Image sensor and electronic device

Abstract

The invention discloses an image sensor and electronic equipment. The image sensor provided by the invention comprises a pixel array and a color filter array, the pixel array comprises at least one multispectral unit, and the multispectral unit comprises at least two first-class pixels used for image imaging and at least one second-class pixel used for multispectral imaging; the color filter array comprises a filter unit, and the filter unit comprises at least two first-class filter elements and at least one second-class filter element. The first type of filtering elements and the first type of pixels are oppositely arranged; the second type of filtering elements and the second type of pixels are oppositely arranged; the wavelength ranges of light which can penetrate through the first type of light filtering elements and the second type of light filtering elements are different, and the at least one second type of light filtering element comprises at least one type of light filtering element; the light filtering unit comprises r first-class light filtering elements, the r first-class light filtering elements are distributed in a p # imgabs0 # q array, the wavelength ranges of light which can penetrate through the r first-class light filtering elements are the same, p and q are positive integers, and r is equal to p # imgabs1 # q.

Description

Technical Field

[0001] This application belongs to the technical field of imaging devices, and particularly relates to an image sensor and an electronic device. Background Art

[0002] With the rapid development of electronic devices such as mobile phones, the types of sensors integrated on electronic devices are increasing. Electronic devices generally use image sensors for photographing and video recording. In order to optimize the video recording effect of smartphones in different light environments and improve the color reproduction and performance capabilities, multi-spectral sensors that can identify the spectral characteristics of the environment have become an essential configuration for smartphones.

[0003] Currently, in the scenario where a multi-spectral sensor assists an image sensor in video recording, the environmental spectral characteristic information obtained by the multi-spectral sensor is used to adjust the image captured by the image sensor, improving the color reproduction and performance capabilities of the image. The image sensor uses one imaging camera for photographing, while the multi-spectral sensor separately uses another camera to capture spectral information in multiple wavelength ranges, resulting in an increase in hardware power consumption. Summary of the Invention

[0004] This application provides an image sensor and an electronic device. The image sensor can balance the image imaging function and the multi-spectral imaging function, without the need to set up an additional multi-spectral sensor to identify multi-spectral information, reducing the hardware power consumption.

[0005] In a first aspect, this application provides an image sensor, including: a pixel array and a color filter array; The pixel array includes at least one multi-spectral unit, and the multi-spectral unit includes at least two first-type pixels for image imaging and at least one second-type pixel for multi-spectral imaging; The color filter array includes a filter unit disposed opposite to the multi-spectral unit. The filter unit includes a first-type filter element and a second-type filter element. The first-type filter element is disposed opposite to the first-type pixel; the second-type filter element is disposed opposite to the second-type pixel; The wavelength range of light that the first-type filter element can transmit is different from the wavelength range of light that the second-type filter element can transmit. The second-type filter element includes multiple filter elements, and each filter element corresponds to a wavelength range of light that can be transmitted. The wavelength ranges of light that the multiple filter elements can transmit are different; Wherein, the filter unit includes r first-type filter elements, and the r first-type filter elements are distributed in a p q array, and the wavelength ranges of light that the r first-type filter elements 211 can transmit are the same. Both p and q are positive integers, and r = p q.

[0006] Second aspect, the present application provides an electronic device, including an image sensor as provided in the first aspect.

[0007] In an embodiment of the present application, the image sensor includes a pixel array and a color filter array; the pixel array includes at least one multispectral unit, and the multispectral unit includes at least two first-type pixels for image imaging and at least one second-type pixel for multispectral imaging; the color filter array includes filter units disposed opposite to the multispectral units, and the filter units include at least two first-type filter elements and at least one second-type filter element, the first-type filter elements are disposed opposite to the first-type pixels; the second-type filter elements are disposed opposite to the second-type pixels; the wavelength ranges of light that can pass through the first-type filter elements and the second-type filter elements are different, and at least one second-type filter element includes at least one type of filter element; wherein, the filter unit includes r first-type filter elements, and the r first-type filter elements are arranged in a p q array distribution, the wavelength ranges of light that can pass through the r first-type filter elements are the same, and both p and q are positive integers, and r = p q. In this way, in the image sensor, the multispectral unit includes first-type pixels for image imaging and at least one second-type pixel for multispectral imaging, the filter unit includes first-type filter elements disposed opposite to the first-type pixels and second-type filter elements disposed opposite to the second-type pixels, the image sensor realizes image imaging through the color channels corresponding to the first-type filter elements, and, identifies multispectral information through the color channels corresponding to the second-type filter elements to realize multispectral imaging, so that the image sensor can take into account both the image imaging function and the multispectral imaging function, without setting an additional multispectral sensor to identify multispectral information, reducing the hardware power consumption. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] Figure 1 Schematic diagram of an image sensor provided for some embodiments of the present application; Figure 2 Schematic diagram of an image sensor provided for some embodiments of the present application; Figure 3A Schematic diagram of the minimum unit of an image sensor provided for some embodiments of the present application; Figure 3B Schematic diagram of a filter unit provided for some embodiments of the present application; Figure 3C Schematic diagram of a filter unit provided for some embodiments of the present application; Figure 3D Schematic diagram of a filter unit provided for some embodiments of the present application; Figure 4A Schematic diagram of a filter unit provided for some embodiments of the present application; Figure 4BSchematic diagram of a filter unit provided for some embodiments of the present application; Figure 5A Schematic diagram of a filter unit provided for some embodiments of the present application; Figure 5B Schematic diagram of a filter unit provided for some embodiments of the present application; Figure 5C Schematic diagram of a filter unit provided for some embodiments of the present application; Figure 5D Schematic diagram of a filter unit provided for some embodiments of the present application; Figure 5E Schematic diagram of a filter unit provided for some embodiments of the present application; Figure 6 Schematic diagram of an electronic device provided for some embodiments of the present application.

[0009] Description of reference numerals: 10 - Image sensor; 100 - Pixel array; 110 - Multispectral unit; 111 - First type of pixel; 112 - Second type of pixel; 200 - Color filter array; 210 - Filter unit; 211 - First type of filter element; R - Red filter element; G - Green filter element; Gr - Green - biased red filter element; Gb - Green - biased blue filter element; B - Blue filter element; 212 - Second type of filter element; F1 - First filter element; F2 - Second filter element; F3 - Third filter element; F4 - Fourth filter element; F5 - Fifth filter element; F6 - Sixth filter element; F7 - Seventh filter element; F8 - Eighth filter element; 220 - Minimum unit of the image sensor; 300 - Microlens array; 301 - Microlens; 600 - Electronic device. Detailed description of the specific implementation

[0010] Embodiments of the present application will be described in detail below. Examples of the embodiments are shown in the accompanying drawings, where the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary only for explaining the present application and should not be construed as limiting the present application. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in the present application without creative efforts fall within the scope of protection of the present application.

[0011] The terms "first" and "second" in the description and claims of this application may explicitly or implicitly include one or more of such features. In the description of this application, unless otherwise specified, the meaning of "a plurality" is two or more. In addition, "and / or" in the description and claims means at least one of the connected objects, and the character " / ", generally represents an "or" relationship between the associated objects before and after.

[0012] In the description of this application, it should be understood that the orientation or positional relationship indicated by terms such as "inner" and "outer" is based on the orientation or positional relationship shown in the drawings. It is only for the convenience of describing this application and simplifying the description, rather than indicating or implying that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be construed as a limitation to this application.

[0013] In the description of this application, it should be noted that unless otherwise clearly specified and limited, the terms "connected" and "connected" should be understood in a broad sense. For example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be directly connected, or indirectly connected through an intermediate medium, and it can be the communication inside two elements. For those of ordinary skill in the art, the specific meanings of the above terms in this application can be understood according to specific circumstances.

[0014] The terms used in the implementation part of this application are only used to explain the specific embodiments of this application, and are not intended to limit this application.

[0015] The terms related to the embodiments of this application will be explained below.

[0016] Image sensor: A device that converts an optical signal into an electrical signal and generates an image based on the electrical signal. The image sensor may include a pixel array, a color filter array, and a microlens array stacked in sequence. The pixel array may include a first type of pixel and a second type of pixel, and the color filter array may include a first type of filter element and a second type of filter element.

[0017] Pixel: It can be divided into a first type of pixel and a second type of pixel. A pixel refers to the smallest element in the pixel array.

[0018] First type of pixel: The first type of pixel is used for image imaging. For example, pixel data output by the first type of pixel is used to synthesize an image. In practical applications, during the process of synthesizing an image, the first type of pixel can be regarded as an effective pixel, and the second type of pixel can be regarded as a defective pixel for processing.

[0019] Second type of pixels: The second type of pixels is used for multispectral imaging, which refers to imaging using multiple spectral information. For example, imaging is performed using the multiple spectral information output by the second type of pixels. In practical applications, during the process of multispectral imaging, the multiple spectral information output by the second type of pixels can effectively improve the color representation ability of the image.

[0020] First type of filter element: The first type of filter element is a filter element corresponding to the first type of pixels. The first type of pixels can sense the light passing through the first type of filter element.

[0021] Second type of filter element: The second type of filter element is a filter element corresponding to the second type of pixels. The second type of pixels can sense the light passing through the second type of filter element.

[0022] The embodiments of the present application provide an image sensor and an electronic device, which will be described in detail below with reference to the accompanying drawings.

[0023] Figure 1 A schematic structural diagram of an image sensor provided by an embodiment of the present application is shown.

[0024] As Figure 1 shown, an image sensor 10 provided by an embodiment of the present application may include: a pixel array 100 and a color filter array 200; the pixel array 100 may include at least one multispectral unit 110, and the multispectral unit 110 includes at least two first type of pixels 111 for image imaging and at least one second type of pixels 112 for multispectral imaging; the color filter array 200 includes a filter unit 210 disposed opposite to the multispectral unit, and the filter unit 210 includes at least two first type of filter elements 211 and at least one second type of filter element 212, the first type of filter elements 211 are disposed opposite to the first type of pixels 111; the second type of filter elements 212 are disposed opposite to the second type of pixels 112; the light wavelength ranges that the first type of filter elements 211 and the second type of filter elements 212 can transmit are different, and at least one second type of filter element 212 includes at least one type of filter element.

[0025] In the embodiments of the present application, the first type of pixels 111 is used for image imaging. For example, an image is generated using the pixel data output by the first type of pixels 111. In practical applications, during the process of generating an image, the first type of pixels 111 can be regarded as effective pixels, and the second type of pixels 112 can be regarded as defective pixels for processing.

[0026] In some embodiments of the present application, the second type of pixel 112 is used for multispectral imaging. Multispectral imaging refers to imaging using multiple spectral information. For example, imaging is performed using the multiple spectral information output by the second type of pixel 112. In practical applications, during the process of multispectral imaging, the multiple spectral information output by the second type of pixel 112 can effectively improve the color performance of the image.

[0027] In some embodiments of the present application, when the second type of filter element 212 includes multiple filter elements, each filter element corresponds to a range of light wavelengths that can pass through, and the ranges of light wavelengths that can pass through the multiple filter elements are different.

[0028] In some embodiments of the present application, as Figure 2 shown, the pixel array 100 and the color filter array 200 can be stacked. The pixel array 100 can include multiple pixels, and the color filter array 200 can include multiple filter elements. One pixel corresponds to one filter element.

[0029] For example, as Figure 2 shown, the image sensor can include a pixel array 100, a color filter array 200, and a microlens array 300 that are stacked in sequence. Among them, in the microlens array 300, each microlens 301 is used to better collect light; in the color filter array 200, filter elements such as the first type of filter element 211 and the second type of filter element 212 are used to filter light of different colors; in the pixel array 100, pixels such as the first type of pixel 111 and the second type of pixel 112 can sense the light transmitted through the filter element and perform photoelectric conversion processing to output an electrical signal.

[0030] Among them, in the pixel array 100, pixels such as the first type of pixel 111 and the second type of pixel 112 can both adopt a typical 4T-PPD (Four Transistors Pinned Photodiode) pixel structure. The 4T-PPD pixel structure can include a sensing region of a PPD and 4 transistors, and its working principle includes the following six steps: The first step is exposure. The electron-hole pairs generated by light irradiation are separated due to the existence of the PPD electric field. Electrons move towards the n region, and holes move towards the p region. The second step is reset. At the end of exposure, the RST transistor is activated to reset the readout region, that is, the n + region of the PPD, to a high level. The third step is reset level readout. After reset is completed, the reset level is read out, which includes the offset noise, 1 / f noise of the operational amplifier, and the kTC noise introduced by reset. The read signal is stored in the first capacitor. The fourth step is charge transfer. The TX transistor is activated to completely transfer the charge from the photosensitive region to the n +The area is used for reading out, and the mechanism here is similar to the charge transfer in a CCD. In the fifth step, the signal level is read out. The voltage signal in the n + area is read out to the second capacitor. The signals here include: the signal generated by photoelectric conversion, the offset generated by the operational amplifier, 1 / f noise, and the kTC noise introduced by reset. In the sixth step, the signal is output. The signals stored in the two capacitors are subtracted, and the obtained signal is amplified analogously and then sampled by an Analog-to-Digital Converter (ADC) to perform digital signal output.

[0031] Of course, in the pixel array 100, pixels such as the first type of pixel 111 and the second type of pixel 112 can also adopt other pixel circuit structures, and the present application does not make specific limitations thereto.

[0032] In some embodiments of the present application, the pixel array 100 may include at least one multispectral unit 110, the color filter array 200 may include at least one filter unit 210, one multispectral unit 110 corresponds to one filter unit 210, and the number of multispectral units 110 is the same as the number of filter units 210. Moreover, one pixel in one multispectral unit 110 corresponds to one filter element in one filter unit 210.

[0033] In some embodiments of the present application, for the microlens array, one microlens may correspond to at least one filter element. For example, referring to Figure 2 , one filter element 111 can use one microlens 301 alone to collect light. Or, in other embodiments, multiple filter elements can share one microlens to collect light, and the present application does not make specific limitations thereto.

[0034] In the image sensor provided by the embodiments of the present application, one multispectral unit 110 in the pixel array 100 is composed of the first type of pixel 111 for image imaging and at least one second type of pixel 112 for multispectral imaging. Correspondingly, one filter unit 210 in the color filter array 200 is composed of the first type of filter element 211 corresponding to the first type of pixel 111 and the second type of filter element 212 corresponding to the second type of pixel 112. In this way, the image sensor 10 realizes image imaging through the color channel corresponding to the first type of filter element 211, and identifies multispectral information through the color channel corresponding to the second type of filter element 212 to realize multispectral imaging, so that the image sensor 10 can take into account both the image imaging function and the multispectral imaging function, without setting an additional multispectral sensor to identify multispectral information, reducing the hardware power consumption.

[0035] An image sensor provided according to an embodiment of the present application, the image sensor includes a pixel array and a color filter array; the pixel array includes at least one multispectral unit, and the multispectral unit includes at least two first-type pixels for image imaging and at least one second-type pixel for multispectral imaging; the color filter array includes a filter unit disposed opposite to the multispectral unit, and the filter unit includes at least two first-type filter elements and at least one second-type filter element, the first-type filter elements are disposed opposite to the first-type pixels; the second-type filter elements are disposed opposite to the second-type pixels; the wavelength ranges of light that the first-type filter elements and the second-type filter elements can transmit are different, and at least one second-type filter element includes at least one type of filter element. In this way, in the image sensor, the multispectral unit includes first-type pixels for image imaging and at least one second-type pixel for multispectral imaging, the filter unit includes first-type filter elements disposed opposite to the first-type pixels and second-type filter elements disposed opposite to the second-type pixels, the image sensor realizes image imaging through the color channels corresponding to the first-type filter elements, and, identifies multispectral information through the color channels corresponding to the second-type filter elements to realize multispectral imaging, so that the image sensor can take into account both the image imaging function and the multispectral imaging function, without setting an additional multispectral sensor to identify multispectral information, reducing the hardware power consumption.

[0036] In some embodiments of the present application, in the color filter array 200, the first-type filter elements 211 may include at least one type of color filter element, wherein the color filter element may include a red filter element R, a green filter element G, a blue filter element B, a cyan filter element C, a magenta filter element M, a yellow filter element Y, and an all-pass filter element W.

[0037] In a specific embodiment, taking the first-type filter elements 211 including three filter elements as an example, the three filter elements can transmit light of three color channels. The first-type filter elements 211 in the color filter array 200 can be arranged in the order of RGGB, RYYB, RWWB or other ways to achieve the function of image imaging. The present application does not specifically limit the types and arrangement ways of the filter elements of the first-type filter elements 211.

[0038] For example, taking the case where the first type of filter element 211 includes three filter elements as an example, the first type of filter element 211 may include a red filter element R and a blue filter element B; the first type of filter element 211 may also include at least one of a green filter element G, a yellow filter element Y, and a clear filter element W. Among them, the light wavelength range that the red filter element R can transmit is the red light band, the light wavelength range that the blue filter element B can transmit is the blue light band, the light wavelength range that the green filter element G can transmit is the green light band, the light wavelength range that the yellow filter element Y can transmit is the yellow light band, and the light wavelength range that the clear filter element W can transmit is the full-spectrum light band, and the full-spectrum light is white light.

[0039] For example, as Figure 3A shown, when the first type of filter element includes a red filter element R, a green filter element G, and a blue filter element B, the color filter array may include a plurality of minimum units. In a minimum unit 220 of the color filter array, the quantity ratio of the red filter element R, the green filter element G, and the blue filter element B is 1:2:1. Among them, the green filter element G adjacent to the red filter element R may be a greenish-red filter element Gr, and the green filter element G adjacent to the blue filter element B in terms of position may be a greenish-blue filter element Gb. In this way, the first type of filter element can be arranged in the RGGB manner in the color filter array 200, and the color filter array arranged in the RGGB manner can be called a Bayer array.

[0040] Again, for example, in other embodiments, when the first type of filter element includes a red filter element R, a yellow filter element Y, and a blue filter element B, in the color filter array 200, the quantity ratio of the red filter element R, the yellow filter element Y, and the blue filter element B is 1:2:1. In this way, compared with the Figure 3A embodiment shown, the green filter element G in the first type of filter element can be replaced with a yellow filter element Y, and the first type of filter element is arranged in the RYYB manner in the color filter array 200.

[0041] Again, for example, in other embodiments, when the first type of filter element includes a red filter element R, a clear filter element W, and a blue filter element B, in the color filter array 200, the quantity ratio of the red filter element R, the clear filter element W, and the blue filter element B is 1:2:1. In this way, compared with the Figure 3A embodiment shown, the green filter element G in the first type of filter element can be replaced with a clear filter element W, and the first type of filter element is arranged in the RWWB manner in the color filter array 200. The embodiments of the present application do not specifically limit the arrangement manner of the first type of filter element in the color filter array.

[0042] In some embodiments of the present application, in order to achieve multispectral imaging, the color channels corresponding to the second type of filter element can identify spectral information in multiple band ranges, and there can be various types of filter elements corresponding to the second type of filter element 212.

[0043] In some embodiments of the present application, the second type of filter element 212 may include visible light filter elements, infrared light filter elements, ultraviolet light filter elements, and so on.

[0044] For example, for visible light filter elements, the second type of filter element 212 may include filter elements for various colors of light. For example, a cyan filter element C, a yellow filter element Y, a magenta filter element M, a purple filter element P, an orange filter element O, and a full-pass filter element W.

[0045] Among them, the second type of filter element 212 may include filter elements with the same spectral curve but different transmittances. For example, the second type of filter element 212 may include a lighter color filter element with the same spectral shape and a transmittance of 80%, or a darker color filter element with the same spectral shape and a transmittance of 30%, and so on. For example, the second type of filter element 212 may include a yellow filter element Y, and the yellow filter element Y may also be divided into a light yellow filter element with a transmittance of 80%, a dark yellow filter element with a transmittance of 30%, and so on. The embodiments of the present application do not make specific settings for the transmittance of the second type of filter element 212 under the same spectral shape.

[0046] Among them, the second type of filter element 212 may also include filter elements with different spectral shapes. Different spectral shapes correspond to different colors that the human eye can perceive within the visible light range. For example, the second type of filter element 212 may include a yellow-green filter element or a cyan-blue filter element within the visible light range, and so on. In the non-visible light band, it may include a near-infrared filter element that transmits 940 nm - 945 nm, a short-wave infrared filter element that transmits 1400 - 1500 nm, and so on. The embodiments of the present application do not make specific settings for the spectral curves that the second type of filter element 212 can transmit.

[0047] In some embodiments of the present application, in the color filter array 200, the first type of filter element 211 may include at least one filter element, and at least one filter element can transmit at least one light band range to obtain at least one color channel information for image imaging. The second type of filter element 212 may include at least one filter element, and at least one filter element can transmit at least one light band range to meet the function of multispectral imaging.

[0048] In some embodiments of the present application, in some embodiments of the present application, the second type of filter element 212 may also include narrow-band filter elements and wide-band filter elements, and so on.

[0049] Among them, the wavelength range of light that the second type of filter element 212 can transmit can be of a narrow-band type or a wide-band type, and the present application does not limit this. Among them, the difference between the narrow-band type and the wide-band type lies in that when performing multispectral imaging using spectral feature information, a single narrow-band type of light wavelength range can represent a spectral feature information, while at least two wide-band type of light wavelength ranges can represent a spectral feature information after being calculated and processed as source data. In addition, the light wavelength range of the narrow-band type is generally narrow and can directly represent the spectral information of a specific color; while the light wavelength range of the wide-band type is generally wide, the light input amount corresponding to the filter element is more sufficient, and the amount of collected signals is larger.

[0050] For example, taking the light wavelength range that the second type of filter element can transmit as an example of the wide-band type, as Figures 3B to 3D shown, in a spectral unit 210, at least one second type of filter element may include at least four of the following: at least four filter elements among the first filter element F1, the second filter element F2, the third filter element F3, the fourth filter element F4, the fifth filter element F5, the sixth filter element F6, the seventh filter element F7, and the eighth filter element F8; Among them, the light wavelength ranges that at least four filter elements can transmit are different.

[0051] For example, in some specific embodiments of the present application, in a spectral unit 210, at least one second type of filter element may include four of the first filter element F1, the second filter element F2, the third filter element F3, the fourth filter element F4, the fifth filter element F5, the sixth filter element F6, the seventh filter element F7, and the eighth filter element F8. For example, in a spectral unit 210, at least one second type of filter element may include the first filter element F1, the second filter element F2, the third filter element F3, and the fourth filter element F4. For example, in a spectral unit 210, at least one second type of filter element may include the fifth filter element F5, the sixth filter element F6, the seventh filter element F7, and the eighth filter element F8. For example, in a spectral unit 210, at least one second type of filter element may include the first filter element F1, the second filter element F2, the third filter element F3, and the fifth filter element F5. For example, in a spectral unit 210, at least one second type of filter element may include the first filter element F1, the second filter element F2, the third filter element F3, and the sixth filter element F6.

[0052] For example, in some specific embodiments of the present application, in a spectral unit 210, at least one second type of filter element may include five of the first filter element F1, the second filter element F2, the third filter element F3, the fourth filter element F4, the fifth filter element F5, the sixth filter element F6, the seventh filter element F7, and the eighth filter element F8. For example, in some specific embodiments of the present application, in a spectral unit 210, at least one second type of filter element may include the first filter element F1, the second filter element F2, the third filter element F3, the fourth filter element F4, and the fifth filter element F5. For example, in some specific embodiments of the present application, in a spectral unit 210, at least one second type of filter element may include the first filter element F1, the third filter element F3, the sixth filter element F6, the seventh filter element F7, and the eighth filter element F8.

[0053] For example, in some specific embodiments of the present application, in a spectral unit 210, at least one second type of filter element may include six of the first filter element F1, the second filter element F2, the third filter element F3, the fourth filter element F4, the fifth filter element F5, the sixth filter element F6, the seventh filter element F7, and the eighth filter element F8. For example, in a spectral unit 210, at least one second type of filter element may include the first filter element F1, the second filter element F2, the third filter element F3, the fourth filter element F4, the fifth filter element F5, and the sixth filter element F6. For example, in a spectral unit 210, at least one second type of filter element may include the first filter element F1, the second filter element F2, the third filter element F3, the fourth filter element F4, the fifth filter element F5, and the seventh filter element F7. For example, in a spectral unit 210, at least one second type of filter element may include the first filter element F1, the second filter element F2, the third filter element F3, the fourth filter element F4, the fifth filter element F5, and the eighth filter element F8.

[0054] For example, in some specific embodiments of the present application, in a spectral unit 210, at least one second type of filter element may include seven of the first filter element F1, the second filter element F2, the third filter element F3, the fourth filter element F4, the fifth filter element F5, the sixth filter element F6, the seventh filter element F7, and the eighth filter element F8. For example, in a spectral unit 210, at least one second type of filter element may include the first filter element F1, the second filter element F2, the third filter element F3, the fourth filter element F4, the fifth filter element F5, the sixth filter element F6, and the seventh filter element F7. For example, in a spectral unit 210, at least one second type of filter element may include the first filter element F1, the second filter element F2, the third filter element F3, the fourth filter element F4, the fifth filter element F5, the sixth filter element F6, and the eighth filter element F8. For example, in a spectral unit 210, at least one second type of filter element may include the first filter element F1, the second filter element F2, the third filter element F3, the fourth filter element F4, the fifth filter element F5, the seventh filter element F7, and the eighth filter element F8.

[0055] For example, in some specific embodiments of the present application, in a spectral unit 210, at least one second type of filter element may include the first filter element F1, the second filter element F2, the third filter element F3, the fourth filter element F4, the fifth filter element F5, the sixth filter element F6, the seventh filter element F7, and the eighth filter element F8.

[0056] It should be noted that the types and quantities of the second type of filter elements in the embodiments of the present application can be set according to actual needs, and the present application does not make specific limitations thereto.

[0057] In this way, by setting at least four of the first filter element F1, the second filter element F2, the third filter element F3, the fourth filter element F4, the fifth filter element F5, the sixth filter element F6, the seventh filter element F7, and the eighth filter element F8 as the second type of filter elements in the embodiments of the present application, the image sensor can identify at least four spectral information and achieve the multi-spectral imaging function.

[0058] Moreover, when the second type of filter element 212 includes at least four of the first filter element F1, the second filter element F2, the third filter element F3, the fourth filter element F4, the fifth filter element F5, the sixth filter element F6, the seventh filter element F7, and the eighth filter element F8, there is an overlapping part in the light wavelength ranges that at least two of the at least four filter elements can transmit.

[0059] For example, in some specific embodiments of the present application, in a spectral unit 210, at least one second type of filter element may include a first filter element F1, a second filter element F2, a third filter element F3, and a fourth filter element F4. Among them, there is an overlapping part in the light wavelength ranges that the second filter element F2 and the fourth filter element F4 can transmit.

[0060] For example, in some specific embodiments of the present application, in a spectral unit 210, at least one second type of filter element may include a fifth filter element F5, a sixth filter element F6, a seventh filter element F7, and an eighth filter element F8. Among them, there is an overlapping part in the light wavelength ranges that the fifth filter element F5 and the sixth filter element F6 can transmit, there is an overlapping part in the light wavelength ranges that the fifth filter element F5 and the seventh filter element F7 can transmit, and there is an overlapping part in the light wavelength ranges that the sixth filter element F6 and the eighth filter element F8 can transmit.

[0061] Among them, when performing multispectral imaging using the spectral feature information obtained based on the second type of filter element 212, the light wavelength ranges that at least two filter elements in the second type of filter element 212 can transmit are used as source data for calculation and processing, and can represent a kind of spectral feature information. And because at least four light wavelength ranges that can be transmitted are relatively wide, the light incident on the corresponding filter elements is more sufficient, and the amount of signal collected is larger.

[0062] In a specific example, the more types of filter elements in the second type of filter element, the richer the identified multispectral information and the better the multispectral imaging function. For example, as Figure 5B shown, in a spectral unit 210, at least one second type of filter element may include a first filter element F1, a second filter element F2, a third filter element F3, a fourth filter element F4, a fifth filter element F5, a sixth filter element F6, a seventh filter element F7, and an eighth filter element F8.

[0063] Moreover, the light wavelength ranges that the first filter element F1, the second filter element F2, the third filter element F3, the fourth filter element F4, the fifth filter element F5, the sixth filter element F6, the seventh filter element F7, and the eighth filter element F8 can transmit are different.

[0064] In this way, by setting eight filter elements in the second type of filter element 212 in the embodiments of the present application, the image sensor can realize the multispectral imaging function by identifying eight kinds of spectral information. And because the eight light wavelength ranges that can be transmitted are relatively wide, the light incident on the corresponding filter elements is more sufficient, and the amount of signal collected is larger.

[0065] In a specific example, the wavelength range of light that the first filter element F1 can transmit is 420 nanometers to 460 nanometers; the wavelength range of light that the second filter element F2 can transmit is 670 nanometers to 700 nanometers; the wavelength range of light that the third filter element F3 can transmit is 520 nanometers to 610 nanometers; the wavelength range of light that the fourth filter element F4 can transmit is 610 nanometers to 700 nanometers; the wavelength range of light that the fifth filter element F5 can transmit is 430 nanometers to 510 nanometers; the wavelength range of light that the sixth filter element F6 can transmit is 450 nanometers to 590 nanometers; the wavelength range of light that the seventh filter element F7 can transmit is 400 nanometers to 440 nanometers; the wavelength range of light that the eighth filter element F8 can transmit is 560 nanometers to 700 nanometers.

[0066] In this way, there is an overlapping part in the wavelength ranges of light that two or more of the above eight filter elements F1 to F8 can transmit. When performing multispectral imaging using the spectral feature information obtained based on the above eight filter elements, there is an overlapping part in the wavelength ranges of light that at least two filter elements in the second type of filter element 212 can transmit. After the corresponding at least two pixel data are used as source data for calculation and processing, they can represent a spectral feature information. In this way, due to the relatively wide wavelength ranges of light that the above eight filter elements can transmit, and there is an overlapping part in the wavelength ranges of light that two or more filter elements can transmit, the light incident on the corresponding filter elements is more sufficient, and the amount of collected signals is larger.

[0067] In practical applications, in the scenario where the image sensor is arranged in a traditional Bayer array, each filter element (i.e., the first type of filter element) has an independent microlens to collect light. However, the image sensor provided by the embodiment of the present application can adopt OCL (On Chip Lens) technology to share an optical unit to collect light for adjacent identical-color first type of filter elements. The optical unit can be an OCL. This solution can achieve more light integration while maintaining the light transmission efficiency, and can provide higher phase focusing accuracy in a low-light environment, thereby significantly improving the phase focusing performance.

[0068] For example, in a specific embodiment, in the image sensor provided by the embodiment of the present application, the filter unit 210 may include r first type of filter elements 211, and the r first type of filter elements are distributed in a p q array. The wavelength ranges of light that the r first type of filter elements 211 can transmit are the same, and both p and q are positive integers, and r = p q.

[0069] Among them, the r first type of filter elements 211 can share an optical unit.

[0070] Among them, in a filter unit, at least two first-type filter elements may include filter elements, wherein q filter elements share one optical unit, and the wavelength ranges of light that the q filter elements can transmit are the same.

[0071] In this way, when the first-type pixels corresponding to the first-type filter elements are used as PDAF (Phase Detection AutoFocus) pixels, among the first-type filter elements, q filter elements share one optical unit, which can achieve more light integration while maintaining the light transmission efficiency, and can provide higher phase focusing accuracy in low light environments, thus significantly improving the phase focusing performance.

[0072] For example, taking p as 2 and q as 2, taking an image sensor with an OCL Bayer array as an example, the Bayer array refers to a color filter array arranged in the RGGB pattern, OCL means that 4 adjacent filter elements of the same color share one microlens. The green filter element G may specifically include: a greenish-red filter element Gr adjacent to the red filter element R in position, and a greenish-blue filter element Gb adjacent to the blue filter element B in position. The first-type filter element 211 may include a red filter element R, a greenish-blue filter element Gb, a greenish-red filter element Gr, and a blue filter element B. The q filter elements are the same type of filter element selected from a red filter element R, a greenish-blue filter element Gb, a greenish-red filter element Gr, and a blue filter element B.

[0073] Among them, as Figure 3A shown, in an image sensor designed with an OCL Bayer array, the minimum unit 220 is composed of 16 filter elements. Among them, the minimum unit 220 may include 4 red filter elements R, 4 greenish-red filter elements Gr, 4 greenish-blue filter elements Gb, and 4 blue filter elements B.

[0074] Among them, in the minimum unit 220, the 4 red filter elements R are distributed in a 2 × 2 array, the 4 red filter elements R correspond to 4 first-type pixels one by one, and the 4 red filter elements R share one optical unit; the optical unit is represented by a dotted circle or ellipse. Among them, the 4 greenish-red filter elements Gr are distributed in a 2 2 - array distribution, 4 red filter elements R correspond one - to - one with 4 first - type pixels, and 4 green - biased - red filter elements Gr share one optical unit. Among them, 4 green - biased - blue filter elements Gb are in a 2 2 - array distribution, 4 red filter elements R correspond one - to - one with 4 first - type pixels, and 4 green - biased - blue filter elements Gb share one optical unit. Among them, 4 blue filter elements B are in a 2 2 - array distribution, 4 blue filter elements B correspond one - to - one with 4 first - type pixels, and 4 blue filter elements B share one optical unit.

[0075] In this case, among the first - type filter elements, filter elements of the same color share one optical unit, and the light input amount of a single color channel is increased to four times the original, which can achieve more light integration while maintaining the light - transmission efficiency.

[0076] Thus, when the first - type pixels corresponding to the red filter element R, the green - biased - blue filter element Gb, the green - biased - red filter element Gr, and the blue filter element B are used as PDAF pixels, 4 red filter elements R share one optical unit, 4 green - biased - blue filter elements Gb share one optical unit, 4 green - biased - red filter elements Gr share one optical unit, 4 blue filter elements B share one optical unit, which can achieve more light integration while maintaining the light - transmission efficiency, and can provide higher phase - focusing accuracy in low - light environments, thus significantly improving the phase - focusing performance.

[0077] Moreover, since the embodiment of the present application also sets at least one second - type pixel 112 for multi - spectral imaging and a second - type filter element 212 corresponding to the second - type pixel 112 in the image sensor, the second - type pixel 112 can also be used as a PDAF pixel in the embodiment of the present application. When the second - type pixel 112 is a PDAF pixel, due to the richer color channels of the second - type filter element 212 corresponding to the second - type pixel 112, introducing the color - channel information of the second - type filter element 212 into the PDAF algorithm can significantly improve the phase - focusing accuracy.

[0078] For example, in a specific embodiment, in a filter unit, the filter unit 210 may include t second - type filter elements 212, and the t second - type filter elements 212 are in a array distribution, the t second - type filter elements 212 share one optical unit, and the light - wavelength ranges that the t second - type filter elements 212 can transmit are the same, m and n are both positive integers, and t = .

[0079] Among them, is greater than or equal to 1. In when it is equal to 1, corresponding to the image sensor designed by OCL, where a second type of filter element uses one OCL alone to collect light. In when it is greater than 1, multiple second type of filter elements share one OCL to collect light. And when multiple second type of filter elements share one OCL to collect light, more light integration can be achieved while maintaining the light transmission efficiency, and higher phase focusing accuracy can be provided in low light environments, thus significantly improving the phase focusing performance. Moreover, since the color channels corresponding to the second type of filter element 212 are richer, introducing the color channel information of the second type of filter element 212 into the PDAF algorithm can further improve the phase focusing accuracy.

[0080] In some embodiments of the present application, referring to Figures 5B to 5D , when the second type of filter element includes at least four filter elements among the first filter element F1, the second filter element F2, the third filter element F3, the fourth filter element F4, the fifth filter element F5, the sixth filter element F6, the seventh filter element F7, and the eighth filter element F8, t second type of filter elements 212 can be the same filter element selected from the above at least four filter elements, and there is an overlapping part in the light wavelength ranges that at least two of the above at least four filter elements can transmit.

[0081] For example, taking m as 1 and n as 2 as an example, the multispectral unit 110 can include two second type of pixels distributed in an array, and the filter unit 210 can include two second type of filter elements distributed in an array, and the two second type of pixels and the two second type of filter elements are arranged in one-to-one correspondence.

[0082] Among them, filter elements cover second type of pixels, and filter elements and second type of pixels can be aligned in the vertical direction.

[0083] As Figure 3D shown, in the filter unit 210, the second type of filter elements are the fifth filter element F5, the sixth filter element F6, the seventh filter element F7, and the eighth filter element F8, a fifth filter element F5 shares one optical unit, a sixth filter element F6 shares one optical unit, a seventh filter element F7 shares one optical unit, A total of [number] eighth filter elements F8 share one optical unit.

[0084] Moreover, A total of [number] fifth filter elements F5 are respectively and correspondingly arranged with [number] second type of pixels in the multispectral unit 110. A total of [number] sixth filter elements F6 are respectively and correspondingly arranged with [number] second type of pixels in the multispectral unit 110. A total of [number] seventh filter elements F7 are respectively and correspondingly arranged with [number] second type of pixels in the multispectral unit 110. A total of [number] eighth filter elements F8 are respectively and correspondingly arranged with [number] second type of pixels in the multispectral unit 110. For another example, taking m as 2 and n as 1, the multispectral unit 110 may include two second type of pixels distributed in an array, and the filter unit 210 may include two second type of filter elements distributed in an array. The two second type of pixels and the two second type of filter elements are respectively and correspondingly arranged. Among them, A total of [number] filter elements cover [number] second type of pixels, and A total of [number] filter elements and [number] second type of pixels may be aligned in the vertical direction.

[0085] As shown in [figure reference], in the filter unit 210, the second type of filter elements are the first filter element F1, the second filter element F2, the third filter element F3, and the fourth filter element F4. A total of [number] first filter elements F1 share one optical unit. A total of [number] second filter elements F2 share one optical unit.

[0086] Moreover, A total of [number] first filter elements F1 are respectively and correspondingly arranged with [number] second type of pixels in the multispectral unit 110. A total of [number] second filter elements F2 are respectively and correspondingly arranged with [number] second type of pixels in the multispectral unit 110. A total of [number] third filter elements F3 are respectively and correspondingly arranged with [number] second type of pixels in the multispectral unit 110. A total of [number] fourth filter elements F4 are respectively and correspondingly arranged with [number] second type of pixels in the multispectral unit 110.

[0087] For example, Figure 4A As shown in [figure reference], in the filter unit 210, the second type of filter elements are the first filter element F1, the second filter element F2, the third filter element F3, and the fourth filter element F4. A total of [number] first filter elements F1 share one optical unit. A total of [number] second filter elements F2 share one optical unit. A total of [number] third filter elements F3 share one optical unit. A total of [number] fourth filter elements F4 share one optical unit.

[0088] Moreover, A total of [number] first filter elements F1 are respectively and correspondingly arranged with [number] second type of pixels in the multispectral unit 110. A total of [number] second filter elements F2 are respectively and correspondingly arranged with [number] second type of pixels in the multispectral unit 110. A total of [number] third filter elements F3 are respectively and correspondingly arranged with [number] second type of pixels in the multispectral unit 110. A total of [number] fourth filter elements F4 are respectively and correspondingly arranged with [number] second type of pixels in the multispectral unit 110. A total of [number] third filter elements F3 are respectively and correspondingly arranged with [number] second type of pixels in the multispectral unit 110. A total of [number] fourth filter elements F4 are respectively and correspondingly arranged with [number] second type of pixels in the multispectral unit 110. Note: The numbers in brackets (e.g., [number]) need to be filled with the actual numbers in the original text. Since the original text has placeholders like this, the translation also retains this form for clarity and to match the original structure.One fourth filter element F4 and those in the multispectral unit 110 are set in one-to-one correspondence with the second type of pixels.

[0089] In this case, among the second type of filter elements, a plurality of filter elements share one optical unit, or a plurality of filter elements share one optical unit, and the light incident amount of a single color channel is increased to twice the original amount, so that more light integration can be achieved while maintaining the light transmission efficiency.

[0090] For another example, taking m as 2 and n as 2 as an example, the multispectral unit 110 may include four second type of pixels distributed in an array, and the filter unit 210 may include four second type of filter elements distributed in an array. The four second type of pixels and the four second type of filter elements are set in one-to-one correspondence.

[0091] Among them, a plurality of filter elements cover a plurality of second type of pixels, and a plurality of filter elements and a plurality of second type of pixels may be aligned in the vertical direction.

[0092] As Figure 4B shown, in a filter unit 210, the second type of filter elements are the first filter element F1, the second filter element F2, the third filter element F3, and the fourth filter element F4. A plurality of first filter elements F1 share one optical unit. A plurality of second filter elements F2 share one optical unit. A plurality of third filter elements F3 share one optical unit. A plurality of fourth filter elements F4 share one optical unit.

[0093] And, a plurality of first filter elements F1 and a plurality of second type of pixels in the multispectral unit 110 are set in one-to-one correspondence, a plurality of second filter elements F2 and a plurality of second type of pixels in the multispectral unit 110 are set in one-to-one correspondence, a plurality of third filter elements F3 and a plurality of second type of pixels in the multispectral unit 110

[0094] In this case, among the second type of filter elements, A filter element shares an optical unit, and the light input amount of a single color channel is increased to four times the original, which can achieve more light integration while maintaining the light transmission efficiency.

[0095] In this way, when the second type of pixels corresponding to the second type of filter elements are used as PDAF pixels, in the second type of filter elements, A filter element shares an optical unit, which can achieve more light integration while maintaining the light transmission efficiency, and can provide higher phase focusing accuracy in low light environments, thus significantly improving the phase focusing performance. Moreover, since the color channels corresponding to the second type of filter elements are richer, introducing the color channel information of the second type of filter elements into the PDAF algorithm can further improve the phase focusing accuracy.

[0096] In practical applications, taking the RGGB Bayer array designed by OCL as an example, in the image sensor provided by the present application, a part of the original RGB filter elements in the Bayer array can be replaced with the second type of filter elements to obtain a filter unit 210 composed of the first type of filter elements 211 and the second type of filter elements 212, and the color filter array 200 is composed of at least one filter unit 210.

[0097] In some embodiments of the present application, the second type of filter elements can be evenly distributed in the filter unit 210 at a certain density. For example, in a filter unit 210 corresponding to a multi-spectral unit, the value range of the proportion of the number of the second type of filter elements is 1% - 100%; wherein, the proportion of the number of the second type of filter elements is the ratio of the number of the second type of filter elements to the total number of filter elements in the filter unit 210.

[0098] In this way, in some embodiments of the present application, the second type of filter elements can be set in the filter unit 210 corresponding to a multi-spectral unit according to the proportion range of 1% - 100%, so as to realize that the second type of filter elements are evenly distributed in the filter unit 210 at a certain density.

[0099] It should be noted that the larger the proportion of the number of the second type of filter elements, the more the second type of filter elements account for, the greater the density of the multi-spectral channels of the color filter array, the greater the impact on the image imaging function, and the better the effect of the multi-spectral imaging function.

[0100] During the process of image imaging using the first type of pixels with the first type of filter elements arranged oppositely, the second type of pixels with the second type of filter elements arranged oppositely can be treated as bad pixels. To avoid excessive bad pixels from affecting the quality of the generated image, in a filter unit 210 corresponding to a multispectral unit, the proportion of the number of the first type of filter elements can be greater than the proportion of the number of the second type of filter elements. Here, the proportion of the number of the first type of filter elements is the ratio of the number of the first type of filter elements to the total number of filter elements in the filter unit 210, and the proportion of the number of the second type of filter elements is the ratio of the number of the second type of filter elements to the total number of filter elements in the filter unit 210.

[0101] For example, in some embodiments of the present application, in a filter unit 210 corresponding to a multispectral unit, the value range of the proportion of the number of the second type of filter elements 212 is 1% - 50%; Here, the proportion of the number of the second type of filter elements is the ratio of the number of the second type of filter elements to the total number of filter elements in the filter unit 210.

[0102] Here, in a filter unit, the proportion of the number of the second type of filter elements can be understood as the multispectral channel density range of the color filter array.

[0103] In this way, by setting the multispectral channel density range to 1% - 50%, it is possible to avoid the multispectral channel density range being too large and occupying too many color channels of the first type of pixels, thus affecting the quality of the image generated based on the first type of pixels.

[0104] In a specific embodiment, through experiments, it can be obtained that in a filter unit 210, the proportion of the number of the second type of filter elements is 6%. Furthermore, at a 6% multispectral channel density, the image sensor can better balance the image imaging function and the multispectral imaging function.

[0105] Of course, in other embodiments, the proportion of the number of the second type of filter elements can also be set to 1%, 5.5%, 7%, 50%, 60%, 70%, 80%, 100%, or other values, etc. The present application does not make specific limitations in this regard.

[0106] For example, taking the Bayer array designed by OCL as an example, in the image sensor provided by the present application, as Figure 3A shown, the minimum unit 220 of the image sensor is composed of 16 filter elements. Among them, the optical unit is represented by a dotted circle. In the minimum unit, a total of red filter elements R share one optical unit, A greenish-red filter element Gr shares an optical unit, and a blue filter element B shares an optical unit.

[0107] In the embodiments of the present application, multiple minimum units 220 can be divided into a filter unit 210. A filter unit 210 can include multiple minimum units. The present application can select at least one minimum unit from multiple minimum units, and replace at least one first-type filter element in the at least one minimum unit with a second-type filter element, so as to obtain a filter unit 210 composed of a majority of first-type filter elements and a minority of second-type filter elements.

[0108] Among them, in a filter unit 210, the number of minimum units can be set according to actual needs. For example, a filter unit 210 can include minimum units, or minimum units, and so on. The present application does not make specific limitations on this.

[0109] Among them, compared with the minimum unit 220 shown in Figure 3A , in some embodiments of the present application, filter elements such as the red filter element R and the blue filter element B in the minimum unit 220 can be replaced with second-type filter elements to obtain a filter unit.

[0110] For example, as shown in Figure 3B , in the embodiments of the present application, the red filter element R in the minimum unit 220 can be replaced with second-type filter elements, such as the first filter element F1 and the second filter element F2.

[0111] For example, as shown in Figure 3C , in the embodiments of the present application, the blue filter element B in the minimum unit 220 can also be replaced with second-type filter elements, such as the third filter element F3 and the fourth filter element F4.

[0112] For example, as shown in Figure 3D , in the embodiments of the present application, the red filter element R and the blue filter element B in the minimum unit 220 can also be replaced with second-type filter elements, such as the fifth filter element F5, the sixth filter element F6, the seventh filter element F7, and the eighth filter element F8.

[0113] Or, as shown in Figure 4A , a filter unit 210 can also be composed of 1 minimum unit, or as shown in Figure 4B , a filter unit 210 can also be composed of The filter unit 210 may also be composed of a plurality of minimum units. In the embodiments of the present application, the red filter element R and the blue filter element B in the minimum unit 220 may also be replaced with second - type filter elements, such as the first filter element F1, the second filter element F2, the third filter element F3, and the fourth filter element F4.

[0114] In addition, in other embodiments of the present application, the green - biased blue filter element Gb or the green - biased red filter element Gr may be replaced with second - type filter elements, and the present application does not limit this.

[0115] In some embodiments of the present application, as Figures 5A to 5E shown, the filter unit 210 may also be composed of a plurality of minimum units. A minimum unit includes a plurality of filter elements. A filter unit 210 may include 16 ×16 = 256 filter elements. The proportion of the number of second - type filter elements may be selected as 1%, 6%, 5.5%, 7%, or 50%, etc. The present application does not limit the specific value of the proportion of the number of second - type filter elements.

[0116] In some embodiments of the present application, as Figure 5A shown, taking the proportion of the number of second - type filter elements as 1% as an example, 256 ×1% = 2.56. The present application may set 3 second - type filter elements in the filter unit 210 composed of 400 filter elements. Among them, the second - type filter elements set in the filter unit 210 may include two first filter elements F1 and one second filter element F2. In this way, 3 second - type filter elements are set in the filter unit 210 composed of 256 filter elements, and the multi - spectral channel density is about 1%.

[0117] In some embodiments of the present application, as Figure 5B shown, taking the proportion of the number of second - type filter elements as 6% as an example, 256 ×6% = 15.36. 16 second - type filter elements may be set in a filter unit 210, including two first filter elements F1, two second filter elements F2, two third filter elements F3, two fourth filter elements F4, two fifth filter elements F5, two sixth filter elements F6, two seventh filter elements F7, and two eighth filter elements F8. In this way, 16 second - type filter elements are set in the filter unit 210 composed of 256 filter elements, and the multi - spectral channel density is about 6%.

[0118] In some embodiments of the present application, as Figure 5C shown, taking the proportion of the number of second - type filter elements as 5.5% as an example, 256 5.5% = 14.08, 14 second - type filter elements can be set in the filter unit 210 composed of 256 filter elements, including two first - type filter elements F1, two second - type filter elements F2, two third - type filter elements F3, two fourth - type filter elements F4, two sixth - type filter elements F6, two seventh - type filter elements F7, and two eighth - type filter elements F8. In this way, 14 second - type filter elements are set in the filter unit 210 composed of 256 filter elements, and the multi - spectral channel density is about 5.5%. Moreover, compared with the 6% multi - spectral channel density, due to the larger proportion of the first - type filter elements, the image imaging function is better.

[0119] In some embodiments of the present application, as Figure 5D shown, taking the proportion of the number of second - type filter elements as 7% as an example, 256 7% = 17.92, 18 second - type filter elements can be set in the filter unit 210 composed of 400 filter elements, including four first - type filter elements F1, two second - type filter elements F2, two third - type filter elements F3, two fourth - type filter elements F4, two sixth - type filter elements F6, two seventh - type filter elements F7, and two eighth - type filter elements F8. In this way, 18 second - type filter elements are set in the filter unit 210 composed of 256 filter elements, and the multi - spectral channel density is about 7%. Moreover, compared with the 6% multi - spectral channel density, due to the larger proportion of the second - type filter elements, the multi - spectral imaging function is better.

[0120] In some embodiments of the present application, as Figure 5E shown, taking the proportion of the number of second - type filter elements as 50% as an example, 256 50% = 128, the present application can set 128 second - type filter elements in the filter unit 210 composed of 256 filter elements. In this way, 128 second - type filter elements are set in the filter unit 210 composed of 256 filter elements, and the multi - spectral channel density is 50%.

[0121] In other embodiments of the present application, in a filter unit 210, the proportion of the number of second - type filter elements can be 60%, 256 60% = 153.6, the present application can set 154 second - type filter elements in the filter unit 210 composed of 256 filter elements. In this way, 154 second - type filter elements are set in the filter unit 210 composed of 256 filter elements, and the multi - spectral channel density is 60%.

[0122] In other embodiments of the present application, in a filter unit 210, the proportion of the number of second - type filter elements can be 70%, 256 70% = 179.2. In the present application, 180 second - type filter elements can be arranged in the filter unit 210 composed of 256 filter elements. In this way, 180 second - type filter elements are arranged in the filter unit 210 composed of 256 filter elements, and the multi - spectral channel density is 70%.

[0123] In other embodiments of the present application, in a filter unit 210, the proportion of the number of second - type filter elements can be 80%, 256 80% = 204.8. In the present application, 205 second - type filter elements can be arranged in the filter unit 210 composed of 256 filter elements. In this way, 205 second - type filter elements are arranged in the filter unit 210 composed of 256 filter elements, and the multi - spectral channel density is 80%.

[0124] In other embodiments of the present application, in a filter unit 210, the proportion of the number of second - type filter elements can be 100%, 256 100% = 256. In the present application, 256 second - type filter elements can be arranged in the filter unit 210 composed of 256 filter elements. In this way, 256 second - type filter elements are arranged in the filter unit 210 composed of 256 filter elements, and the multi - spectral channel density is 100%.

[0125] It should be noted that in some embodiments of the present application, the larger the proportion of the number of second - type filter elements in a filter unit 210, the more second - type filter elements there are, the greater the multi - spectral channel density of the color filter array, the greater the impact on the image imaging function, and the better the effect of the multi - spectral imaging function.

[0126] In some embodiments of the present application, in the color filter array 200, the filter surface shapes of filter elements such as the first - type filter elements 211 and the second - type filter elements 212 can be any shape, for example, square, circular, triangular or hexagonal, etc. The present application does not make specific restrictions on this.

[0127] For example, the filter surface shape of the first - type filter element 211 can be square, triangular or hexagonal, or other shapes. The filter surface shape of the second - type filter element 212 can also be square, triangular or hexagonal, or other shapes. The embodiments of the present application do not make specific restrictions on the filter surface shapes of the filter elements.

[0128] Among them, the filter elements in the shape of a square have better regularity and are convenient to implement on actual image input / output devices. Compared with the filter elements in the shape of a square, the filter elements in the shape of a hexagon are more evenly distributed, have higher angular resolution and better symmetry, which is beneficial to reducing the amount of filtering calculation.

[0129] Based on the same concept as the image sensor provided in any of the above embodiments, an embodiment of the present application further provides an electronic device.

[0130] As Figure 6 shown, an embodiment of the present application provides an electronic device 600, including an image sensor 10.

[0131] It should be noted that the electronic device provided in the embodiment of the present application includes the image sensor provided in any of the above embodiments and can implement all functions of the image sensor. To avoid repetition, details are not described herein again.

[0132] In the embodiment of the present application, the electronic device can be a terminal or other devices other than terminals. Exemplarily, the electronic device can be a smart watch, a mobile phone, a tablet computer, a laptop computer, a handheld computer, a vehicle-mounted electronic device, a Mobile Internet Device (MID), an augmented reality (AR) / virtual reality (VR) device, a robot, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (PDA), etc. It can also be a server, a Network Attached Storage (NAS), a personal computer (PC), etc. The embodiment of the present application does not make specific limitations.

[0133] In the description of this specification, the descriptions referring to terms such as "one embodiment", "some embodiments", "illustrative embodiments", "examples", "specific examples", or "some examples", etc. mean that the specific features, structures, materials, or characteristics described in connection with the embodiment or example are included in at least one embodiment or example of the present application. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials, or characteristics described can be combined in any one or more embodiments or examples in a suitable manner.

[0134] Although the embodiments of the present application have been shown and described, those of ordinary skill in the art can understand that various changes, modifications, substitutions, and variations can be made to these embodiments without departing from the principles and spirits of the present application. The scope of the present application is defined by the claims and their equivalents.

Claims

1. An image sensor, characterized in that: include: Pixel array and color filter array; The pixel array includes at least one multi-spectral unit, and the multi-spectral unit includes at least two first-type pixels for image imaging and at least one second-type pixel for multi-spectral imaging; The color filter array comprises a filter unit arranged opposite to the multi-spectral unit, the filter unit comprises at least two first-type filter elements and at least one second-type filter element, the first-type filter element is arranged opposite to the first-type pixel; the second-type filter element is arranged opposite to the second-type pixel; The first type of filter element and the second type of filter element have different light wavelength ranges that can be transmitted, and the at least one second type of filter element includes at least one type of filter element; Wherein, the filter unit includes r first-type filter elements, and the r first-type filter elements are p q array distribution, the wavelength range of light that can be transmitted by the r first-class filter elements is the same, p and q are both positive integers, r=p q.

2. The image sensor according to claim 1, characterized in that The r first-type filter elements share one optical unit; p is 2, and q is 2.

3. The image sensor according to claim 1, characterized in that The at least one second type of filter element includes at least four of the following filter elements: a first filter element, a second filter element, a third filter element, a fourth filter element, a fifth filter element, a sixth filter element, a seventh filter element, and an eighth filter element; The at least four filter elements are capable of transmitting light in different wavelength ranges.

4. The image sensor according to claim 3, characterized in that: The at least one second type of filter element comprises a first filter element, a second filter element, a third filter element, a fourth filter element, a fifth filter element, a sixth filter element, a seventh filter element and an eighth filter element; The first filter element, the second filter element, the third filter element, the fourth filter element, the fifth filter element, the sixth filter element, the seventh filter element and the eighth filter element have different light wavelength ranges that can be transmitted.

5. The image sensor according to claim 3 or 4, characterized in that: The wavelength range of light that can be transmitted by the first filter element is 420 nanometers to 460 nanometers; The second filter element can transmit light of wavelengths ranging from 670 nanometers to 700 nanometers; The third filter element can transmit light of wavelengths in the range of 520 nanometers to 610 nanometers; The fourth filter element can transmit light of wavelengths ranging from 610 nanometers to 700 nanometers; The light wavelength range that the fifth filter element can transmit is 430 nanometers to 510 nanometers; The wavelength range of light that can be transmitted by the sixth filter element is 450 nanometers to 590 nanometers; The seventh filter element can transmit light of wavelengths in the range of 400 nanometers to 440 nanometers; The eighth filter element can transmit light in a wavelength range of 560 nanometers to 700 nanometers.

6. The image sensor according to claim 3, characterized in that: The filter unit includes t second-type filter elements, wherein the t second-type filter elements are Array distribution, the t second-type filter elements share one optical unit, and the t second-type filter elements can transmit the same wavelength range of light, m ​​and n are both positive integers, t=m×n.

7. The image sensor according to claim 6, characterized in that: The t second-type filter elements are the same type of filter elements selected from the at least four types of filter elements; There is an overlapping portion in the wavelength ranges of light that can be transmitted by at least two of the at least four filter elements.

8. The image sensor according to claim 6, characterized in that: m is 1, n is 2; The multi-spectral unit includes The two second type pixels are arranged in an array, and the filter unit includes The two second-type filter elements are distributed in an array, and the two second-type pixels and the two second-type filter elements are arranged in a one-to-one correspondence.

9. The image sensor according to claim 6, characterized in that: m is 2, n is 1; The multi-spectral unit includes The two second type pixels are arranged in an array, and the filter unit includes The two second-type filter elements are distributed in an array, and the two second-type pixels and the two second-type filter elements are arranged in a one-to-one correspondence.

10. The image sensor according to claim 6, characterized in that: m is 2, n is 2; The multi-spectral unit includes The four second type pixels are arranged in an array, and the filter unit includes Array Distribution The four second-type pixels and the four second-type filter elements are arranged in a one-to-one correspondence.

11. The image sensor according to any one of claims 1 to 4, characterized in that: In a filter unit corresponding to a multi-spectral unit, the value range of the proportion of the second type of filter elements is 1% to 100%; The proportion of the number of the second type of filter elements is the ratio of the number of the second type of filter elements to the total number of filter elements in the filter unit.

12. The image sensor according to any one of claims 1 to 4, characterized in that: In a filter unit corresponding to a multi-spectral unit, the ratio of the number of the second type of filter elements ranges from 1% to 50%; The proportion of the number of the second type of filter elements is the ratio of the number of the second type of filter elements to the total number of filter elements in the filter unit.

13. The image sensor according to claim 11, characterized in that: The second type of filter elements accounts for 6%.

14. An electronic device, characterized in that: The invention comprises the image sensor according to any one of claims 1 to 13.

Images