Image sensor and electronic device

Abstract

The utility model describes a kind of image sensor, including the pixel array being periodically arranged by several first pixel units and several second pixel units, first pixel unit is made of 2×2 subpixels with same color filter, second pixel unit is made of single subpixel, second pixel unit is divided into the upper left, lower left, upper right and lower right of first pixel unit;The subpixel of first pixel unit and second pixel unit includes pixel circuit, wherein, first pixel unit is at least used to generate image image signal, and second pixel unit is used to generate in situ multispectral image signal.The utility model further describes an electronic device comprising the above-mentioned image sensor.The present application realizes the function of obtaining multispectral signal without increasing the number of camera by reasonably arranging first pixel unit and second pixel unit in pixel array, effectively reduces the cost and power consumption of equipment, and simplifies the overall structure design.

Description

Technical Field

[0001] This invention relates to the field of imaging, and in particular to an image sensor and an electronic device incorporating the image sensor. Background Technology

[0002] Mobile multispectral image sensors have seen rapid development in smartphones, portable devices, and professional imaging in recent years. Their core objectives are to improve color reproduction, expand the range of spectral information acquisition, and support diverse application scenarios (such as skin analysis, material identification, and agricultural monitoring). Current mainstream multispectral image capture methods involve a built-in auxiliary camera and external accessories. The raw data from the multispectral sensor is aligned with the main camera image via an ISP (Image Signal Processor), and AI algorithms (such as white balance correction and spectral reconstruction) are run by an NPU (Neural Processing Unit). This approach achieves system-level application without requiring external hardware and offers the advantage of low latency.

[0003] However, this approach also has certain disadvantages, including but not limited to: the need to add an extra camera module on the hardware side, increasing the system size; the optical parameters of the multispectral module differ from those of other modules, requiring alignment through algorithms, which increases power consumption and introduces some latency; insufficient spatial resolution of multispectral image data; and a significant burden on the algorithm. Therefore, to achieve more complete multispectral applications, a more compact and algorithm-friendly hardware design is urgently needed. Utility Model Content

[0004] In view of this, the present invention provides an image sensor, comprising a pixel array formed by periodically arranging a plurality of first pixel units and a plurality of second pixel units, wherein the first pixel unit is composed of 2×2 sub-pixels with the same color filter, and the second pixel unit is composed of a single sub-pixel, the second pixel units being arranged at the upper left, lower left, upper right, and lower right of the first pixel unit; each sub-pixel of the first pixel unit and the second pixel unit includes a pixel circuit, the pixel circuit including at least: a photoelectric conversion element configured to receive light signals to generate charge; a charge storage and transfer circuit connected to the photoelectric conversion element, configured to store charge according to a control selection signal to generate an integrated charge signal and output it; and a readout circuit connected to the charge storage and transfer circuit, configured to output an electrical signal according to the integrated charge signal; wherein the first pixel unit is at least used to generate an imaging image signal, and the second pixel unit is used to generate an in-situ multispectral image signal.

[0005] Optionally, the second pixel unit includes at least three sub-pixels of filters with different spectral transmittances, and the first pixel unit and the second pixel unit include at least six sub-pixels of filters with different spectral transmittances.

[0006] Optionally, adjacent 2×2 first pixel units form a periodic repeating unit, which includes sub-pixels of three filters with different spectral transmittances.

[0007] Optionally, a second pixel unit containing at least two filters with different spectral transmittances is located in a first extending direction through the second pixel unit located in the upper left and lower right of the same first pixel unit; and a second pixel unit containing at least two filters with different spectral transmittances is located in a second extending direction through the second pixel unit located in the upper right and lower left of the same first pixel unit.

[0008] Optionally, both the first pixel unit and the second pixel unit are used to generate in-situ multispectral image signals.

[0009] Optionally, the second pixel unit includes a first sub-pixel, a second sub-pixel, and a third sub-pixel with different spectral transmittances. The first sub-pixel, the second sub-pixel, and the third sub-pixel are complementary colors of the sub-pixels in the first pixel unit, respectively. In the pixel array, the ratio of the first sub-pixel to the second sub-pixel to the third sub-pixel is 2:1:1.

[0010] Optionally, the second pixel unit includes a first sub-pixel, a second sub-pixel, a third sub-pixel, and a fourth sub-pixel with different spectral transmittances. The first sub-pixel, the second sub-pixel, and the third sub-pixel are complementary colors of the sub-pixels in the first pixel unit, and the fourth sub-pixel is an NIR pixel. In the pixel array, the ratio of the first sub-pixel to the second sub-pixel to the third sub-pixel to the fourth sub-pixel is 1:1:1:1.

[0011] Optionally, the second pixel unit includes a first sub-pixel, a second sub-pixel, a third sub-pixel, a fourth sub-pixel, and a fifth sub-pixel with different spectral transmittances. The first sub-pixel, the second sub-pixel, and the third sub-pixel are complementary colors of the sub-pixels in the first pixel unit, and the fourth sub-pixel and the fifth sub-pixel are NIR pixels with different spectral transmittances. In the pixel array, the ratio of the first sub-pixel to the second sub-pixel to the third sub-pixel to the fourth sub-pixel to the fifth sub-pixel is 1:1:1:1:1.

[0012] Optionally, the second pixel unit includes a first sub-pixel, a second sub-pixel, a third sub-pixel, a fourth sub-pixel, a fifth sub-pixel, and a sixth sub-pixel with different spectral transmittances. The first sub-pixel, the second sub-pixel, and the third sub-pixel are complementary colors to the sub-pixels in the first pixel unit, and the fourth sub-pixel, the fifth sub-pixel, and the sixth sub-pixel are the same color as one of the sub-pixels in the first pixel unit. In addition, the ratio of the first sub-pixel to the second sub-pixel to the third sub-pixel to the fourth sub-pixel to the fifth sub-pixel to the sixth sub-pixel in the pixel array is 1:1:1:1:1:1.

[0013] Optionally, the second pixel unit includes a first sub-pixel, a second sub-pixel, a third sub-pixel, a fourth sub-pixel, a fifth sub-pixel, a sixth sub-pixel, and a seventh sub-pixel with different spectral transmittances. The first, second, and third sub-pixels are complementary colors to the sub-pixels in the first pixel unit, the fourth, fifth, and sixth sub-pixels are the same color as one of the sub-pixels in the first pixel unit, and the seventh sub-pixel is an NIR pixel. In the pixel array, the ratio of the first sub-pixel to the second sub-pixel to the third sub-pixel to the fourth sub-pixel to the fifth sub-pixel to the sixth sub-pixel to the seventh sub-pixel is 1:1:1:1:1:1:1.

[0014] Optionally, the second pixel unit includes a first sub-pixel, a second sub-pixel, a third sub-pixel, a fourth sub-pixel, a fifth sub-pixel, a sixth sub-pixel, a seventh sub-pixel, and an eighth sub-pixel with different spectral transmittances. The first sub-pixel, the second sub-pixel, and the third sub-pixel are complementary colors to the sub-pixels in the first pixel unit, the fourth sub-pixel, the fifth sub-pixel, and the sixth sub-pixel are the same color as one of the sub-pixels in the first pixel unit, and the seventh sub-pixel and the eighth sub-pixel are NIR pixels with different spectral transmittances. In the pixel array, the ratio of the first sub-pixel to the second sub-pixel to the third sub-pixel to the fourth sub-pixel to the fifth sub-pixel to the sixth sub-pixel to the seventh sub-pixel to the eighth sub-pixel is 1:1:1:1:1:1:1:1.

[0015] Optionally, the image sensor also includes: a microlens array, which includes multiple microlenses for collecting and converging incident light to form an image; 2x2 sub-pixels with the same color filter in the first pixel unit are located below the same microlens, and the sub-pixels of the second pixel unit correspond one-to-one with the microlenses.

[0016] Optionally, the first pixel unit is an octagon, and the second pixel unit is a rectangle or a rhombus.

[0017] Optionally, at least a portion of the subpixels of the first pixel unit in the pixel array are auto-phase focusing pixels.

[0018] This invention also provides an electronic device that includes the above-described image sensor.

[0019] Compared with the prior art, the present invention has at least the following outstanding advantages:

[0020] This invention achieves the function of acquiring multispectral signals without increasing the number of cameras by rationally arranging the first pixel unit LPD and the second pixel unit SPD in the pixel array. This effectively reduces the cost and power consumption of the device, simplifies the overall structural design, and avoids the problem of non-natural alignment of the field of view between the multispectral camera and the imaging camera. At the same time, the pixel array of this invention can acquire visible light and near-infrared light signals simultaneously, and through reasonable selection and arrangement of filters, it achieves coverage of a wide spectral range, breaking through the limitations of wavelength range in the prior art. Attached Figure Description

[0021] Figure 1 This is a schematic diagram of a pixel array provided in an embodiment of this application;

[0022] Figure 2 This is a schematic diagram of an image sensor provided in an embodiment of this application;

[0023] Figure 3 This is a pixel circuit structure diagram provided in an embodiment of this application;

[0024] Figure 4 This is another schematic diagram of a pixel array provided in the embodiments of this application;

[0025] Figure 5 This is another schematic diagram of a pixel array provided in the embodiments of this application;

[0026] Figure 6 This is another schematic diagram of a pixel array provided in the embodiments of this application;

[0027] Figure 7 This is another schematic diagram of a pixel array provided in the embodiments of this application;

[0028] Figure 8 This is another schematic diagram of a pixel array provided in the embodiments of this application;

[0029] Figure 9 This is another schematic diagram of a pixel array provided in the embodiments of this application;

[0030] Figure 10 This is another schematic diagram of a pixel array provided in the embodiments of this application;

[0031] Figure 11 This is another schematic diagram of a pixel array provided in the embodiments of this application. Detailed Implementation

[0032] To make the above-mentioned objectives, features and advantages of this utility model more apparent and understandable, the utility model will be further described below in conjunction with the accompanying drawings and embodiments.

[0033] It should be noted that specific details are set forth in the following description to provide a full understanding of the present invention. However, the present invention can be implemented in many ways other than those described herein, and those skilled in the art can make similar extensions without departing from the spirit of the present invention. Therefore, the present invention is not limited to the specific embodiments disclosed below.

[0034] Please refer to Figure 1 , Figure 1 This utility model provides an image sensor, including a pixel array 10 formed by a plurality of first pixel units LPD and a plurality of second pixel units SPD arranged periodically. The first pixel unit LPD is composed of 2×2 sub-pixels with the same color filter, and the second pixel unit SPD is composed of a single sub-pixel. The second pixel units SPD are arranged in the upper left, lower left, upper right and lower right positions of the first pixel unit LPD.

[0035] Understandably, this invention employs a design that uses 2×2 sub-pixels with the same color filter to form the first pixel unit LPD, combined with a single sub-pixel to form the second pixel unit SPD. This achieves efficient light signal acquisition, improves imaging accuracy and efficiency, and places the second pixel unit SPD in the upper left, lower left, upper right, and lower right positions of the first pixel unit LPD. This maximizes the utilization rate of the incident light beam, thereby improving the overall imaging quality.

[0036] Optionally, at least a portion of the subpixels of the first pixel unit LPD in the pixel array are auto-phase focusing pixels.

[0037] Further optional, such as Figure 2 As shown, the image sensor also includes: a microlens array, which includes multiple microlenses for collecting and converging incident light to form an image; 2x2 sub-pixels with the same color filter in the first pixel unit LPD are located below the same microlens, and the sub-pixels of the second pixel unit SPD correspond one-to-one with the microlenses.

[0038] The sub-pixels of the first pixel unit LPD and the second pixel unit SPD both include pixel circuits 20. Please refer to [reference needed]. Figure 3 The pixel circuit 20 includes at least:

[0039] The photoelectric conversion element 201 is configured to receive optical signals to generate electrical charges;

[0040] The charge storage and transfer circuit 202 is connected to the photoelectric conversion element 201 and is configured to store charge according to the control selection signal to generate an integrated charge signal and output it.

[0041] The readout circuit 203 is connected to the charge storage and transfer circuit 202 and is configured to output an electrical signal based on the integrated charge signal.

[0042] The first pixel unit LPD is used to generate at least the imaging image signal, and the second pixel unit SPD is used to generate the in-situ multispectral image signal.

[0043] In this application, by rationally arranging the first pixel unit LPD and the second pixel unit SPD in the pixel array, the function of acquiring multispectral signals is achieved without increasing the number of cameras, effectively reducing the cost and power consumption of the device, while simplifying the overall structural design and avoiding the problem of non-natural alignment of the field of view between the multispectral camera and the imaging camera; at the same time, the pixel array of this application can acquire visible light and near-infrared light signals simultaneously, and through the rational selection and arrangement of filters, a wide spectral range coverage is achieved, breaking through the limitations of wavelength range limitation in the prior art.

[0044] In some embodiments, the first pixel unit LPD is optionally designed as an octagon, and the second pixel unit SPD is designed as a rectangle or rhombus.

[0045] For example, such as Figure 1 As shown, when the first pixel unit LPD is a regular octagon, the second pixel unit SPD located at its four corners is a rectangle; for example, as... Figure 4 As shown, when the first pixel unit LPD is a pair of non-regular octagons with side lengths smaller than the other three pairs of side lengths, the second pixel unit SPD located at its four corners is a rhombus.

[0046] In the embodiments of this application, by defining the shape and position of the first pixel unit LPD and the second pixel unit SPD, the pixel arrangement density can be maximized, the beam utilization of incident light can be improved, and thus the overall imaging quality can be improved.

[0047] In some embodiments, the second pixel unit includes at least three sub-pixels of filters with different spectral transmittances, and the first pixel unit and the second pixel unit include at least six sub-pixels of filters with different spectral transmittances.

[0048] The color filter can be composed of organic materials or inorganic multilayer film materials. For example, when optical resin is selected as the color filter, the proportion of materials inside the optical resin can be adjusted to allow light of different wavelengths to pass through, thereby achieving the effect of color filtering.

[0049] Generally, color filters include three basic colors: red (R), green (G), and blue (B). The most common filter arrangement is the Bayer array RGGB, where each basic repeating unit has one R color, one B color, and two G color filters. Of course, in some practical applications, there are also pixel array arrangements such as RGBW (red, green, blue, white) or quad Bayer arrays (QBC). In other practical applications, color filters may also include three colors: Cyan (C), Magenta (M), and Yellow (Y), or near-infrared (NIR) cutoff filters.

[0050] Optionally, adjacent 2×2 first pixel units LPDs form a periodic repeating unit, which includes sub-pixels of three filters with different spectral transmittances. For example, adjacent 2×2 first pixel units LPDs are arranged periodically in the form of a Bayer array RGGB.

[0051] Understandably, to achieve in-situ multispectral image signals, it is necessary to cover the wavelength range of visible light as much as possible. Therefore, in some embodiments, the first pixel unit LPD can be used to generate in-situ multispectral image signals while simultaneously performing imaging. This allows the first pixel unit LPD and the second pixel unit SPD to include sub-pixels with at least six filters having different spectral transmittances, thus enabling the realization of complete in-situ multispectral image signals. In other embodiments, the first pixel unit LPD is dedicated to generating imaging image signals, while the second pixel unit SPD is used to generate in-situ multispectral image signals. This approach achieves clear signal separation, facilitating subsequent image processing and analysis.

[0052] Therefore, the embodiments of this application expand the spectral acquisition range and improve the comprehensiveness and accuracy of multispectral imaging through diversified filter designs.

[0053] Based on the above embodiments, further, in some embodiments, such as Figure 5 As shown, a second pixel unit SPD containing at least two filters with different spectral transmittances is located in the first extension direction of the second pixel unit SPD located in the upper left and lower right of the same first pixel unit LPD.

[0054] A second pixel unit SPD containing at least two filters with different spectral transmittances is located in the second extension direction of the second pixel unit SPD located in the upper right and lower left of the same first pixel unit LPD.

[0055] In existing technologies, when image sensors acquire full-color image signals, if the arrangement of individual color sub-pixels is such that adjacent rows also appear in adjacent column positions or are spaced the same number of columns apart, it will be difficult to effectively identify complex checkerboard patterns, thus affecting the evaluation of image quality.

[0056] Therefore, this application embodiment starts from the arrangement of the second pixel unit SPD, so that the second pixel unit SPD arranged diagonally opposite the first pixel unit LPD contains as many filters with different spectral transmittance as possible, so that the spatial point density of each spectrum is as similar as possible, while the distribution of filters of the same color within the period is dispersed, and the minimum period of spatial distribution is increased as much as possible to reduce the possibility of moiré patterns.

[0057] In some specific embodiments, when the second pixel unit SPD includes a first sub-pixel, a second sub-pixel, and a third sub-pixel with different spectral transmittances, the first sub-pixel, the second sub-pixel, and the third sub-pixel are complementary colors of the sub-pixels in the first pixel unit LPD, and the ratio of the first sub-pixel to the second sub-pixel to the third sub-pixel in the pixel array is 2:1:1.

[0058] For example, such as Figure 6 As shown, adjacent 2×2 first pixel units (LPDs) are periodically arranged in a Bayer array RGGB configuration. R (Red) has a wavelength range of approximately 620-750 nm, G (Green) has a wavelength range of approximately 495-570 nm, and B (Blue) has a wavelength range of approximately 450-495 nm. The first, second, and third sub-pixels correspond to color filters for one of the three colors: M (Magenta), Cyan, and Y (Yellow), respectively. Cyan (C) is complementary to Red (R), Magenta (M) is complementary to Green (G), and Yellow (Y) is complementary to Blue (B). Cyan is a color between blue and green with a wavelength range of approximately 470-510 nm, Magenta is a color between red and blue with a wavelength range of approximately 495-565 nm, and Yellow is a color between red and green with a wavelength range of approximately 558-597 nm. Correspondingly, the ratio of magenta filter to cyan filter to yellow filter in the second pixel unit SPD is 2:1:1.

[0059] In this embodiment, the first pixel unit LPD is used for imaging and also for generating in-situ multispectral image signals. The first pixel unit LPD and the second pixel unit SPD together include six different color filters. The multiple different color filters can not only generate a full-color image, but also supplement and enhance color information, thereby providing a wider color gamut and better color accuracy.

[0060] In some specific embodiments, when the second pixel unit SPD includes a first sub-pixel, a second sub-pixel, a third sub-pixel, and a fourth sub-pixel with different spectral transmittance, the first sub-pixel, the second sub-pixel, and the third sub-pixel are complementary colors of the sub-pixels in the first pixel unit LPD, and the fourth sub-pixel is an NIR pixel; and in the pixel array, the ratio of the first sub-pixel to the second sub-pixel to the third sub-pixel to the fourth sub-pixel is 1:1:1:1.

[0061] For example, such as Figure 7 As shown, adjacent 2×2 first pixel units LPD are arranged periodically in the form of Bayer array RGGB. The first, second, and third sub-pixels correspond to one of the three color filters, M (Magenta), Cyan, and Y (Yellow), respectively. The fourth sub-pixel is a near-infrared (NIR) cutoff filter. The wavelength range of the near-infrared (NIR) cutoff filter usually starts from 700nm and extends to 1200nm or even higher, and is mainly used in the field of near-infrared imaging. Correspondingly, the ratio of magenta filter to cyan filter to yellow filter to near-infrared (NIR) cutoff filter in the second pixel unit SPD is 1:1:1:1.

[0062] In the embodiments of this application, the first pixel unit LPD is used for imaging and also for generating in-situ multispectral image signals. The first pixel unit LPD and the second pixel unit SPD together include seven different color filters. The pixel array can simultaneously acquire visible light and near-infrared light signals. Through reasonable selection and arrangement of filters, a wide spectral range coverage is achieved, breaking through the limitation of wavelength range in the prior art.

[0063] In some specific embodiments, when the second pixel unit SPD includes a first sub-pixel, a second sub-pixel, a third sub-pixel, a fourth sub-pixel, and a fifth sub-pixel with different spectral transmittance, the first sub-pixel, the second sub-pixel, and the third sub-pixel are complementary colors of the sub-pixels in the first pixel unit LPD, and the fourth sub-pixel and the fifth sub-pixel are NIR pixels with different spectral transmittance; and in the pixel array, the ratio of the first sub-pixel to the second sub-pixel to the third sub-pixel to the fourth sub-pixel to the fifth sub-pixel is 1:1:1:1:1.

[0064] For example, such as Figure 8As shown, adjacent 2×2 first pixel units LPD are arranged periodically in the form of Bayer array RGGB. The first sub-pixel, the second sub-pixel, and the third sub-pixel correspond to one of the three colors M (Magenta), (Cyan), and Y (Yellow), respectively. The fourth sub-pixel and the fifth sub-pixel are respectively provided with a first near-infrared (NIR) cutoff filter and a second near-infrared (NIR) cutoff filter with different spectral transmittance. Correspondingly, the ratio of magenta filter to cyan filter to yellow filter to first near-infrared (NIR) cutoff filter to second near-infrared (NIR) cutoff filter in the second pixel unit SPD is 1:1:1:1:1.

[0065] In the embodiments of this application, the first pixel unit LPD is used for imaging and also for generating in-situ multispectral image signals. The first pixel unit LPD and the second pixel unit SPD together include eight different color filters. The pixel array can simultaneously acquire visible light and near-infrared light signals. Through reasonable selection and arrangement of filters, a wide spectral range coverage is achieved, breaking through the limitation of wavelength range in the prior art.

[0066] In some specific embodiments, when the second pixel unit SPD includes a first sub-pixel, a second sub-pixel, a third sub-pixel, a fourth sub-pixel, a fifth sub-pixel, and a sixth sub-pixel with different spectral transmittance, the first sub-pixel, the second sub-pixel, and the third sub-pixel are complementary colors of the sub-pixels in the first pixel unit LPD, and the fourth sub-pixel, the fifth sub-pixel, and the sixth sub-pixel are the same color as a sub-pixel in the first pixel unit LPD; and in the pixel array, the ratio of the first sub-pixel to the second sub-pixel to the third sub-pixel to the fourth sub-pixel to the fifth sub-pixel to the sixth sub-pixel is 1:1:1:1:1:1.

[0067] For example, such as Figure 9 As shown, adjacent 2×2 first pixel units LPD are arranged periodically in the form of a Bayer array RGGB. The first, second, and third sub-pixels are color filters of three colors: M (Magenta), Cyan, and Y (Yellow), respectively. The fourth, fifth, and sixth sub-pixels correspond to color filters of one of the three colors: R (Red), G (Green), and B (Blue), respectively. Correspondingly, the ratio of magenta, cyan, yellow, red, green, and blue color filters in the second pixel unit SPD is 1:1:1:1:1:1.

[0068] In this embodiment, the first pixel unit LPD is dedicated to imaging, and the second pixel unit SPD contains six different color filters to generate in-situ multispectral image signals. This scheme achieves coverage of a wide spectral range while enabling clear signal separation, which facilitates subsequent image processing and analysis.

[0069] In some specific embodiments, when the second pixel unit SPD includes a first sub-pixel, a second sub-pixel, a third sub-pixel, a fourth sub-pixel, a fifth sub-pixel, a sixth sub-pixel, and a seventh sub-pixel with different spectral transmittances, the first sub-pixel, the second sub-pixel, and the third sub-pixel are complementary colors of the first pixel unit, the fourth sub-pixel, the fifth sub-pixel, and the sixth sub-pixel are the same color as a sub-pixel in the first pixel unit LPD, and the seventh sub-pixel is an NIR pixel; and in the pixel array, the ratio of the first sub-pixel to the second sub-pixel to the third sub-pixel to the fourth sub-pixel to the fifth sub-pixel to the sixth sub-pixel to the seventh sub-pixel is 1:1:1:1:1:1:1.

[0070] For example, such as Figure 9 As shown, adjacent 2×2 first pixel units LPD are arranged periodically in the form of a Bayer array RGGB. The first, second, and third sub-pixels correspond to color filters of one of the three colors M (Magenta), Cyan, and Y (Yellow), respectively. The fourth, fifth, and sixth sub-pixels correspond to color filters of one of the three colors R (Red), G (Green), and B (Blue), respectively. The seventh sub-pixel corresponds to a near-infrared (NIR) cutoff filter. Correspondingly, the ratio of magenta, cyan, yellow, red, green, blue, and near-infrared (NIR) cutoff filters in the second pixel unit SPD is 1:1:1:1:1:1:1:1.

[0071] In this embodiment, the first pixel unit LPD is dedicated to imaging, and the second pixel unit SPD contains seven different color filters to generate in-situ multispectral image signals. This scheme achieves coverage of a wide spectral range while enabling clear signal separation, which facilitates subsequent image processing and analysis.

[0072] In some specific embodiments, when the second pixel unit SPD includes a first sub-pixel, a second sub-pixel, a third sub-pixel, a fourth sub-pixel, a fifth sub-pixel, a sixth sub-pixel, a seventh sub-pixel, and an eighth sub-pixel with different spectral transmittance, the first sub-pixel, the second sub-pixel, and the third sub-pixel are complementary colors of the sub-pixels in the first pixel unit LPD, the fourth sub-pixel, the fifth sub-pixel, and the sixth sub-pixel are the same color as a sub-pixel in the first pixel unit LPD, and the seventh sub-pixel and the eighth sub-pixel are NIR pixels with different spectral transmittance;

[0073] Furthermore, in the pixel array, the ratio of the first sub-pixel to the second sub-pixel to the third sub-pixel to the fourth sub-pixel to the fifth sub-pixel to the sixth sub-pixel to the seventh sub-pixel to the eighth sub-pixel is 1:1:1:1:1:1:1:1.

[0074] For example, such as Figure 10 As shown, adjacent 2×2 first pixel units LPD are arranged periodically in the form of a Bayer array RGGB. The first, second, and third sub-pixels correspond to color filters of one of the three colors M (Magenta), Cyan, and Y (Yellow), respectively. The fourth, fifth, and sixth sub-pixels correspond to color filters of one of the three colors R (Red), G (Green), and B (Blue), respectively. The fourth and fifth sub-pixels are respectively equipped with a first near-infrared (NIR) cutoff filter and a second near-infrared (NIR) cutoff filter with different spectral transmittance. Correspondingly, the ratio of magenta filter to cyan filter to yellow filter to red filter to green filter to blue filter to the first near-infrared (NIR) cutoff filter and the second near-infrared (NIR) cutoff filter in the second pixel unit SPD is 1:1:1:1:1:1:1:1:1.

[0075] In this embodiment, the first pixel unit LPD is dedicated to imaging, and the second pixel unit SPD contains eight different color filters to generate in-situ multispectral image signals. This scheme achieves coverage of a wide spectral range while enabling clear signal separation, which facilitates subsequent image processing and analysis.

[0076] This application also provides an electronic device incorporating the aforementioned image sensor, such as a smartphone, tablet computer, digital camera, camcorder, security monitoring equipment, automobile, communication equipment, and bioimaging equipment. This electronic device, by rationally arranging the first pixel unit LPD and the second pixel unit SPD in the pixel array of the image sensor, achieves the function of acquiring multispectral signals without increasing the number of cameras, effectively reducing the cost and power consumption of the device. It also simplifies the overall structural design and avoids the problem of non-natural alignment of the field of view between the multispectral camera and the imaging camera. Furthermore, the pixel array of this invention can simultaneously acquire visible light and near-infrared light signals, and through reasonable filter selection and arrangement, it achieves wide spectral range coverage, overcoming the limitations of wavelength range constraints in existing technologies.

[0077] The above description, in conjunction with specific preferred embodiments, provides a further detailed explanation of the present invention. It should not be construed that the specific implementation of the present invention is limited to these descriptions. For those skilled in the art, various simple deductions or substitutions can be made without departing from the concept of the present invention, and all such modifications and substitutions should be considered within the protection scope of the present invention.

Claims

1. An image sensor, characterized in that, It includes a pixel array consisting of a number of first pixel units and a number of second pixel units arranged periodically, wherein the first pixel unit is composed of 2×2 sub-pixels with the same color filter, the second pixel unit is composed of a single sub-pixel, and the second pixel units are arranged in the upper left, lower left, upper right and lower right of the first pixel unit. Both the first pixel unit and the second pixel unit include pixel circuits in their sub-pixels, and the pixel circuits include at least: A photoelectric conversion element configured to receive optical signals to generate electrical charge; A charge storage and transfer circuit, connected to the photoelectric conversion element, is configured to store charge according to a control selection signal to generate an integrated charge signal and output it. A readout circuit, connected to the charge storage and transfer circuit, is configured to output an electrical signal based on the integrated charge signal; The first pixel unit is used to generate an imaging image signal, and the second pixel unit is used to generate an in-situ multispectral image signal.

2. The image sensor as described in claim 1, characterized in that, The second pixel unit includes at least three types of filter sub-pixels with different spectral transmittances, and the first pixel unit and the second pixel unit include at least six types of filter sub-pixels with different spectral transmittances.

3. The image sensor as described in claim 2, characterized in that, Adjacent 2×2 first pixel units form a periodic repeating unit, which includes three sub-pixels of filters with different spectral transmittance.

4. The image sensor as described in claim 2, characterized in that, The second pixel unit, which includes at least two filters with different spectral transmittances, extends through the first extension direction of the second pixel unit located at the upper left and lower right of the same first pixel unit. The second pixel unit, which includes at least two filters with different spectral transmittances, extends through the second pixel unit located at the upper right and lower left of the same first pixel unit.

5. The image sensor as described in claim 2, characterized in that, Both the first pixel unit and the second pixel unit are used to generate in-situ multispectral image signals.

6. The image sensor as described in claim 5, characterized in that, The second pixel unit includes a first sub-pixel, a second sub-pixel, and a third sub-pixel with different spectral transmittances, wherein the first sub-pixel, the second sub-pixel, and the third sub-pixel are complementary colors of the sub-pixels within the first pixel unit; Furthermore, in the pixel array, the ratio of the first sub-pixel to the second sub-pixel to the third sub-pixel is 2:1:

1.

7. The image sensor as described in claim 5, characterized in that, The second pixel unit includes a first sub-pixel, a second sub-pixel, a third sub-pixel, and a fourth sub-pixel with different spectral transmittances. The first sub-pixel, the second sub-pixel, and the third sub-pixel are complementary colors of the sub-pixels in the first pixel unit, and the fourth sub-pixel is an NIR pixel. Furthermore, in the pixel array, the ratio of the first sub-pixel to the second sub-pixel to the third sub-pixel to the fourth sub-pixel is 1:1:1:

1.

8. The image sensor as described in claim 5, characterized in that, The second pixel unit includes a first sub-pixel, a second sub-pixel, a third sub-pixel, a fourth sub-pixel, and a fifth sub-pixel with different spectral transmittances. The first sub-pixel, the second sub-pixel, and the third sub-pixel are complementary colors of the sub-pixels in the first pixel unit, and the fourth sub-pixel and the fifth sub-pixel are NIR pixels with different spectral transmittances. Furthermore, in the pixel array, the ratio of the first sub-pixel to the second sub-pixel to the third sub-pixel to the fourth sub-pixel to the fifth sub-pixel is 1:1:1:1:

1.

9. The image sensor as claimed in claim 2, characterized in that, The second pixel unit includes a first sub-pixel, a second sub-pixel, a third sub-pixel, a fourth sub-pixel, a fifth sub-pixel, and a sixth sub-pixel with different spectral transmittances. The first sub-pixel, the second sub-pixel, and the third sub-pixel are complementary colors to the sub-pixels in the first pixel unit, and the fourth sub-pixel, the fifth sub-pixel, and the sixth sub-pixel are the same color as a sub-pixel in the first pixel unit. Furthermore, in the pixel array, the ratio of the first sub-pixel to the second sub-pixel to the third sub-pixel to the fourth sub-pixel to the fifth sub-pixel to the sixth sub-pixel is 1:1:1:1:1:

1.

10. The image sensor as claimed in claim 2, characterized in that, The second pixel unit includes a first sub-pixel, a second sub-pixel, a third sub-pixel, a fourth sub-pixel, a fifth sub-pixel, a sixth sub-pixel, and a seventh sub-pixel with different spectral transmittances. The first sub-pixel, the second sub-pixel, and the third sub-pixel are complementary colors of the sub-pixels in the first pixel unit. The fourth sub-pixel, the fifth sub-pixel, and the sixth sub-pixel are the same color as a sub-pixel in the first pixel unit. The seventh sub-pixel is an NIR pixel. Furthermore, in the pixel array, the ratio of the first sub-pixel to the second sub-pixel to the third sub-pixel to the fourth sub-pixel to the fifth sub-pixel to the sixth sub-pixel to the seventh sub-pixel is 1:1:1:1:1:1:

1.

11. The image sensor as claimed in claim 2, characterized in that, The second pixel unit includes a first sub-pixel, a second sub-pixel, a third sub-pixel, a fourth sub-pixel, a fifth sub-pixel, a sixth sub-pixel, a seventh sub-pixel, and an eighth sub-pixel with different spectral transmittance. The first sub-pixel, the second sub-pixel, and the third sub-pixel are complementary colors of the sub-pixels in the first pixel unit. The fourth sub-pixel, the fifth sub-pixel, and the sixth sub-pixel are the same color as a sub-pixel in the first pixel unit. The seventh sub-pixel and the eighth sub-pixel are NIR pixels with different spectral transmittance. Furthermore, in the pixel array, the ratio of the first sub-pixel to the second sub-pixel to the third sub-pixel to the fourth sub-pixel to the fifth sub-pixel to the sixth sub-pixel to the seventh sub-pixel to the eighth sub-pixel is 1:1:1:1:1:1:1:

1.

12. The image sensor as claimed in claim 1, characterized in that, The image sensor further includes a microlens array, which comprises multiple microlenses for collecting and converging incident light to form an image; In the first pixel unit, 2x2 sub-pixels with the same color filter are located below the same microlens, and the sub-pixels of the second pixel unit correspond one-to-one with the microlens.

13. The image sensor as claimed in claim 1, characterized in that, The first pixel unit is an octagon, and the second pixel unit is a rectangle or a rhombus.

14. The image sensor as claimed in claim 1, characterized in that, At least a portion of the sub-pixels of the first pixel unit in the pixel array are auto-phase focusing pixels.

15. An electronic device, characterized in that, It includes the image sensor as described in any one of claims 1-14.

Images