Image sensor with dark scene full-color function and imaging method thereof

Abstract

The present invention provides an image sensor with dark scene full-color function, comprising: a pixel array, including a plurality of pixels arranged in rows and columns; a plurality of groups of filters, each filter being arranged on the pixels respectively, each group of filters comprising a plurality of color filters with different light responses and a plurality of white filters with full spectrum response, the pixels under the color filters being used to collect the color signals of the image, and the pixels under the white filters being used to collect the brightness signals of the image, wherein a color filter with a light response in each group of filters corresponds to at least one white filter; and an infrared suppression film, being arranged between the color filters and the pixels to suppress infrared light from entering the pixels. The present invention also provides an imaging method of the above-mentioned image sensor.

Description

Technical Field

[0001] The invention relates to an image sensor, and in particular to an image sensor with dark scene full color function and an imaging method thereof. Background Art

[0002] The image capture device includes an image sensor and an imaging lens. The imaging lens focuses light onto the image sensor to form an image, and the image sensor converts the optical signal into an electrical signal. The image capture device outputs the electrical signal to other components of the host system. The image capture device and other components of the host system form an image sensor system or an imaging system. The application of image sensors has become very common and can be applied to various electronic systems, such as mobile devices, digital cameras, medical devices or computers. The technology for manufacturing image sensors, especially the technology for manufacturing complementary metal oxide semiconductor ("CMOS") image sensors, continues to develop rapidly.

[0003] A typical image sensor includes multiple photosensitive elements ("pixels") arranged in a two-dimensional array. This image sensor can be configured to produce a color image by forming a color filter array (CFA) on the pixels. Existing image sensor chips are generally designed with a Bayer array. However, in an environment with low light intensity at night, when infrared supplementary light is required to achieve sufficient brightness, the color cannot be restored because the infrared light will pass through the three RGB filters, resulting in the same signal intensity for all colors. In fields such as security monitoring and machine vision that have high requirements for dark light scenes, there are two existing technical solutions: one is a Bayer-mode CMOS image sensor. In very dark scenes, the infrared cutoff (IR-CUT) needs to be turned off to supplement infrared light, and the image becomes black and white, completely losing color information; the second is to use two CMOS image sensor chips, such as Figure 1A and Figure 1B As shown, in very dark scenes, the Bayer pattern chip is responsible for collecting color information, and the other chip is full-spectrum responsive, has no infrared cutoff, and can accept active supplementary infrared light to obtain brightness information with a higher signal-to-noise ratio, and then uses an algorithm to fuse the two. However, this requires two chips and two lenses, which is very expensive. Summary of the invention

[0004] The following description presents the contributions made by the present invention.

[0005] The present invention provides an image sensor with dark scene full-color function and an imaging method thereof, which can achieve the full-color effect of dark light scenes with only one image sensor chip.

[0006] An image sensor with dark scene full-color function, comprising:

[0007] a pixel array comprising a plurality of pixels arranged in rows and columns;

[0008] A plurality of groups of filters, each of which is disposed on the pixels, each group of filters comprising a plurality of color filters with different light responses and a plurality of white filters with full spectrum response, the pixels under the white filters are used to collect color signals of the image, and the pixels under the white filters are used to collect brightness signals of the image, wherein a color filter with one light response in each group of filters corresponds to at least one white filter; and

[0009] The infrared suppression film is arranged between the color filter and the pixel to suppress infrared light from entering the pixel.

[0010] An imaging device of the above image sensor, the imaging device further comprising:

[0011] a signal processing unit connected to the image sensor, configured to process the color signal and the brightness signal output by the image sensor to convert them into a full-color signal, and to continue processing the full-color signal to output color image data;

[0012] A display unit connected to the signal processing unit, and configured to display a color image according to the color image data;

[0013] A storage unit connected to the display unit and used to store the color image;

[0014] A control unit is connected to the image sensor, the signal processing unit, and the storage unit, and is used to control signal transmission.

[0015] An imaging method applied to the above image sensor, characterized in that it comprises the following steps:

[0016] Step (610): performing bilinear interpolation on the color signals in the image, thereby obtaining a multi-channel color difference signal (Blue_DL / Red_DL / Green_DL) with low spatial frequency at each point in the image;

[0017] Step (620): performing edge judgment interpolation on the brightness signal in the image, and providing two filters (Filter_L / Filter_H) with different spatial frequencies to filter each point in the image with the two filters, thereby obtaining a brightness signal (Y_L) with a low spatial frequency and a brightness signal (Y_H) with a high spatial frequency at each point;

[0018] Step (630): Fusing the color difference signal (Blue_DL / Red_DL / Green_DL) with low spatial frequency and the luminance signal (Y_L) with low spatial frequency of each point in the image, thereby obtaining a color signal (Blue_LF / Red_LF / Green_LF) with low spatial frequency and high signal-to-noise ratio;

[0019] Step (640): Eliminate the color deviation caused by the crosstalk signal (Alpha), thereby obtaining a more accurate color signal (Blue_LP / Red_LP / Green_LP); and

[0020] Step (650): complement the brightness signal (Y_H) with high spatial frequency of each point back into the color signal (Blue_LP / Red_LP / Green_LP), and output the final color signal (Blue_Final / Red_Final / Green_Final).

[0021] The image sensor with full-color dark scene function and the imaging method thereof of the present invention arrange an infrared cut-off film under the color filter, change the filter array mode, and introduce a white filter with full spectrum response, so that only one image sensor chip can achieve a full-color effect of a dark light scene, especially receiving infrared signals in a night environment, improving the sensitivity of the chip in different environments, and enabling the chip to accurately restore images and colors in extremely dark scenes. BRIEF DESCRIPTION OF THE DRAWINGS

[0022] Figure 1A The figure is a schematic diagram of the structure of a Bayer pattern color filter array in the prior art.

[0023] Figure 1B It is a schematic diagram of the structure of a full spectrum response filter in the prior art.

[0024] Figure 2 FIG. 4 is a schematic diagram of the structure of an image sensor according to an embodiment of the present invention.

[0025] Figures 2A-2D Schematic diagrams of the arrangement of filters of image sensors according to four embodiments of the present invention.

[0026] Figures 3A-3C Schematic diagrams of the structures of infrared suppression films and transparent films of image sensors according to four embodiments of the present invention.

[0027] Figure 4 FIG. 4 is a schematic diagram of a curve showing wavelength and transmittance of the image sensor of the present invention.

[0028] Figure 5 FIG. 4 is a schematic diagram of the structure of an imaging device including an embodiment of the image sensor of the present invention.

[0029] Figure 6 The figure is a flow chart of an imaging method of an image sensor according to an embodiment of the present invention. DETAILED DESCRIPTION

[0030] The above-mentioned drawings illustrate an image sensor with dark scene full-color function and an imaging method thereof of the present invention. This article discloses different embodiments of the image sensor. In the following description, many specific details are set forth for a more thorough understanding of the present invention. However, those skilled in the relevant art should know that the technical content recorded in the present invention can be implemented without one or more specific details, or other methods, components, materials, etc. In other examples, well-known structures, materials or operations are not shown or described in detail to avoid blurring specific content.

[0031] The present invention arranges an infrared cut-off film under the color filter, changes the filter array mode, and introduces a white filter with full spectrum response, so that a full-color effect of a dark light scene can be achieved with only one image sensor chip.

[0032] Figure 2 FIG. 1 is a schematic diagram of an image sensor 100 according to an embodiment of the present invention. The image sensor 100 includes a pixel array 102. The pixel array 102 has a plurality of image sensor pixel units included in an integrated circuit system according to the teachings of the present invention. Figure 2 As shown, in the image sensor 100, the pixel array 102 is coupled to the control circuit 108 and the read circuit 104, and the read circuit 104 is coupled to the functional logic unit 106. The control circuit 108 and the read circuit 104 are also coupled to the status register 110. In one embodiment, the pixel array 102 is a two-dimensional (2D) array of image sensor pixels (e.g., pixels P1, P2, ..., Pn). In one embodiment, after each pixel has acquired its image data or image charge, the image data is read out by the read circuit 104 using the read mode specified by the status register 110, and then transmitted to the functional logic unit 106. The functional logic unit 106 can only store the image data, or can process the image data according to the later image effect (e.g., cropping, rotating, removing red eyes, adjusting brightness, adjusting contrast, or other methods).

[0033] Figures 2A-2D Schematic diagrams of the structures of the filter arrays of the image sensors of four embodiments of the present invention, Figures 3A-3C The four embodiments of the present invention are schematic diagrams of the structures of the infrared suppression film and the transparent film of the image sensor according to the four embodiments of the present invention. The four embodiments provided by the present invention are preferred embodiments, which are only used for the purpose of explanation and do not constitute a limitation of the present invention. According to the teaching of the present invention, other structures can also be used in the embodiments of the present invention.

[0034] In one embodiment, the filter array includes a color filter and a white filter. The color filter is a filter that allows visible light to pass while suppressing infrared light, and the white filter is a filter that responds to the full spectrum, that is, a filter that allows the full spectrum to pass. In one embodiment, the color filter includes a first light-responsive color filter, a second light-responsive color filter, and a third light-responsive color filter. The first light-responsive color filter is a green filter (G), the second light-responsive color filter is a blue filter (B), and the third light-responsive color filter (R) is a red filter. In other embodiments, the color filter can also be a filter of other colors. In one embodiment, each group of filters is arranged in a 4X4 format.

[0035] Combination Figure 2 , Figures 2A-2D as well as Figures 3A-3C The image sensor with dark scene full-color function of the present invention comprises a pixel array 102, comprising a plurality of pixels (P1, P2, ..., Pn) arranged in rows and columns; a plurality of groups of filters (B, G, R, W), each filter being respectively arranged on the pixels, each group of filters comprising a plurality of color filters (B, G, R) with different light responses and a plurality of white filters (W) with full spectrum response, the pixels under the color filters (B, G, R) being used to collect the color signals of the image, and the pixels under the white filters (W) being used to collect the brightness signals of the image, wherein a color filter with one light response in each group of filters corresponds to at least one white filter; a transparent film (C) being arranged between the white filter (W) and the pixels; and an infrared suppression film (SIR) being arranged between the color filters (B, G, R) and the pixels to suppress infrared light from entering the pixels.

[0036] like Figure 2AAs shown, in each group of filters, the first light response color filter (G) accounts for 37.5%; the second light response color filter (B) accounts for 18.75%; the third light response color filter (R) accounts for 18.75%; and the white filter (W) accounts for 25%. Each group of filters includes a first subgroup 211, a second subgroup 212, a third subgroup 213, and a fourth subgroup 214; the first subgroup 211 includes three of the second light response color filters (B) and a white filter (W); the fourth subgroup 214 includes three of the third light response color filters (R) and a white filter (W); the second subgroup 212 and the third subgroup 213 respectively include three first light response color filters (G) and a white filter (W); the first subgroup 211 and the fourth subgroup 214 are diagonally related, and the second subgroup 212 and the third subgroup 213 are diagonally related.

[0037] Specifically, Figure 2A As shown, the first light-responsive color filter (G) is arranged in the third and fourth columns of the first row, the third column of the second row, the first and second columns of the third row, and the first column of the fourth row; the second light-responsive color filter (B) is arranged in the first and second columns of the first row, and the first column of the second row; the third light-responsive color filter (R) is arranged in the third and fourth columns of the third row, and the third column of the fourth row; the white filter (W) is arranged in the second and fourth columns of the second row, and the second and fourth columns of the fourth row.

[0038] Figure 2B , 2C 2D are structural schematic diagrams of the arrangement of filters of image sensors of three other embodiments of the present invention. In each group of filters, the first light-responsive color filter (G) accounts for 25%; the second light-responsive color filter (B) accounts for 12.5%; the third light-responsive color filter (R) accounts for 12.5%; and the white filter (W) accounts for 50%.

[0039] like Figure 2B As shown, each group of filters includes a first subgroup 221, a second subgroup 222, a third subgroup 223, and a fourth subgroup 224; the first subgroup 221 includes two of the second light-responsive color filters (B) and two white filters (W); the fourth subgroup 224 includes two of the third light-responsive color filters (R) and two white filters (W); the second subgroup 222 and the third subgroup 223 include two first light-responsive color filters (G) and two white filters (W), respectively; the first subgroup 221 and the fourth subgroup 224 are in a diagonal relationship, and the second subgroup 222 and the third subgroup 223 are in a diagonal relationship.

[0040] Specifically, Figure 2B As shown, the first light-responsive color filter (G) is arranged in the third column of the first row, the fourth column of the second row, the first column of the third row, and the second column of the fourth row; the second light-responsive color filter (B) is arranged in the first column of the first row, the second column of the second row; the third light-responsive color filter (R) is arranged in the third column of the third row, and the fourth column of the fourth row; the white filter (W) is arranged in the second and fourth columns of the first row, the first and third columns of the second row, the second and fourth columns of the third row, and the first and third columns of the fourth row.

[0041] like Figure 2C As shown, each group of filters includes a first subgroup 231, a second subgroup 232, a third subgroup 233, and a fourth subgroup 234; the first subgroup 231 includes two of the second light-responsive color filters (B) and two white filters (W); the fourth subgroup 234 includes two of the third light-responsive color filters (R) and two white filters (W); the second subgroup 232 and the third subgroup 233 include two first light-responsive color filters (G) and two white filters (W), respectively; the first subgroup 231 and the fourth subgroup 234 are in a diagonal relationship, and the second subgroup 232 and the third subgroup 233 are in a diagonal relationship.

[0042] Specifically, Figure 2C As shown, the first light-responsive color filter (G) is arranged in the third column of the first row, the third column of the second row, the second column of the third row, and the second column of the fourth row; the second light-responsive color filter (B) is arranged in the first column of the first row and the first column of the second row; the third light-responsive color filter (R) is arranged in the fourth column of the third row and the fourth column of the fourth row; the white filter (W) is arranged in the second and fourth columns of the first row, the second and fourth columns of the second row, the first and third columns of the third row, and the first and third columns of the fourth row.

[0043] like Figure 2D As shown, each group of filters includes a first subgroup 241, a second subgroup 242, a third subgroup 243, and a fourth subgroup 244; the first subgroup 241 and the fourth subgroup 244 respectively include one first light response color filter (G), one second light response color filter (B), and two white filters (W); the second subgroup 242 and the third subgroup 243 respectively include one first light response color filter (G), one third light response color filter (R), and two white filters (W); the first subgroup 241 and the fourth subgroup 244 are in a diagonal relationship, and the second subgroup 242 and the third subgroup 243 are in a diagonal relationship.

[0044] Specifically, Figure 2DAs shown, the first light-responsive color filter (G) is arranged in the second and fourth columns of the second row, and the second and fourth columns of the fourth row; the second light-responsive color filter (B) is arranged in the first column of the first row, and the third column of the third row; the third light-responsive color filter (R) is arranged in the third column of the first row, and the first column of the third row; the white filter (W) is arranged in the second and fourth columns of the first row, the first and third columns of the second row, the second and fourth columns of the third row, and the first and third columns of the fourth row.

[0045] Figures 3A-3C The installation forms of the mid-infrared suppression film (SIR) and the transparent film (C) correspond to Figures 2A-2D The color filters (B, G, R) and the white filter (W) in the embodiment of the present invention are arranged. An infrared suppression film (SIR) is arranged below the color filters (B, G, R), and a transparent film (C) is arranged below the white filter (W). In one embodiment, a gap is arranged between the infrared suppression film (SIR) and the transparent film (C). In one embodiment, the gap is offset toward the transparent film (C) and is completely covered below the white filter (W).

[0046] In one embodiment, the transparent film (C) is made of the same clear material as the white filter (W), such as quartz, glass or any other suitable transparent material. Therefore, the transparent film 330 can be a white filter 420, that is, a double-layer or double-thick white filter 420 is set on the corresponding photosensitive element. The infrared suppression film (SIR) is a material that allows visible light to pass through while suppressing infrared light. It is placed under the color filter (B, G, R) to ensure that normal color information can be obtained without the need for optical elements such as infrared cutoffs (IR-CUT) and is not affected by infrared, so that accurate color restoration can be obtained when infrared fill light is used at night. In one embodiment, the infrared suppression film (SIR) uses an infrared cutoff material with a transmittance of 0.1%-2%. In one embodiment, the material of the infrared suppression film (SIR) is organic. In one embodiment, the material of the infrared suppression film (SIR) is polyurethane or polyimide. In other ways, the material of the infrared suppression film (SIR) can also be inorganic. In one embodiment, the thickness of the infrared suppression film (SIR) is 0.6-1.5 um. Preferably, the thickness of the infrared suppression film (SIR) is 1 um.

[0047] In the above four embodiments, the filter array mode is selected according to the application preference, where the pixels under the color filters (B, G, R) are responsible for collecting color information, and the pixels under the white filter (W) are responsible for collecting brightness signals. In scenarios where more brightness signals need to be supplemented, a mode with a larger proportion of white filters (W) can be selected, such as Figure 2B-2DIn scenarios where less brightness signal needs to be supplemented, a mode with a smaller proportion of white filter (W) can be selected, such as Figure 2A .

[0048] Figure 4 The wavelength and transmittance curve diagram of the image sensor of the present invention is shown in FIG. According to the present invention, infrared suppression films of different thicknesses are used to have a transmittance of nearly 0 for infrared light of about 850 nanometers, and a higher transmittance for other visible light, so that visible light can pass while infrared light is suppressed, and the white filter can ensure brightness information, so that the image sensor can have the best brightness signal-to-noise ratio.

[0049] Figure 5 An imaging device provided by the present invention includes an image sensor 510, a signal processing unit 520, a display unit 530, a storage unit 540 and a control unit 550. The image sensor 510 has the structure shown in the present invention. The signal processing unit 520 is connected to the image sensor 510, and is used to process the color signal and brightness signal output by the image sensor 510 to convert them into full-color signals, and continue to process the full-color signals to output color image data. The display unit 530 is connected to the signal processing unit 520, and is used to display a color image according to the color image data. The storage unit 540 is connected to the display unit 530, and is used to store the color image. The control unit 550 is connected to the image sensor 510, the signal processing unit 520 and the storage unit 540, and is used to control signal transmission.

[0050] In one embodiment, the signal processing unit 520 processes the color signal and the brightness signal including: Figure 6 The steps of the imaging method are shown.

[0051] Figure 6 The present invention provides an imaging method applied to the above-mentioned image sensor. Since the filter array designed in the present invention includes four light-responsive filters, it is necessary to further process the image signal when restoring the color signal with the best signal-to-noise ratio. The imaging method applied to the above-mentioned image sensor of the present invention includes the following steps.

[0052] Step 610: Perform bilinear interpolation on the color signals in the image to obtain a multi-channel low spatial frequency color difference signal (Blue_DL / Red_DL / Green_DL) at each point in the image. Figure 2A In the image sensor shown, color signals such as red, green and blue (R / G / B) account for 75%. Figure 2B-2D In image sensors, color signals such as red, green and blue account for 50%.

[0053] Among them, bilinear interpolation refers to the linear interpolation extension of the interpolation function with two variables, and linear interpolation is performed once in the X-axis and Y-axis directions respectively. Among them, high spatial frequency and low spatial frequency refer to distinguishing different spatial frequencies for different image components in the image. In one embodiment, short-distance mutations (such as edges and lines), drastic fluctuations (such as noise), image details, rough or non-uniform parts, etc. are designated as high spatial frequencies; while long-distance and large-scale slow changes, image backgrounds, flat or uniform parts, etc. are designated as low spatial frequencies.

[0054] Step 620: Perform edge judgment interpolation on the brightness signal in the image, and provide two filters with different spatial frequencies (Filter_L / Filter_H) to filter each point in the image with the two filters, thereby obtaining a brightness signal with a low spatial frequency (Y_L) and a brightness signal with a high spatial frequency (Y_H) at each point. Figure 2A In the image sensor shown, the brightness signal W accounts for 25%. Figure 2B-2D In the image sensor, the brightness signal W accounts for 50%.

[0055] Step 630: Fuse the color difference signal (Blue_DL / Red_DL / Green_DL) with low spatial frequency and the brightness signal (Y_L) with low spatial frequency of each point in the image to obtain a color signal (Blue_LF / Red_LF / Green_LF) with low spatial frequency and high signal-to-noise ratio.

[0056] The specific calculation formula is as follows:

[0057] Blue_LF=Blue_DL+Y_L;

[0058] Red_LF=Red_DL+Y_L;

[0059] Green_LF=Green_DL+Y_L.

[0060] Step 640: Eliminate the color deviation caused by the crosstalk signal (Alpha), thereby obtaining a more accurate color signal (Blue_LP / Red_LP / Green_LP).

[0061] The specific calculation formula is as follows:

[0062] Blue_LP=Blue_LF–Y_L*Alpha;

[0063] Red_LP=Red_LF–Y_L*Alpha;

[0064] Green_LP=Green_LF–Y_L*Alpha.

[0065] Step 650: complement the brightness signal (Y_H) with high spatial frequency of each point back into the color signal (Blue_LP / Red_LP / Green_LP) to improve the spatial resolution of the color signal, and output the final color signal (Blue_Final / Red_Final / Green_Final).

[0066] The specific calculation formula is as follows:

[0067] Blue_Final=Blue_LP+Y_H;

[0068] Red_Final=Red_LP+Y_H;

[0069] Green_Final=Green_LP+Y_H.

[0070] The image sensor with full-color dark scene function and the imaging method thereof of the present invention arrange an infrared cut-off film under the color filter, change the filter array mode, and introduce a white filter with full spectrum response, so that only one image sensor chip can achieve a full-color effect of a dark light scene, especially receiving infrared signals in a night environment, improving the sensitivity of the chip in different environments, and enabling the chip to accurately restore images and colors in extremely dark scenes.

[0071] References throughout the specification to "one embodiment," "an embodiment," "an example," or "an example" mean that a particular feature, structure, or characteristic described in conjunction with the embodiment or example is included in at least one embodiment or example of the invention. Therefore, phrases such as "in one embodiment" or "in one example" that appear throughout the specification do not necessarily all refer to the same embodiment or example. In addition, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments or examples. Directional terms such as "top," "downward," "above," "below" are used to refer to the direction of the drawings being described. In addition, unless otherwise specifically stated, the terms "having," "including," "containing," and similar terms are defined to mean "comprising." The particular features, structures, or characteristics may be included in an integrated circuit, an electronic circuit, a combinational logic circuit, or other suitable components that provide the described functionality. In addition, it should be understood that the drawings provided herein are only for the purpose of explaining those of ordinary skill in the art, and that the drawings are not necessarily drawn to scale.

[0072] The above description of the illustrated examples of the present invention (including what is described in the abstract) is not intended to be exhaustive or limited to the precise form disclosed. Although specific embodiments and examples of the present invention are described herein for illustrative purposes, various equivalent modifications may be made without departing from the broader spirit and scope of the present invention. In fact, it should be understood that specific example structures and materials are provided for the purpose of explanation, and other structures and materials may also be used in other embodiments and examples according to the teachings of the present invention. These modifications may be made to the embodiments of the present invention according to the above detailed description. The terms used in the following claims should not be interpreted as limiting the present invention to the specific embodiments disclosed in the specification and claims. On the contrary, the scope is determined entirely by the following claims, which should be interpreted according to the established principles of claim interpretation.

[0073] The various embodiments given in the embodiments of the present invention include but are not limited to the explanation and description of the invention content proposed by the present invention. The above embodiments are only for the purpose of explanation and do not constitute a limitation of the present invention. Reasonable revisions to the various embodiments of the present invention.

Claims

1. An imaging method for an image sensor with dark scene full-color function, characterized in that: The image sensor comprises: a pixel array comprising a plurality of pixels arranged in rows and columns; A plurality of groups of filters, each of which is disposed on the pixels, each group of filters comprising a plurality of color filters with different light responses and a plurality of white filters with full spectrum response, the pixels under the color filters are used to collect color signals of the image, and the pixels under the white filters are used to collect brightness signals of the image, wherein a color filter with one light response in each group of filters corresponds to at least one white filter; and An infrared suppression film, disposed between the color filter and the pixel, to suppress infrared light from entering the pixel; The imaging method comprises the following steps: Step (610): performing bilinear interpolation on the color signals in the image, thereby obtaining a multi-channel color difference signal (Blue_DL / Red_DL / Green_DL) with low spatial frequency at each point in the image; Step (620): performing edge judgment interpolation on the brightness signal in the image, and providing two filters (Filter_L / Filter_H) with different spatial frequencies to filter each point in the image with the two filters, thereby obtaining a brightness signal (Y_L) with a low spatial frequency and a brightness signal (Y_H) with a high spatial frequency at each point; Step (630): Fusing the color difference signal (Blue_DL / Red_DL / Green_DL) with low spatial frequency and the luminance signal (Y_L) with low spatial frequency of each point in the image, thereby obtaining a color signal (Blue_LF / Red_LF / Green_LF) with low spatial frequency and high signal-to-noise ratio; Step (640): Eliminate the color deviation caused by the crosstalk signal (Alpha), thereby obtaining a more accurate color signal (Blue_LP / Red_LP / Green_LP); and Step (650): complement the brightness signal (Y_H) with high spatial frequency of each point back into the color signal (Blue_LP / Red_LP / Green_LP), and output the final color signal (Blue_Final / Red_Final / Green_Final).

2. The imaging method according to claim 1, characterized in that The image sensor is a FSI or BSI image sensor.

3. The imaging method according to claim 1, characterized in that: The invention also includes a transparent film, which is arranged between the white filter and the pixel.

4. The imaging method according to claim 1, wherein: The color filter includes a first photo-responsive color filter, a second photo-responsive color filter, and a third photo-responsive color filter.

5. The imaging method according to claim 4, characterized in that: The first photo-responsive color filter is a green filter, the second photo-responsive color filter is a blue filter, and the third photo-responsive color filter is a red filter.

6. The imaging method according to claim 5, characterized in that: Each group of filters is arranged in a 4X4 format.

7. The imaging method according to claim 5, characterized in that: In each group of filters, the first light response color filters account for 37.5%; the second light response color filters account for 18.75%; the third light response color filters account for 18.75%; and the white filters account for 25%.

8. The imaging method according to claim 7, characterized in that: Each group of filters includes a first subgroup, a second subgroup, a third subgroup, and a fourth subgroup; the first subgroup includes three of the second light responsive color filters and one white filter; the fourth subgroup includes three of the third light responsive color filters and one white filter; the second subgroup and the third subgroup include three first light responsive color filters and one white filter, respectively; the first subgroup is diagonally related to the fourth subgroup, and the second subgroup is diagonally related to the third subgroup.

9. The imaging method according to claim 7 or 8, characterized in that: The first light-responsive color filters are arranged in the third and fourth columns of the first row, the third column of the second row, the first and second columns of the third row, and the first column of the fourth row; the second light-responsive color filters are arranged in the first and second columns of the first row, and the first column of the second row; the third light-responsive color filters are arranged in the third and fourth columns of the third row, and the third column of the fourth row; the white filters are arranged in the second and fourth columns of the second row, and the second and fourth columns of the fourth row.

10. The imaging method according to claim 5, characterized in that: In each group of filters, the first light response color filter accounts for 25%; the second light response color filter accounts for 12.5%; the third light response color filter accounts for 12.5%; and the white filter accounts for 50%.

11. The imaging method according to claim 10, characterized in that: Each group of filters includes a first subgroup, a second subgroup, a third subgroup, and a fourth subgroup; the first subgroup includes two of the second light-responsive color filters and two white filters; the fourth subgroup includes two of the third light-responsive color filters and two white filters; the second subgroup and the third subgroup include two first light-responsive color filters and two white filters, respectively; the first subgroup is diagonally related to the fourth subgroup, and the second subgroup is diagonally related to the third subgroup.

12. The imaging method according to claim 10 or 11, characterized in that: The first light-responsive color filter is set in the third column of the first row, the fourth column of the second row, the first column of the third row, and the second column of the fourth row; the second light-responsive color filter is set in the first column of the first row and the second column of the second row; the third light-responsive color filter is set in the third column of the third row and the fourth column of the fourth row; the white filter is set in the second and fourth columns of the first row, the first and third columns of the second row, the second and fourth columns of the third row, and the first and third columns of the fourth row.

13. The imaging method according to claim 10 or 11, characterized in that: The first light-responsive color filter is set in the third column of the first row, the third column of the second row, the second column of the third row, and the second column of the fourth row; the second light-responsive color filter is set in the first column of the first row and the first column of the second row; the third light-responsive color filter is set in the fourth column of the third row and the fourth column of the fourth row; the white filter is set in the second and fourth columns of the first row, the second and fourth columns of the second row, the first and third columns of the third row, and the first and third columns of the fourth row.

14. The imaging method according to claim 10, wherein: Each group of filters includes a first subgroup, a second subgroup, a third subgroup, and a fourth subgroup; the first subgroup and the fourth subgroup respectively include a first light-responsive color filter, a second light-responsive color filter, and two white filters; the second subgroup and the third subgroup respectively include a first light-responsive color filter, a third light-responsive color filter, and two white filters; the first subgroup is diagonally related to the fourth subgroup, and the second subgroup is diagonally related to the third subgroup.

15. The imaging method according to claim 10 or 14, characterized in that: The first light-responsive color filter is arranged in the second and fourth columns of the second row, and the second and fourth columns of the fourth row; the second light-responsive color filter is arranged in the first column of the first row, and the third column of the third row; the third light-responsive color filter is arranged in the third column of the first row, and the first column of the third row; the white filter is arranged in the second and fourth columns of the first row, the first and third columns of the second row, the second and fourth columns of the third row, and the first and third columns of the fourth row.

16. An imaging device comprising an image sensor to which the imaging method according to claim 1 is applied, characterized in that: The imaging device further comprises: a signal processing unit connected to the image sensor, configured to process the color signal and the brightness signal output by the image sensor to convert them into a full-color signal, and to continue processing the full-color signal to output color image data; A display unit connected to the signal processing unit, and configured to display a color image according to the color image data; A storage unit connected to the display unit and used to store the color image; A control unit is connected to the image sensor, the signal processing unit, and the storage unit, and is used to control signal transmission.

17. The imaging method according to claim 1, wherein: The color signal accounts for 75%, and the brightness signal accounts for 25%.

18. The imaging method according to claim 1, wherein: The color signal accounts for 50%, and the brightness signal accounts for 50%.

19. The imaging method according to claim 1, wherein: The high spatial frequency refers to a short-distance mutation, a sharp fluctuation, image details, a rough or non-uniform part; the low spatial frequency refers to a long-distance and large-scale slow change, image background, a flat or uniform part.

20. The imaging method according to claim 1, wherein: The calculation formula of step (630) is as follows: Blue_LF=Blue_DL+Y_L; Red_LF=Red_DL+Y_L; Green_LF=Green_DL+Y_L.

21. The imaging method according to claim 1, wherein: The calculation formula of step (640) is as follows: Blue_LP=Blue_LF–Y_L*Alpha; Red_LP=Red_LF–Y_L*Alpha; Green_LP=Green_LF–Y_L*Alpha.

22. The imaging method according to claim 1, wherein: The calculation formula of step (650) is as follows: Blue_Final=Blue_LP+Y_H; Red_Final=Red_LP+Y_H; Green_Final=Green_LP+Y_H.

Images