Image sensor, imaging module and electronic device
By using color filter arrays of red, blue and tunable filters in the image sensor to adapt to different brightness environments, the problem that image sensors are difficult to take into account high photosensitive and color recognition capabilities, and higher quality imaging is achieved.
Patent Information
- Application Number
- CN202421619019.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Utility models(China)
- Current Assignee / Owner
- Filing Date
- 2024-07-09
- Publication Date
- 2025-05-13
- Estimated Expiration
- 2034-07-09
AI Technical Summary
Image sensors are difficult to take into account both high photosensitive and better color recognition capabilities, which affects imaging quality.
A color filter array including red, blue and tunable filters is adopted. The tunable filter allows green or white light to pass through different states, adapt to different brightness environments, and improve the photosensitive ability and color recognition ability of the image sensor.
The image sensor has achieved high photosensitive ability and better color recognition ability in different environments, thereby improving imaging quality.
Smart Images

Figure CN222868987U_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of imaging technology, and more specifically, to an image sensor, an imaging module and an electronic device. Background Art
[0002] In the related art, in order to obtain the color information of the image, the pixels of the image sensor (such as CMOS image sensor, etc.) are usually in the form of Bayer RGGB array or RWWB array. Among them, the Bayer RGGB array (including 25% red filter, 50% green filter and 25% blue filter) is more in line with the visual characteristics of the human eye, with better color recognition ability, but the image has a lower light sensitivity; the RWWB array (including 25% red filter, 50% white filter and 25% blue filter) has a higher image light sensitivity, but poorer color recognition ability. Therefore, it is difficult for image sensors to take into account both high light sensitivity and better color recognition ability at the same time, which is not conducive to improving image quality. Utility Model Content
[0003] Embodiments of the present application provide an image sensor, an imaging module, and an electronic device.
[0004] The image sensor of the embodiment of the present application includes a color filter array and a plurality of photodiodes. The color filter array includes a plurality of filters, and the plurality of filters include a red filter, a blue filter, and a tunable filter. The tunable filter has a first state and a second state. In the first state, the tunable filter only allows green light to pass through, and in the second state, the tunable filter allows white light to pass through. The plurality of photodiodes are opposite to the color filter array, and the photodiodes obtain light signals passing through the color filter array and output electrical signals in response to the light signals.
[0005] In some embodiments, the image sensor includes a pixel array, the pixel array includes a plurality of pixels, each pixel includes a filter and a photodiode. When the photodiode senses that the brightness of the corresponding pixel is greater than a first preset range, the tunable filter in the pixel whose brightness is greater than the first preset range is in the first state; when the photodiode senses that the brightness of the corresponding pixel is less than the first preset range, the tunable filter in the pixel whose brightness is less than the first preset range is in the second state.
[0006] In some embodiments, the pixel array includes a minimum repeating unit, the minimum repeating unit includes a red pixel, a blue pixel and a tunable pixel, the filter in the red pixel is a red filter, the filter in the blue pixel is a blue filter, and the filter in the tunable pixel is a tunable filter.
[0007] In some embodiments, in the minimum repeating unit, the ratio of the number of the red pixel, the number of the blue pixel, and the number of the tunable pixel is 1:1:2.
[0008] In some embodiments, in the minimum repeating unit, the red pixel and the blue pixel are arranged diagonally; or, the red pixel and the blue pixel are arranged adjacent to each other in the same row or adjacent to each other in the same column.
[0009] In some embodiments, the minimum repeating unit includes 4 pixels in 2 rows and 2 columns, and the arrangement of the pixels in the minimum repeating unit is:
[0010] or, or, or, or, or, or, or, or, or, or, or,
[0011] Wherein, R represents the red pixel, B represents the blue pixel, and T represents the tunable pixel.
[0012] In some embodiments, the minimum repeating units are combined into a large pixel. When the brightness of the large pixel is greater than a second preset range, at least part of the tunable filters in the large pixel with a brightness greater than the second preset range are in the first state; when the brightness of the large pixel is less than the second preset range, at least part of the tunable filters in the large pixel with a brightness less than the second preset range are in the second state.
[0013] In some embodiments, the image sensor further comprises a processing circuit, the processing circuit being electrically connected to the pixel array. The image sensor further comprises a substrate and a substrate, the pixel array and the processing circuit being arranged flatly on the substrate, and the substrate being arranged on the substrate.
[0014] In some embodiments, the image sensor further includes a processing circuit, the processing circuit being electrically connected to the pixel array. The image sensor further includes a first substrate and a second substrate, the pixel array being disposed on the first substrate, the processing circuit being disposed on the second substrate, and the first substrate and the second substrate being stacked.
[0015] In some embodiments, the image sensor further comprises a circuit layer, the circuit layer being electrically connected to the photodiode and used to transmit the electrical signal. In the direction in which the light is incident on the image sensor, the circuit layer is disposed between the color filter array and the photodiode.
[0016] In some embodiments, the image sensor further comprises a circuit layer, the circuit layer being electrically connected to the photodiode and used to transmit the electrical signal. In the direction in which light is incident on the image sensor, the circuit layer is disposed on a side of the photodiode opposite to the color filter array.
[0017] In some embodiments, the tunable filter includes at least one of an electrochromic filter and a liquid crystal electrically controlled tunable filter.
[0018] In some embodiments, the image sensor further includes a microlens array, which is disposed on a light incident path of the color filter array, and the microlens array is used to converge light onto the color filter array.
[0019] The imaging module of the embodiment of the present application includes the image sensor described in any of the above embodiments.
[0020] The electronic device according to the embodiment of the present application includes the imaging module described in the above embodiment.
[0021] In the image sensor, imaging module and electronic device of the embodiments of the present application, the tunable filter has a first state and a second state. In the first state, the tunable filter only allows green light to pass through. At this time, the image sensor has better color recognition ability. In the second state, the tunable filter allows white light to pass through. At this time, the image sensitivity of the image sensor is relatively high. In this way, the image sensor can take into account both high sensitivity and better color recognition ability, which is beneficial to improving imaging quality.
[0022] Additional aspects and advantages of the present application will be given in part in the description below, and in part will become apparent from the description below, or will be learned through the practice of the present application. BRIEF DESCRIPTION OF THE DRAWINGS
[0023] The above and / or additional aspects and advantages of the present application will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:
[0024] Figure 1 is a schematic diagram of the structure of an electronic device in some embodiments of the present application;
[0025] Figure 2 It is a schematic diagram of the structure of electronic devices according to other embodiments of the present application;
[0026] Figure 3 yes Figure 1 A schematic structural diagram of an implementation of an image sensor in an electronic device shown;
[0027] Figure 4 yes Figure 1 A schematic structural diagram of another embodiment of an image sensor in an electronic device shown;
[0028] Figure 5 yes Figure 1 A schematic structural diagram of an implementation of a pixel array of an image sensor in an electronic device shown;
[0029] Figures 6 to 17 yes Figure 1 A schematic diagram of pixel arrangement in a minimum repeating unit of a pixel array of an image sensor in an electronic device shown;
[0030] Fig.18 yes Figure 1 A schematic structural diagram of another embodiment of a pixel array of an image sensor in an electronic device shown;
[0031] Fig.19 yes Figure 1 A structural schematic diagram of an implementation manner of a partial structure of an image sensor in an electronic device shown;
[0032] Fig. 20 yes Figure 1 A schematic structural diagram of another implementation of a partial structure of an image sensor in an electronic device is shown.
[0033] Description of main component symbols:
[0034] Electronic equipment 2000;
[0035] Imaging module 1000;
[0036] Image sensor 100; lens 200; processing chip 300;
[0037] Color filter array 10, filter 11, red filter 111, blue filter 113, tunable filter 115;
[0038] Photodiode 20;
[0039] Microlens array 30, microlens 31; pixel array 40, pixel 41, red pixel R, blue pixel B, tunable pixel T; minimum repeating unit 43;
[0040] Circuit layer 50; processing circuit 60; base plate 70; substrate 80; first substrate 91; second substrate 93. DETAILED DESCRIPTION
[0041] In order to make the above-mentioned purposes, features and advantages of the present application more obvious and easy to understand, the specific implementation methods of the present application are described in detail below in conjunction with the accompanying drawings. In the following description, many specific details are set forth to facilitate a full understanding of the present application. However, the present application can be implemented in many other ways different from those described herein, and those skilled in the art can make similar improvements without violating the connotation of the present application, so the present application is not limited by the specific embodiments disclosed below.
[0042] In the description of the present application, it should be understood that the terms "center", "length", "up", "down", "front", "back", "vertical", "horizontal", "top", "bottom", "inside", "outside", etc., indicating orientations or positional relationships, are based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing the present application and simplifying the description, and do not indicate or imply that the device or element referred to must have a specific orientation, be constructed and operated in a specific orientation, and therefore should not be understood as a limitation on the present application.
[0043] In addition, the terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" and "second" may explicitly or implicitly include at least one of the features. In the description of this application, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.
[0044] In this application, unless otherwise clearly specified and limited, the terms "installed", "connected", "connected" and the like should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, it can be the internal connection of two elements or the interaction relationship between two elements, unless otherwise clearly defined. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to specific circumstances.
[0045] In the present application, unless otherwise clearly specified and limited, a first feature being “above” or “below” a second feature may mean that the first and second features are in direct contact, or the first and second features are in indirect contact through an intermediate medium. Moreover, a first feature being “above”, “above”, and “above” a second feature may mean that the first feature is directly above or obliquely above the second feature, or simply means that the first feature is higher in level than the second feature. A first feature being “below”, “below”, and “below” a second feature may mean that the first feature is directly below or obliquely below the second feature, or simply means that the first feature is lower in level than the second feature.
[0046] See also Figure 1 , the electronic device 2000 of the embodiment of the present application includes an imaging module 1000. It should be noted that, in some embodiments, the electronic device 2000 includes but is not limited to vehicles, mobile terminals, medical devices, and security monitoring. The imaging module 1000 includes but is not limited to imaging modules 1000 in vehicles, mobile terminals, medical devices, and security monitoring. Among them, vehicles include but are not limited to passenger vehicles such as pure electric vehicles and hybrid vehicles, and large engineering vehicles whose working conditions are not very bad. Mobile terminals include but are not limited to mobile phones, tablet computers, laptops, smart wearable devices (such as smart watches, smart bracelets, smart glasses, smart helmets, etc.), head-mounted display devices, virtual reality devices, etc.
[0047] Among them, since the electronic device 2000 in this embodiment includes the imaging module 1000, it can be understood that the electronic device 2000 at least includes the same beneficial effects as the imaging module 1000. Therefore, for the beneficial effects of the electronic device 2000, please refer to the beneficial effects of the imaging module 1000 described below.
[0048] See also Figure 1 , the imaging module 1000 of the embodiment of the present application includes an image sensor 100. Further, in some embodiments, the imaging module 1000 also includes a lens 200, which is arranged on the light incident path of the image sensor 100, and the lens 200 is used to converge the light to the image sensor 100, and the lens 200 and the image sensor 100 can be packaged in the housing of the same imaging module 1000. Among them, the lenses in the lens 200 include but are not limited to spherical lenses, aspherical lenses and free-form lenses. The image sensor 100 can use a complementary metal oxide semiconductor (CMOS) photosensitive element or a charge-coupled device (CCD) photosensitive element.
[0049] For further information, see Figure 2 In some embodiments, the imaging module 1000 further includes a processing chip 300, which is electrically connected to the image sensor 100 and can be disposed inside or outside the housing. The processing chip 300 can receive a signal output by the image sensor 100 and process the received signal to obtain a target image.
[0050] Among them, since the imaging module 1000 in this embodiment includes the image sensor 100, it can be understood that the imaging module 1000 at least includes the same beneficial effects as the image sensor 100. Therefore, for the beneficial effects of the imaging module 1000, please refer to the beneficial effects of the image sensor 100 described below.
[0051] See also Figure 1 and Figure 3 The image sensor 100 of the embodiment of the present application includes a color filter array 10 and a plurality of photodiodes 20. The color filter array 10 includes a plurality of filters 11, and the plurality of filters 11 include a red filter 111, a blue filter 113, and a tunable filter 115. The tunable filter 115 has a first state and a second state. In the first state, the tunable filter 115 only allows green light to pass through. In the second state, the tunable filter 115 allows white light to pass through. The plurality of photodiodes 20 are opposite to the color filter array 10. The photodiodes 20 obtain light signals passing through the color filter array 10 and output electrical signals in response to the light signals.
[0052] Among them, the color filter array 10 (Color Filter Array, CFA) is a two-dimensional array composed of filters 11 of different colors. CFA plays the role of collecting color information of the image in the image sensor 100. In some embodiments of the present application, the CFA includes a plurality of filters 11, and the filters 11 allow light of a specific band to pass through. Among them, the plurality of filters 11 include a red filter 111, a blue filter 113 and a tunable filter 115. The red filter 111 only allows red light to pass through, the blue filter 113 only allows red light to pass through, the tunable filter 115 only allows green light to pass through in the first state, and the tunable filter 115 allows white light to pass through in the second state. In this way, the image sensor 100 can obtain the color information of the image through the plurality of filters 11.
[0053] It can be understood that when the tunable filter 115 is in the first state, the tunable filter 115 only allows green light to pass through. At this time, the CFA includes a red filter 111, a blue filter 113 and a green filter (a filter when the tunable filter 115 is in the first state), which is more in line with the visual characteristics of the human eye in the color recognition scheme. In this way, the image sensor 100 has a better color recognition ability; when the tunable filter 115 is in the second state, the tunable filter 115 allows white light to pass through. At this time, the CFA includes a red filter 111, a blue filter 113 and a white filter (a filter when the tunable filter 115 is in the second state), so that the image sensor 100 has a higher photosensitivity. Among them, the tunable filter 115 can be switched between the first state and the second state, so that the image sensor 100 can take into account both high photosensitivity and better color recognition ability, which is conducive to improving imaging quality.
[0054] The photodiode 20 is a semiconductor-based light sensor or light detector, and the photodiode 20 can convert a light signal into an electrical signal. In some embodiments of the present application, a plurality of photodiodes 20 are opposite to the color filter array 10, that is, the photodiode 20 is opposite to the filter 11, and the photodiode 20 can receive a light signal that passes through the corresponding filter 11, and output an electrical signal in response to the light signal, so that the photodiode 20 cooperates with the color filter array 10 to enable the image sensor 100 to obtain a color image.
[0055] It should be noted that, in some embodiments, the quantitative correspondence between the photodiodes 20 and the filters 11 may be different according to different image sensors 100. In one example, the photodiodes 20 correspond to the filters 11 one to one, that is, one photodiode 20 corresponds to one filter 11, for example, one red filter 111 corresponds to one photodiode 20. In one example, the quantitative relationship between the photodiodes 20 and the filters 11 is many-to-one, that is, multiple photodiodes 20 correspond to one filter 11. In one example, the quantitative relationship between the photodiodes 20 and the filters 11 is one-to-many, that is, one photodiode 20 corresponds to multiple filters 11.
[0056] Furthermore, in some embodiments, the image sensor 100 may further include a microlens array 30 . The microlens array 30 is disposed on the light incident path of the color filter array 10 . The microlens array 30 is used to converge light onto the color filter array 10 .
[0057] Specifically, in some embodiments, the microlens array 30 is disposed on a side of the color filter array 10 away from the photodiode 20. The microlens array 30 can converge light, thereby directing more incident light to the photodiode 20, thereby improving the photoelectric conversion efficiency.
[0058] More specifically, in some embodiments, the microlens array 30 includes a plurality of microlenses 31, and the microlens array 30 is a two-dimensional array formed by a plurality of microlenses 31. The microlenses 31 include, but are not limited to, spherical lenses, aspherical lenses, and free-form lenses. Among them, the quantitative correspondence between the microlenses 31 and the filters 11 may vary according to the image sensor 100. In one example, the microlenses 31 correspond to the filters 11 one-to-one, that is, one microlens 31 corresponds to one filter 11, for example, one red filter 111 corresponds to one microlens 31. In one example, the quantitative relationship between the microlenses 31 and the filters 11 is many-to-one, that is, multiple microlenses 31 correspond to one filter 11. In one example, the quantitative relationship between the microlenses 31 and the filters 11 is one-to-many, that is, one microlens 31 corresponds to multiple filters 11.
[0059] See also Figure 3 and Figure 5 In some embodiments, the image sensor 100 includes a pixel array 40 , the pixel array 40 includes a plurality of pixels 41 , and each pixel 41 includes a filter 11 and a photodiode 20 .
[0060] Specifically, in some embodiments, each pixel 41 includes, in addition to the filter 11 and the photodiode 20, a microlens 31 corresponding to the filter 11. When external light is incident on the image sensor 100, the microlens 31 can converge the light so that more incident light is guided to the filter 11 corresponding to the microlens 31, and the photodiode 20 receives the light filtered by the filter 11 and converts the light into an electrical signal according to the received light.
[0061] In the image sensor 100 of the embodiment of the present application, the tunable filter 115 has a first state and a second state. In the first state, the tunable filter 115 only allows green light to pass through. At this time, the image sensor 100 has better color recognition ability. In the second state, the tunable filter 115 allows white light to pass through. At this time, the image sensitivity of the image sensor 100 is relatively high. In this way, the image sensor 100 can take into account both high sensitivity and better color recognition ability, which is beneficial to improve imaging quality.
[0062] The image sensor 100 is further described below with reference to the accompanying drawings.
[0063] In the related art, if the image sensor is in a strong light environment, the brightness of the light entering the pixel is too high, which will cause the amount of light entering the pixel to exceed the preset brightness range. At this time, the image sensor is prone to image overexposure, affecting the imaging quality; if the image sensor is in a weak light environment, the brightness of the light entering the pixel is too low, which will cause the amount of light entering the pixel to be lower than the preset brightness range. At this time, the image of the image sensor is prone to low brightness, strong noise, poor color and missing detail information, affecting the imaging quality.
[0064] See also Figure 3 and Figure 5 In certain embodiments of the present application, when the photodiode 20 senses that the brightness of the corresponding pixel 41 is greater than a first preset range, the tunable filter 115 in the pixel 41 whose brightness is greater than the first preset range is in a first state; when the photodiode 20 senses that the brightness of the corresponding pixel 41 is less than the first preset range, the tunable filter 115 in the pixel 41 whose brightness is less than the first preset range is in a second state.
[0065] Among them, in the first state, the tunable filter 115 allows only green light to pass through, and the amount of light entering is reduced compared to the tunable filter 115 allowing white light to pass through, so that on the one hand, it can prevent the brightness of the pixel 41 from being too high, resulting in image overexposure, thereby improving the image quality; on the other hand, because green is more in line with the visual characteristics of the human eye, the color recognition ability of the image can also be improved in the first state. In the second state, the tunable filter 115 allows white light to pass through, and the amount of light entering is increased compared to the tunable filter 115 allowing only green light to pass through, so that the brightness of the pixel 41 is too low, resulting in low brightness, strong noise, poor color, and missing detail information in the image, thereby improving the image quality.
[0066] Specifically, please combine Figure 2 In some embodiments, if the pixel 41 includes a first pixel, and the photodiode 20 in the first pixel senses that the brightness of the first pixel is greater than a first preset range, the photodiode 20 in the first pixel may output a first signal to the processing chip 300 or a processor in the electronic device 2000 (not shown), and the processing chip 300 or the processor may adaptively adjust the state of the tunable filter 115 in the first pixel according to the first signal. For example, the processing chip 300 or the processor may control whether the tunable filter 115 in the first pixel is powered on according to the first signal to achieve adaptive adjustment of the state and place the tunable filter 115 in the first pixel in a first state, at which point the tunable filter 115 only allows green light to pass through.
[0067] If the pixel 41 includes a second pixel, and the photodiode 20 in the second pixel senses that the brightness of the second pixel is less than the first preset range, the photodiode 20 in the second pixel may output a second signal to the processing chip 300 or the processor, and the processing chip 300 or the processor may adaptively adjust the state of the tunable filter 115 in the second pixel according to the second signal. For example, the processing chip 300 or the processor may control whether the tunable filter 115 in the second pixel is powered on according to the second signal to achieve adaptive adjustment of the state and make the state of the tunable filter 115 in the second pixel in the second state, at which time the tunable filter 115 allows white light to pass through.
[0068] Exemplarily, in one example, the initial state of the tunable filter 115 is the second state. If the photodiode 20 in the first pixel senses that the brightness of the first pixel is greater than the first preset range, the state of the tunable filter 115 in the first pixel can be adjusted from the second state to the first state, at which time the tunable filter 115 only allows green light to pass through, and the amount of light entering the first pixel is reduced. In another example, the initial state of the tunable filter 115 is the first state. If the photodiode 20 in the second pixel senses that the brightness of the second pixel is less than the first preset range, the state of the tunable filter 115 in the second pixel can be adjusted from the first state to the second state, at which time the tunable filter 115 allows white light to pass through, and the amount of light entering the second pixel is increased.
[0069] In addition, in the present application, the setting of the tunable filter 115 can also improve the uniformity of the image brightness distribution, improve the imaging quality, and improve the vignetting effect (the brightness of the edge area of the image is lower and the brightness of the middle area is higher) caused by the optical characteristics of the lens 200 and the image sensor 100 in the imaging module 1000. Specifically, when the brightness of the edge area of the image is lower than the first preset range, the tunable filter 115 in the pixel 41 corresponding to the edge area can be in the second state, thereby increasing the amount of light entering the edge area; when the brightness of the middle area of the image is higher than the first preset range, the tunable filter 115 in the pixel 41 corresponding to the middle area can be in the first state, thereby reducing the amount of light entering the middle area while maintaining the color recognition ability of the middle area, thereby improving the vignetting effect of the imaging module 1000, achieving uniformity of the image brightness distribution, and improving the imaging quality.
[0070] In some embodiments, the tunable filter 115 includes at least one of an electrochromic filter and a liquid crystal electrically tunable filter.
[0071] Specifically, in one example, the tunable filter 115 includes an electrochromic filter. The electrochromic filter contains an electrochromic material. Under the action of an external electric field, the charges inside the electrochromic material will move and undergo an oxidation-reduction reaction, thereby causing the optical properties of the electrochromic filter to change. For example, when not powered on, the electrochromic filter is in a transparent state, that is, the electrochromic filter is in a second state, at which time the electrochromic filter allows white light to pass through; when powered on, the color of the electrochromic filter changes, that is, the electrochromic filter is in a first state, at which time the electrochromic filter only allows green light to pass through. Of course, in addition to green, the electrochromic filter can also only allow other monochromatic lights to pass through when powered on.
[0072] In another example, the tunable filter 115 includes a liquid crystal electrically controlled tunable filter. The liquid crystal electrically controlled tunable filter includes a liquid crystal molecule layer, and the liquid crystal molecule layer has an electrically controlled birefringence effect. Specifically, under the action of an external electric field, the arrangement of the liquid crystal molecules will change, thereby changing the refractive index and phase of the light. For example, when the power is turned on, the arrangement of the liquid crystal molecules changes, and the liquid crystal electrically controlled tunable filter only allows light of a specific wavelength to pass through, that is, the liquid crystal electrically controlled tunable filter is in a first state, at which time, the liquid crystal electrically controlled tunable filter only allows green light to pass through; when the power is not turned on, the arrangement of the liquid crystal molecule layer is in an initial state, and the liquid crystal electrically controlled tunable filter exhibits a white light transmission state, that is, the liquid crystal electrically controlled tunable filter is in a second state, at which time, the liquid crystal electrically controlled tunable filter allows white light to pass through. Of course, in addition to green, the liquid crystal electrically controlled tunable filter can also only allow other monochromatic lights to pass through when the power is turned on.
[0073] It can be understood that, in some embodiments, the tunable filters 115 in multiple pixels 41 are all electrochromic filters; or, the tunable filters 115 in multiple pixels 41 are all liquid crystal electrically-controlled tunable filters; or, the tunable filters 115 in part of the multiple pixels 41 are electrochromic filters, and the tunable filters 115 in another part are liquid crystal electrically-controlled tunable filters.
[0074] See also Figure 3 and Figure 5 In some embodiments, the pixel array 40 includes a minimum repeating unit 43, the minimum repeating unit 43 includes a red pixel R, a blue pixel B and a tunable pixel T, the filter 11 in the red pixel R is a red filter 111, the filter 11 in the blue pixel B is a blue filter 113, and the filter 11 in the tunable pixel T is a tunable filter 115.
[0075] Specifically, in some embodiments, the pixel array 40 includes a plurality of minimum repeating units 43, each of which includes a plurality of pixels 41, that is, each of which includes a red pixel R, a blue pixel B, and a tunable pixel T. Wherein, in the case where the pixel array 40 is a two-dimensional array composed of N*M pixels 41, the pixel array 40 may include Q minimum repeating units 43, each of which is a two-dimensional array composed of I*J pixels 41. Exemplarily, in the case where the pixel array 40 is a two-dimensional array composed of 4*4 pixels 41, the pixel array 40 may include 4 minimum repeating units 43, each of which includes 2*2 pixels 41.
[0076] In some embodiments, in the minimum repeating unit 43 , the ratio of the number of red pixels R, blue pixels B, and tunable pixels T is 1:1:2.
[0077] Among them, since green is more in line with the visual characteristics of the human eye, in the minimum repeating unit 43, when the ratio of the number of red pixels R, blue pixels B and tunable pixels T is 1:1:2, and at least part of the tunable filter 115 in the tunable pixel T is in the first state, the image sensor 100 can achieve better color recognition capability; when at least part of the tunable filter 115 in the tunable pixel T is in the second state, the image sensor 100 can achieve better photosensitivity.
[0078] For further information, see Figure 3 and Figure 5 , and combined with Figures 6 to 17 In some embodiments, in the minimum repeating unit 43, the red pixel R and the blue pixel B are arranged diagonally; or, the red pixel R and the blue pixel B are arranged in adjacent rows or columns.
[0079] Specifically, in some embodiments, in the minimum repeating unit 43, the number of pixels 41 in the row and column is equal. Exemplarily, the minimum repeating unit 43 includes but is not limited to 2 rows and 2 columns and 4 pixels 41, 4 rows and 4 columns and 16 pixels 41, 6 rows and 6 columns and 36 pixels 41, 8 rows and 8 columns and 64 pixels 41, and 10 rows and 10 columns and 100 pixels 41. This can improve the resolution and balanced color performance of the image in the row and column directions, and improve the display effect.
[0080] Please combine Figures 6 to 17 In some embodiments, when the minimum repeating unit 43 includes 4 pixels 41 in 2 rows and 2 columns, the arrangement of the pixels 41 in the minimum repeating unit 43 is:
[0081] (like Figure 6 or,
[0082] (like Figure 7 or,
[0083] (like Figure 8 or,
[0084] (like Fig. 9 or,
[0085] (like Fig.10 or,
[0086] (like Fig.11 or,
[0087] (like Fig.12 or,
[0088] (like Fig.13 or,
[0089] (like Fig.14 or,
[0090] (like Fig.15 or,
[0091] (like Fig.16 or,
[0092] (like Fig.17 shown);
[0093] Among them, R represents the red pixel R, B represents the blue pixel B, and T represents the tunable pixel T.
[0094] Specifically, the arrangement of pixels 41 in the minimum repeating unit 43 is: (like Figure 6 In the case shown in FIG. 1 , the red pixel R and the blue pixel B are arranged diagonally; in the minimum repeating unit 43, the arrangement of the pixels 41 is as follows: (like Fig.10 In the case shown in FIG. 1 , the red pixel R and the blue pixel B are arranged in adjacent rows; the arrangement of the pixels 41 in the minimum repeating unit 43 is as follows: (like Fig.12In the case shown in FIG. 4 , the red pixel R and the blue pixel B are arranged adjacent to each other in the same column. It is understandable that in other minimum repeating units 43, the red pixel R and the blue pixel B are arranged diagonally; or, the red pixel R and the blue pixel B are arranged adjacent to each other in the same row or adjacent to each other in the same column, which will not be explained one by one here.
[0095] See also Figure 3 and Figure 5 In some embodiments, the minimum repeating unit 43 is merged into a large pixel. When the brightness of the large pixel is greater than the second preset range, at least part of the tunable filter 115 in the large pixel whose brightness is greater than the second preset range is in the first state; when the brightness of the large pixel is less than the second preset range, at least part of the tunable filter 115 in the large pixel whose brightness is less than the second preset range is in the second state.
[0096] Specifically, in some embodiments, if the brightness of the large pixel is greater than the second preset range, the state of at least part of the tunable filter 115 in the large pixel can be adaptively adjusted, and at least part of the tunable filter 115 in the large pixel is placed in the first state. At this time, at least part of the tunable filter 115 only allows green light to pass through. Compared with all the tunable filters 115 allowing white light to pass through, the amount of light entering is reduced, thereby preventing the image from being overexposed due to excessive brightness of the pixel 41, thereby improving the imaging quality. On the other hand, since green is more in line with the visual characteristics of the human eye, the color recognition ability of the image can also be improved in the first state.
[0097] If the brightness of the large pixel is less than the second preset range, the state of at least part of the tunable filter 115 in the large pixel can be adaptively adjusted, and the state of at least part of the tunable filter 115 in the large pixel is in the second state. At this time, at least part of the tunable filter 115 allows white light to pass through. Compared with all tunable filters 115 only allowing green light to pass through, the amount of light entering is increased, thereby preventing the brightness of the pixel 41 from being too low, resulting in low brightness, strong noise, poor color, and missing detail information in the image, thereby improving the imaging quality. It should be noted that in some embodiments, the brightness of the large pixel can be sensed by the photodiode 20 in the large pixel.
[0098] Exemplarily, in one example, when the minimum repeating unit 43 includes 4 pixels 41 in 2 rows and 2 columns, the large pixel is a pixel synthesized by 4 pixels 45, and the large pixel includes 2 tunable pixels T. The initial state of the tunable filter 115 in the 2 tunable pixels T is the second state. If the brightness of the large pixel is greater than the second preset range, the state of at least part of the tunable filter 115 in the large pixel can be adjusted from the second state to the first state. At this time, the tunable filter 115 is only for green light to pass through, and the amount of light entering the first pixel is reduced. In another example, when the minimum repeating unit 43 includes 4 pixels 41 in 2 rows and 2 columns, the large pixel is a pixel synthesized by 4 pixels 45, and the large pixel includes 2 tunable pixels T. The initial state of the tunable filter 115 in the 2 tunable pixels T is the first state. If the brightness of the large pixel is less than the second preset range, the state of at least part of the tunable filter 115 in the large pixel can be adjusted from the first state to the second state. At this time, the tunable filter 115 allows white light to pass through, and the amount of light entering the second pixel increases.
[0099] It should be noted that, in some embodiments, the brightness of the large pixel may be the maximum value of the brightness of all pixels 41 in the minimum repeating unit 43; or, the brightness of the large pixel may be the average value of the brightness of all pixels 41 in the minimum repeating unit 43. The second preset range may be the same as the first preset range; or, the second preset range may be different from the first preset range.
[0100] See also Figure 3 and Fig.18 In some embodiments, when the minimum repeating unit 43 includes 4 pixels 41 in 2 rows and 2 columns, and in the minimum repeating unit 43, the ratio of the number of red pixels R, blue pixels B and tunable pixels T is 1:1:2, at least part of the tunable filter 115 in the large pixel is in the first state, which may include: the tunable filter 115 in all tunable pixels T in the large pixel is in the first state. At this time, the arrangement of the pixels 41 in the minimum repeating unit 43 may be: Or, the tunable filter 115 in some tunable pixels T in the large pixel is in the first state, and the tunable filter 115 in another part of the tunable pixels T is in the second state. At this time, the arrangement of the pixels 41 in the minimum repeating unit 43 can be: or Wherein, G represents a green pixel 41, that is, the tunable pixel T when the tunable filter 115 in the tunable pixel T is in the first state; W represents a white pixel 41, that is, the tunable pixel T when the tunable filter 115 in the tunable pixel T is in the second state.
[0101] When the minimum repeating unit 43 includes 4 pixels 41 in 2 rows and 2 columns, and in the minimum repeating unit 43, the ratio of the number of red pixels R, blue pixels B and tunable pixels T is 1:1:2, at least part of the tunable filter 115 in the large pixel is in the second state, which may include: all tunable pixels T in the large pixel are in the second state. At this time, the arrangement of the pixels 41 in the minimum repeating unit 43 may be: Or, some of the tunable pixels T in the large pixel are in the first state, and the other part is in the second state. In this case, the arrangement of the pixels 41 in the minimum repeating unit 43 can be: or
[0102] In summary, after the tunable pixel T is adaptively adjusted according to the change in light brightness, the arrangement of the pixels 41 in the minimum repeating unit 43 of the pixel array 40 may include: and At least one of the above, thereby, the image sensor 100 can take into account both high photosensitivity and better color recognition ability, and can flexibly adapt to different brightness scenes, thereby not only improving the imaging quality, but also improving the applicability of the image sensor 100.
[0103] See also Fig.19 or Fig. 20 In some embodiments, the image sensor 100 further includes a processing circuit 60, which is electrically connected to the pixel array 40. In some embodiments, the processing circuit 60 can receive the electrical signal generated by the pixel array 40, and process and control the electrical signal. For example, the processing circuit 60 can perform steps such as denoising and analog-to-digital conversion on the electrical signal.
[0104] Please combine Fig.19 In some embodiments, the image sensor 100 further includes a substrate 70 and a substrate 80, the pixel array 40 and the processing circuit 60 are arranged flat on the substrate 80, and the substrate 80 is arranged on the substrate 70. It can be understood that in this embodiment, the image sensor 100 is a non-stacked image sensor. Among them, the pixel array 40 and the processing circuit 60 are manufactured on the same substrate 80, and the pixel array 40 and the processing circuit 60 adopt the same manufacturing process. For example, the pixel array 40 and the processing circuit 60 are both arranged on the same substrate 80 using the same process (for example, a 65nm process).
[0105] Please combine Fig. 20In some other embodiments, the image sensor 100 further includes a processing circuit 60, and the processing circuit 60 is electrically connected to the pixel array 40. The image sensor 100 further includes a first substrate 91 and a second substrate 93, the pixel array 40 is disposed on the first substrate 91, and the processing circuit 60 is disposed on the second substrate 93, and the first substrate 91 and the second substrate 93 are stacked. It can be understood that in this embodiment, the image sensor 100 is a stacked image sensor. Among them, the pixel array 40 and the processing circuit 60 are manufactured on the first substrate 91 and the second substrate 93, respectively, and the pixel array 40 and the processing circuit 60 can adopt different manufacturing processes, for example, the pixel array 40 can adopt a 65nm process, and the processing circuit 60 can adopt a 45nm process.
[0106] See also Figure 3 or Figure 4 , and combined with Fig.19 or Fig. 20 In some embodiments, the image sensor 100 further includes a circuit layer 50, which is electrically connected to the photodiode 20 and is used to transmit electrical signals. Specifically, in some embodiments, the circuit layer 50 may be electrically connected to the processing circuit 60, so that the circuit layer 50 may transmit electrical signals to the processing circuit 60.
[0107] Please combine Figure 3 In some embodiments, in the direction in which the light is incident on the image sensor 100, the circuit layer 50 is disposed between the color filter array 10 and the photodiode 20. It is understood that in this embodiment, the image sensor 100 is a front-illuminated image sensor. Figure 4 In other embodiments, in the direction in which light is incident on the image sensor 100, the circuit layer 50 is disposed on the side of the photodiode 20 opposite to the color filter array 10. It can be understood that in this embodiment, the image sensor 100 is a back-illuminated image sensor. Among them, both the front-illuminated image sensor and the back-illuminated image sensor are non-stacked image sensors.
[0108] The technical features of the above-mentioned embodiments can be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above-mentioned embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification. At the same time, other implementation methods can be derived from the above-mentioned embodiments, so that structural and logical replacements and changes can be made without departing from the scope of this disclosure.
[0109] The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the patent. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the patent of the present application shall be subject to the attached claims.
Claims
1. An image sensor (100), characterized in that: include: A color filter array (10), the color filter array (10) comprising a plurality of filters (11), the plurality of filters (11) comprising a red filter (111), a blue filter (113) and a tunable filter (115), the tunable filter (115) having a first state and a second state, in the first state, the tunable filter (115) only allows green light to pass through, in the second state, the tunable filter (115) allows white light to pass through; and A plurality of photodiodes (20), the plurality of photodiodes (20) being opposite to the color filter array (10), the photodiodes (20) acquiring light signals transmitted through the color filter array (10), and outputting electrical signals in response to the light signals.
2. The image sensor (100) according to claim 1, characterized in that The image sensor (100) comprises a pixel array (40), the pixel array (40) comprises a plurality of pixels (41), and each of the pixels (41) comprises a filter (11) and a photodiode (20); When the photodiode (20) senses that the brightness of the corresponding pixel (41) is greater than a first preset range, the tunable filter (115) in the pixel (41) whose brightness is greater than the first preset range is in the first state; When the photodiode (20) senses that the brightness of the corresponding pixel (41) is less than a first preset range, the tunable filter (115) in the pixel (41) whose brightness is less than the first preset range is in the second state.
3. The image sensor (100) according to claim 2, characterized in that The pixel array (40) comprises a minimum repeating unit (43), the minimum repeating unit (43) comprises a red pixel, a blue pixel and a tunable pixel, the filter (11) in the red pixel is a red filter (111), the filter (11) in the blue pixel is a blue filter (113), and the filter (11) in the tunable pixel is a tunable filter (115).
4. The image sensor (100) according to claim 3, characterized in that In the minimum repeating unit (43), the number ratio of the red pixel, the blue pixel and the tunable pixel is 1:1:
2.
5. The image sensor (100) according to claim 3, characterized in that In the minimum repeating unit (43), the red pixel and the blue pixel are arranged diagonally; or, the red pixel and the blue pixel are arranged adjacent to each other in the same row or adjacent to each other in the same column.
6. The image sensor (100) according to claim 3, characterized in that The minimum repeating unit (43) comprises 4 pixels (41) in 2 rows and 2 columns. The arrangement of the pixels (41) in the minimum repeating unit (43) is as follows: Wherein, R represents the red pixel, B represents the blue pixel, and T represents the tunable pixel.
7. The image sensor (100) according to claim 3, characterized in that The minimum repeating units (43) are merged into a large pixel; When the brightness of the large pixel is greater than a second preset range, at least part of the tunable filters (115) in the large pixel having a brightness greater than the second preset range are in the first state; When the brightness of the large pixel is less than the second preset range, at least part of the tunable filters (115) in the large pixel with brightness less than the second preset range are in the second state.
8. The image sensor (100) according to claim 2, characterized in that The image sensor (100) further comprises a processing circuit (60), wherein the processing circuit (60) is electrically connected to the pixel array (40); The image sensor (100) further comprises a base plate (70) and a substrate (80), the pixel array (40) and the processing circuit (60) are arranged flatly on the substrate (80), and the substrate (80) is arranged on the base plate (70); or The image sensor (100) further comprises a first substrate (91) and a second substrate (93); the pixel array (40) is arranged on the first substrate (91); the processing circuit (60) is arranged on the second substrate (93); and the first substrate (91) and the second substrate (93) are arranged in a stacked manner.
9. The image sensor (100) according to claim 1, characterized in that: The image sensor (100) further comprises a circuit layer (50), wherein the circuit layer (50) is electrically connected to the photodiode (20) and is used to transmit the electrical signal; In the direction in which light is incident on the image sensor (100), the circuit layer (50) is arranged between the color filter array (10) and the photodiode (20); or, In the direction in which light is incident on the image sensor (100), the circuit layer (50) is arranged on a side of the photodiode (20) opposite to the color filter array (10).
10. The image sensor (100) according to claim 1, characterized in that The tunable filter (115) comprises at least one of an electrochromic filter and a liquid crystal electrically controlled tunable filter.
11. The image sensor (100) according to claim 1, characterized in that The image sensor (100) further comprises: A microlens array (30), the microlens array (30) being arranged on the light incident path of the color filter array (10), the microlens array (30) being used to converge light onto the color filter array (10).
12. An imaging module (1000), characterized in that: include: The image sensor (100) according to any one of claims 1 to 11.
13. An electronic device (2000), characterized in that: include: The imaging module (1000) of claim 12.