Image forming apparatus
By adjusting the color filter pattern according to region changes in the pixel array of the imaging device, the image quality problems caused by traditional uniform arrangement of color filters are solved, and better noise reduction and color reproducibility are achieved.
Patent Information
- Application Number
- CN202380080116.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-11-30
- Filing Date
- 2023-10-12
- Publication Date
- 2025-06-27
AI Technical Summary
In imaging devices, conventional uniformly arranged color filters make it difficult to achieve an ideal state of image quality, especially in the periphery of the array.
By employing different color filter patterns or arrangements in different regions of the pixel array, such as using RGBCMY color filter patterns in the central region and using RGB color filter patterns in the peripheral region, the configuration of the color filter is adjusted according to the region changes.
The relative noise level and color reproducibility in the pixel-generated signal are improved, especially in the periphery of the array, and image quality degradation due to deterioration of the peripheral light amount is prevented.
Smart Images

Figure CN120226473A_ABST
Abstract
Description
Cross - reference to Related Applications
[0001] This application claims the benefit of Japanese Priority Patent Application JP2022 - 192056, filed on November 30, 2022, the entire content of which is incorporated herein by reference. Technical Field
[0002] The present invention relates to an imaging device. Background Art
[0003] As a structure of a color filter in an imaging device, there is a structure in which primary color filters of R (red), G (green), and B (blue) are arranged for each photosensitive pixel in a photosensitive pixel array. In addition, in addition to the primary color filters, there is a structure in which complementary color filters are arranged for each photosensitive pixel (see Patent Document 1). Further, the arrangement pattern of the color filters repeats in the area of the entire array. Citation List Patent Documents
[0004] Patent Document 1: International Publication No. WO2021 / 171797 Summary of the Invention
[0005] Due to the characteristics of the imaging optical system, at a given light intensity within the subject area, the amount of light along the central axis of the optical system is greater than the amount of light at the periphery of the optical system or towards the periphery. The present invention provides an image sensor having different color filter patterns or arrangements in different regions of the pixel array, which solves the problems existing in other image sensors in the regions towards the periphery of the array. For example, compared with conventional image sensors, the image sensor according to an embodiment of the present invention can improve the relative noise level in the signals generated by the pixels and the reproducibility of colors, especially in the case towards the periphery of the array. The color filter pattern used herein may refer to the number and arrangement of color filters within a given pattern. According to an embodiment of the present invention, the pattern of the color filters changes with the distance from the center of the array. For example, the color filters may be arranged in a first pattern in the area including the center of the array, and may be arranged in a second pattern in the area outside the area where the color filters are arranged in the first pattern at the center of the array. According to other embodiments of the present invention, the color filters are arranged in a first pattern in a selected area of the array, and are arranged in a second pattern in the area of the array other than the area where the color filters are arranged in the first pattern. According to other embodiments of the present invention, the color filters within a single array can be arranged in two or more different patterns. According to at least some embodiments of the present invention, different patterns of color filters associated with a pixel array may include different sets of color filters. For example, the color filters of a first pattern may include red, green, blue, cyan, magenta, and yellow color filters, while the color filters of a second pattern may include only red, green, and blue color filters. According to other embodiments of the present invention, the color filters of different patterns may include different numbers of specific color filters. For example, the color filters of a first pattern may include one each of red, green, and blue color filters, while the color filters of a second pattern may include two each of red, green, and blue color filters. According to other embodiments of the present invention, the color filters of different patterns may include different sets of color filters and different numbers of specific color filters. For example, the color filters of a first pattern may include one each of red, green, blue, cyan, magenta, and yellow color filters, while the color filters of a second pattern may include one each of red and blue color filters and two yellow color filters. Other features and advantages of embodiments of the present invention will become more apparent from the following description, particularly when considered in conjunction with the accompanying drawings. Technical Problem
[0006] In an imaging device, color filters are typically configured to be uniformly arranged in a plane. In such a configuration, it is sometimes difficult to obtain ideal image quality.
[0007] There is a desire to provide an imaging device capable of obtaining desired image quality. Brief Description of the Drawings
[0008] Figure 1 is an explanatory diagram showing an overview of an imaging device according to a comparative example. Figure 2 is an explanatory diagram showing an example of characteristics of an imaging device according to a comparative example. Figure 3 is an explanatory diagram showing an example of image quality resulting from differences in the arrangement of color filters. Figure 4 is an explanatory diagram showing an overview of an imaging device according to an embodiment of the present invention. Figure 5 is an explanatory diagram showing an example of characteristics of an imaging device according to an embodiment. Figure 6 is an explanatory diagram showing an overview of Configuration Example 1 of an imaging device according to an embodiment. Figure 7 is a plan view showing an overview of Configuration Example 1 of an imaging device according to an embodiment. Figure 8 is an explanatory diagram showing an overview of Configuration Example 2 of an imaging device according to an embodiment. Figure 9 is a plan view showing an overview of Configuration Example 2 of an imaging device according to an embodiment. Figure 10 It is an explanatory diagram showing an overview of Configuration Example 3-1 of an imaging device according to an embodiment. Figure 11 It is a plan view showing an overview of Configuration Example 3-1 of an imaging device according to an embodiment. Figure 12 It is an explanatory diagram showing an overview of Configuration Example 3-2 of an imaging device according to an embodiment. Figure 13 It is a plan view showing an overview of Configuration Example 3-2 of an imaging device according to an embodiment. Figure 14 It is an explanatory diagram showing an overview of Configuration Example 3-3 of an imaging device according to an embodiment. Figure 15 It is a plan view showing an overview of Configuration Example 3-3 of an imaging device according to an embodiment. Figure 16 It is an explanatory diagram showing an overview of Configuration Example 4-1 of an imaging device according to an embodiment. Figure 17 It is an explanatory diagram showing an overview of Configuration Example 4-2 of an imaging device according to an embodiment. Figure 18 It is an explanatory diagram showing an overview of Configuration Example 5 of an imaging device according to an embodiment. Figure 19 It is an explanatory diagram showing an overview of Configuration Example 6-1 of an imaging device according to an embodiment. Figure 20 It is an explanatory diagram showing an overview of Configuration Example 6-2 of an imaging device according to an embodiment. Figure 21 It is an explanatory diagram showing an overview of Configuration Example 6-3 of an imaging device according to an embodiment. Detailed Description of the Invention
[0009] Embodiments of the present invention will be described in detail below with reference to the accompanying drawings. Note that the description will be made in the following order. 0. Comparative Example ( Figures 1 to 3 ) 1. Embodiment 1.1 Overview ( Figures 4 to 5 ) 1.2 Configuration Example ( Figures 6 to 21 ) 1.3 Effects 2. Other Embodiments 0. Comparative Example
[0010] Figure 1 It shows an overview of an imaging device according to a comparative example.
[0011] The imaging device according to the comparative example includes a pixel array 101 which includes a plurality of pixels 100 arranged two-dimensionally. Light from a subject is incident on the pixel array 101 via an imaging optical system 2.
[0012] The pixel array 101 includes a light-receiving layer 20, a color filter layer 10 stacked on the light-receiving layer 20, and a plurality of microlenses 30.
[0013] The light-receiving layer 20 includes a semiconductor substrate and includes a plurality of light-receiving elements 21 arranged two-dimensionally. The light-receiving elements 21 include, for example, PDs (photodiodes). The light-receiving elements 21 output pixel signals corresponding to the incident light.
[0014] The color filter layer 10 includes a plurality of color filters 11 arranged two-dimensionally corresponding to the plurality of light-receiving elements 21. The microlenses 30 are stacked on the plurality of color filters 11.
[0015] The plurality of color filters 11 include color filters having different colors from each other. Figure 1 An arrangement example of the color filters 11 is shown, which include primary color filters and complementary color filters. The primary color filters include, for example, an R (red) filter 11R, a G (green) filter 11G, and a B (blue) filter 11B, and the complementary color filters include, for example, a C (cyan) filter 11C, an M (magenta) filter 11M, and a Y (yellow) filter 11Y.
[0016] Figure 2 Characteristic examples of the imaging device according to the comparative example are shown. In Figure 2 , the horizontal axis represents the distance from the center point of the pixel array 101, where 0% of the distance corresponds to the center point of the pixel array 101, and 100% of the distance corresponds to the point farthest from the center point on the pixel array. The left vertical axis represents the amount of light, and the right vertical axis represents the noise and color reproducibility.
[0017] In the imaging device according to the comparative example, regardless of the distance from the center point of the pixel array 101 or regardless of which region, the color filters 11 are configured to be uniformly arranged in a plane. For this reason, as Figure 1 shown, the arrangement structure of the color filters 11 is uniform in all regions including the central region 40 and the peripheral region 50. At the same time, in the imaging device, generally, compared with the central region 40, in the peripheral region 50, the amount of incident light on the pixel array 101 decreases according to the cosine fourth law. Therefore, the light-receiving sensitivity in the periphery of the screen decreases, and the signal-to-noise (SN) ratio deteriorates. This causes deterioration of the image quality. If color filters 11 other than RGB are introduced to improve color reproducibility, the decrease in the signal-to-noise ratio will be significantly manifested as noise in the periphery of the screen.
[0018] Figure 3 Shows an example of image quality caused by differences in the arrangement of the color filters 11. In Figure 3 the lower half, the horizontal axis represents the distance from the center point of the pixel array in percentage (%), where a distance of 0% corresponds to the center point of the pixel array, and a distance of 100% corresponds to the point farthest from the center point in the pixel array; the vertical axis represents the amplitude of the pixel signal. Figure 3 The following amplitudes of the pixel signal are shown in the lower half: the amplitude when the arrangement of the color filters 11 is RGBCMY and the amplitude when the arrangement of the color filters 11 is RGB. Figure 3 An example of the actually obtained image for the target color is shown in the upper half. Figure 3 An example of the actually obtained image is shown in the upper half: the image when the arrangement of the color filters 11 is RGBCMY and the image when the arrangement of the color filters 11 is RGB. In Figure 3 In the image shown in the upper half of , the smaller the value, the higher the color reproducibility.
[0019] As described above, when the arrangement of the color filters 11 is uniform in the plane, since the amount of light decreases as the distance from the center point increases, the image quality of the peripheral region 50 deteriorates. For this reason, for the pixel signals in the peripheral region 50, the gain of the signal is increased. In this case, when the arrangement of the color filters 11 is RGBCMY, as Figure 3 shown in the upper part of , in the obtained image, the color reproducibility is close to the target color (good color reproducibility), but the granular noise is obvious. At the same time, when the arrangement of the color filters 11 is RGB, in the obtained image, the color reproducibility is poor, but the noise is not obvious. 1. Embodiment 1.1 Overview
[0020] Figure 4 Shows an overview of an imaging device according to an embodiment of the present invention. Figure 5 Shows an example of the characteristics of an imaging device according to an embodiment. In Figure 5 it, the horizontal axis represents the distance from the center point of the pixel array 1, where a distance of 0% corresponds to the center point of the pixel array 1, and a distance of 100% corresponds to the point farthest from the center point on the pixel array 1; the left vertical axis represents the amount of light, and the right vertical axis represents noise and color reproducibility.
[0021] The imaging device according to this embodiment may be, for example, a CMOS (Complementary Metal Oxide Semiconductor) type image sensor. The imaging device according to this embodiment includes a pixel array 1, and the pixel array 1 includes a plurality of pixels 100 arranged two-dimensionally. Light from a subject enters the pixel array 1 through an imaging optical system 2. According to at least some embodiments of the present invention, the center point of the pixel array 1 coincides with the central axis of the imaging optical system 2.
[0022] The pixel array 1 includes a light receiving layer 20, a color filter layer 10 stacked on the light receiving layer 20, and a plurality of microlenses 30.
[0023] The color filter layer 10 includes a plurality of color filters 11 arranged two-dimensionally corresponding to a plurality of light receiving elements 21. The microlenses 30 are stacked on the plurality of color filters 11. The plurality of color filters 11 includes a plurality of primary color filters and one or more complementary color filters.
[0024] The structure of the pixel array 1 in the imaging device according to this embodiment is different from the structure of the pixel array 101 in the imaging device according to the above comparative example in the structure of the plurality of color filters 11 in the color filter layer 10. The structure of the light receiving layer 20 in the imaging device according to this embodiment may be similar to the structure of the light receiving layer 20 in the imaging device according to the above comparative example.
[0025] In the imaging device according to this embodiment, the pattern or structure of the plurality of color filters 11 varies according to the region in the plane. For example, the structure of the plurality of color filters 11 changes according to the distance from the center point of the pixel array 1. In Figure 4 the structural example, the structure of the plurality of color filters 11 is configured to include more complementary color filters in the central region 40 than in the peripheral region 50. Specifically, the pattern or arrangement of the color filters 11 in the central region 40 is configured as RGBCMY, while the pattern or arrangement of the color filters 11 in the peripheral region 50 is configured as RGB. Therefore, as Figure 5 shown, compared with the peripheral region 50, the structure of the plurality of color filters 11 in the central region 40 has higher color reproducibility. In addition, compared with the characteristics of the imaging device according to the comparative example ( Figure 2 ), the characteristic of noise reduction in the peripheral region 50 is obtained.
[0026] As described above, in the imaging device according to this embodiment, as an example, it may have the characteristic of prioritizing color reproducibility in the central region 40 and prioritizing noise reduction in the peripheral region 50. Therefore, it is possible to prevent the deterioration of image quality due to the deterioration of the peripheral light amount. 1.2 Structural Example
[0027] A more specific structural example of the imaging device according to this embodiment will be described below. (Configuration Example 1)
[0028] Figure 6 and 7 show an overview of Configuration Example 1 of the imaging device according to the present embodiment.
[0029] As Figure 7 shown, in the imaging device according to Configuration Example 1, the arrangement of the color filters 11 in the central region (for example, the region where the distance from the center point of the pixel array 1 is more than about 0% and less than about 60%) is configured as RGBCMY, while the arrangement of the color filters 11 in the peripheral region (for example, the region where the distance from the center point of the pixel array 1 is more than about 60% and about 100% or less) is configured as RGB. Therefore, compared with the case where the arrangement of the color filters 11 is RGB, higher color reproducibility performance is obtained in the central region. At the same time, compared with the case where the arrangement of the color filters 11 is RGBCMY, less obvious noise performance is obtained in the peripheral region. Therefore, for example, compared with the case where the color filters 11 are uniformly arranged over the entire region of the pixel array 1, less obvious noise performance in the peripheral region is obtained.
[0030] Note that in Figure 6 , the horizontal axis represents the distance from the center point of the pixel array 1 in percentage, and the vertical axis represents the mixing ratio. Here, the ratio when the color filter 11 changes from the first reference pattern or arrangement to the second reference pattern or arrangement is defined as the mixing ratio. The mixing ratio of the first reference arrangement is set to 0%, and the mixing ratio of the second reference arrangement is set to 100%. In Figure 7 's configuration example, the ratio when RGBCMY (i.e., the arrangement of the color filter 11 with a mixing ratio of 0%) changes to RGB (i.e., the arrangement of the color filter 11 with a mixing ratio of 100%) is defined as the mixing ratio. In Figure 7 's configuration example, since there are only two arrangements of the color filter 11, the change in the mixing ratio is two values, 0% and 100%.
[0031] Note that Figure 6 shows an example where the boundary where the change in the arrangement of the color filter 11 is located is at a distance of 60% from the center point of the pixel array 1, but the boundary where the change in the arrangement of the color filter 11 is located is not limited to a distance of 60% from the center point of the pixel array 1. (Configuration Example 2)
[0032] Figure 8 and 9 show an overview of the second configuration example of the imaging device according to the present embodiment. In Figure 8 , the horizontal axis represents the distance from the center point of the pixel array 1, and the vertical axis represents the mixing ratio.
[0033] The above-described Configuration Example 1 shows two arrangement patterns or types of the color filter 11, but the arrangement pattern or type of the color filter 11 can also be three or more. According to the distance from the center point of the pixel array 1, the arrangement of the color filter 11 can vary in three or more levels. In this way, the arrangement of the color filter 11 can be smoothly switched according to the distance from the center point of the pixel array 1.
[0034] In the imaging device according to Configuration Example 2, as Figure 9 shown, the arrangement of the color filter 11 in the central region (for example, the image height is about 0% or more and less than about 30%) is configured as RGBCMY, while the arrangement of the color filter 11 in the peripheral region (for example, the image height is about 80% or more and 100% or less) is configured as RGB. In addition, in the intermediate region (for example, the distance from the center point of the pixel array 1 is about 30% or more and less than about 80%), the arrangement of the color filter 11 is configured to change from RGBCMY to RGB according to the Figure 8 predetermined mixing ratio shown. Note that Figure 9 shows a configuration example with a mixing ratio of 40% as an example of the color filter 11 in the intermediate region. The arrangement of the color filter 11 in the intermediate region can adopt the arrangement shown in Figure 10 described later.
[0035] Note that Figure 8 shows an example in which the boundary of the intermediate region is set to a distance of 30% from the center point of the pixel array 1 and a distance of 80% from the center point of the pixel array 1, but the boundary of the intermediate region is not limited to this. (Configuration Example 3-1)
[0036] Figure 10 and 11 show an overview of Configuration Example 3-1 of the imaging device according to the present embodiment. In Figure 10 , the horizontal axis represents the mixing ratio, and the vertical axis represents the total number of pixels.
[0037] The configuration of multiple color filters 11 can be configured to change the combination of color filters of corresponding colors according to the distance from the center point of the pixel array 1 while maintaining a constant ratio. Figure 10 and 11 show an arrangement example of the color filter 11 for every 64 pixels (8 pixels vertically × 8 pixels horizontally). Figure 10 and 11 show an example: the arrangement of the color filter 11 with a mixing ratio of 0% is RGBCMY, and the arrangement of the color filter 11 with a mixing ratio of 100% is RGB. For example, in the intermediate region of Configuration Example 2 in Figure 8 and 9 , the arrangement of the color filter 11 can be as shown in Figure 10Changed from RGBCMY to RGB as shown. Figure 11 Shows an example of the arrangement of the color filters 11 with a mixing ratio of 100% being a Bayer array ( Figure 11 upper part) and the arrangement being a quad Bayer array (QBC: quad Bayer coding) ( Figure 11 lower part). (Configuration Example 3-2)
[0038] Figure 12 and 13 Shows an overview of Configuration Example 3-2 of the imaging device according to the present embodiment. In Figure 12 , the horizontal axis represents the mixing ratio, and the vertical axis represents the total number of pixels.
[0039] The structure of the plurality of color filters 11 can be configured such that the light receiving elements 21 in the peripheral region have higher light receiving sensitivity compared to the central region. In the plurality of color filters 11, the structure of the plurality of color filters 11 can be configured to include more complementary color filters in the peripheral region than in the central region. Figure 12 and 13 Shows an example where the arrangement of the color filters 11 with a mixing ratio of 0% is RGB (RGGB), and the arrangement of the color filters 11 with a mixing ratio of 100% is RYB (RYYB). In this example, in the central region, for example, the following structure is adopted: using primary color (RGB) color filters 11 to emphasize color reproducibility. As approaching the peripheral region, the following structure is adopted: increasing the Y-color (complementary color) color filters 11 instead of the G-color (one of the primary colors) color filters 11 to emphasize light receiving sensitivity. (Configuration Example 3-3)
[0040] Figure 14 and 15 Shows an overview of Configuration Example 3-3 of the imaging device according to the present embodiment. In Figure 14 , the horizontal axis represents the mixing ratio, and the vertical axis represents the total number of pixels.
[0041] The structure of the plurality of color filters 11 can be configured such that the light receiving elements 21 in the peripheral region have higher light receiving sensitivity compared to the central region. In the plurality of color filters 11, the plurality of color filters 11 can be configured to include more complementary color filters in the peripheral region than in the image height central region. Figure 14 and 15The following example is shown: The arrangement of the color filters 11 with a mixing ratio of 0% is RGB, while the arrangement of the color filters 11 with a mixing ratio of 100% is CMY. In this example, in the central region, the following structure is adopted: The primary color (RGB) color filters 11 are used to emphasize color reproduction. As approaching the peripheral region, the following structure is adopted: The complementary color (CMY) color filters 11 are increased to replace the primary color (RGB) color filters 11 to emphasize the light reception sensitivity. (Configuration Example 4-1)
[0042] Figure 16 The general situation of Configuration Example 4-1 of the imaging device according to the present embodiment is shown. In Figure 16 the upper half, the horizontal axis represents the distance (expressed as a percentage) from the center point of the pixel array 1, where a distance of 0% corresponds to the center point of the pixel array, and a distance of 100% corresponds to the point on the pixel array 1 that is farthest from the center point; the vertical axis represents the number of colors of the color filters 11.
[0043] The structure of the plurality of color filters 11 can be configured to change the number of colors and the color type according to the distance from the center point of the pixel array 1. Figure 16 The following example is shown: For each of the regions at a distance of more than 0% and less than 30% from the center point of the pixel array 1, at a distance of more than 30% and less than 60% from the center point of the pixel array 1, at a distance of more than 60% and less than 80% from the center point of the pixel array 1, and at a distance of more than 80% and 100% or less from the center point of the pixel array 1, the number of colors and the color type of the color filters 11 change. In the region at a distance of more than 0% and less than 30% from the center point of the pixel array 1, RGBCMY is used as the color of the color filters 11. In the region at a distance of more than 30% and less than 60% from the center point of the pixel array 1, RGBC is used as the color of the color filters 11. In the region at a distance of more than 60% and less than 80% from the center point of the pixel array 1, RGGB is used as the color of the color filters 11. In the region at a distance of more than 80% and 100% or less from the center point of the pixel array 1, RGBW is used as the color of the color filters 11. W represents white.
[0044] Note that in each region, the arrangement of the color filters 11 can be changed while keeping the number of colors of the color filters 11 unchanged. In addition, the distance from the center point of the pixel array 1 of the boundary where the structure of the color filters 11 changes in different regions is not limited to Figure 16 the example shown. (Configuration Example 4-2)
[0045] Figure 17 The general situation of Configuration Example 4-2 of the imaging device according to the present embodiment is shown. InFigure 17 In the upper half, the horizontal axis represents the distance from the center point of the pixel array 1 (expressed as a percentage), where 0% corresponds to the center point of the pixel array 1, and 100% corresponds to the point on the pixel array 1 that is farthest from the center point of the pixel array 1; the vertical axis represents the number of colors of the color filter 11.
[0046] The structure of the plurality of color filters 11 can be configured to change the number of colors and the color types according to the distance from the center point of the pixel array 1. Figure 17 The following example is shown: For each region at a distance greater than 0% and less than 30% from the center point of the pixel array 1, at a distance greater than 30% and less than 60% from the center point of the pixel array 1, at a distance greater than 60% and less than 80% from the center point of the pixel array 1, and at a distance greater than 80% and less than 100% from the center point of the pixel array 1, the number of colors and the color types of the color filter 11 change. In the region at a distance greater than 0% and less than 30% from the center point of the pixel array 1, RGBCMY is used as the color of the color filter 11. In the region at a distance greater than 30% and less than 60% from the center point of the pixel array 1, RGBC is used as the color of the color filter 11. In the region at a distance greater than 60% and less than 80% from the center point of the pixel array 1, RGGB is used as the color of the color filter 11. In the region at a distance greater than 80% and less than 100% from the center point of the pixel array 1, RYYB is used as the color of the color filter 11.
[0047] Note that in each region, the arrangement of the color filter 11 can be changed while keeping the number of colors of the color filter 11 unchanged. In addition, the distance of the boundary where the structure change of the color filter 11 occurs is not limited to Figure 17 the example shown. (Structural Example 5)
[0048] Figure 18 Shows an overview of Structural Example 5 of the imaging device according to the present embodiment. In Figure 18 it, the horizontal axis represents the distance from the central pixel of the pixel array 1 (expressed as a percentage), where 0% corresponds to the central pixel, and 100% corresponds to the point on the pixel array that is farthest from the central pixel; the vertical axis represents the mixing ratio.
[0049] The structure of the plurality of color filters 11 can be configured to change the arrangement period of the color filters 11 of the corresponding colors according to the distance from the center point of the pixel array 1. For example, when the period in the longitudinal (vertical direction) is defined as N and the period in the lateral (horizontal direction) is defined as M, the arrangement period of the color filters 11 of the corresponding colors can be configured to change in (N×M). In Figure 18In this case, at each distance from the center point of the pixel array 1, the number of colors of the color filter 11 is the same, and the arrangement period of the color filter 11 changes according to the distance from the center point of the pixel array 1. Figure 18 The following example is shown: RGB is used as the color of the color filter 11 at each image height. Figure 18 The following example is shown: For each region at a distance of more than 0% and less than 30% from the center point of the pixel array 1, at a distance of more than 30% and less than 60% from the center point of the pixel array 1, at a distance of more than 60% and less than 80% from the center point of the pixel array 1, and at a distance of more than 80% and 100% or less from the center point of the pixel array 1, the arrangement period of the color filter 11 changes. In the region at a distance of more than 0% and less than 30% from the center point of the pixel array 1, the arrangement of the color filter 11 is a Bayer array (N×M = 1×1). In the region at a distance of more than 30% and less than 60% from the center point of the pixel array 1, the arrangement of the color filter 11 is a four-Bayer array (N×M = 2×2). In the region at a distance of more than 60% and less than 80% from the center point of the pixel array 1, the arrangement period of the color filter 11 is set to N×M = 3×3. In the region at a distance of more than 80% and 100% or less from the center point of the pixel array 1, the arrangement period of the color filter 11 is set to N×M = 4×4.
[0050] Note that the division method of the region where the arrangement period of the color filter 11 is changed is not limited to Figure 18 the example shown, and other configurations can be adopted. In addition, the change of the period (N×M) is not limited to Figure 18 the example shown, and other configurations can be adopted. (Configuration Example 6-1)
[0051] Figure 19 An overview of Configuration Example 6-1 of the imaging device according to this embodiment is shown.
[0052] The configuration of the plurality of color filters 11 can be configured to be different between one or more specific regions (a part of the region) 62 in the plane and other regions. In Figure 19 this case, the arrangement of the color filter 11 in the specific region 62 changes. Figure 19 The following example is shown: The specific region 62 is set periodically. Figure 19 The following example is shown: The arrangement of the color filter 11 in the specific region 62 is RGBCMY, while the arrangement of the color filter 11 in the other region 61 is RGB.
[0053] Note that the arrangement of the color filters 11 in the specific region 62 and other regions 61 is not limited to RGBCMY and RGB, and other patterns can be adopted. In addition, the shape, position, size, quantity, etc. of the specific region 62 are not limited to Figure 19 the example shown, and other patterns can be adopted. (Configuration Example 6-2)
[0054] Figure 20 Fig. shows an overview of Configuration Example 6-2 of the imaging device according to the present embodiment.
[0055] The configuration of the plurality of color filters 11 can be configured to be different between a plurality of specific regions 62 and other regions 61 in a plane, and can be configured to change the distribution density of the plurality of specific regions 62 according to the distance from the center point of the pixel array 1. In Figure 20 it, the arrangement of the color filters 11 in the specific region 62 changes. Figure 20 Fig. shows an example where the distribution density of the specific region 62 changes according to the distance from the center point of the pixel array 1. Figure 20 Fig. shows an example where the distribution density of the specific region 62 increases in the central region and decreases as it approaches the peripheral region. Figure 20 Fig. shows an example where the arrangement of the color filters 11 in the specific region 62 is RGBCMY, while the arrangement of the color filters 11 in the other regions 61 is RGB. Note that, for the sake of easy explanation, Figure 20 only a part of the distribution of the specific region 62 is shown in a simplified diagram for facilitating the understanding of the change in the distribution density of the specific region 62.
[0056] Note that the arrangement of the color filters 11 in the specific region 62 and other regions 61 is not limited to RGBCMY and RGB, and other patterns can be adopted. In addition, the shape, position, size, quantity, etc. of the specific region 62 are not limited to Figure 20 the form shown, and other patterns can be adopted. (Configuration Example 6-3)
[0057] Figure 21 Fig. shows an overview of Configuration Example 6-3 of the imaging device according to the present embodiment.
[0058] The configuration of the plurality of color filters 11 can be configured to be different between a plurality of specific regions 62 and other regions 61 in a plane. The configuration of the plurality of color filters 11 can be configured to have: a dense region 71 where the distribution density of the plurality of specific regions 62 is relatively high; and a sparse region 72 where the distribution density of the plurality of specific regions 62 is relatively low. In Figure 21 it, the arrangement of the color filters 11 in the specific region 62 changes.Figure 21 An example is shown below: the arrangement of the color filters 11 in the specific region 62 is RGBCMY, while the arrangement of the color filters 11 in the other regions 61 is RGB.
[0059] Note that the arrangements of the color filters 11 in the specific region 62 and the other regions 61 are not limited to RGBCMY and RGB, and other patterns can be adopted. In addition, the shape, position, size, number, etc. of the specific region 62 are not limited to Figure 21 the example shown, and other patterns can be adopted. In addition, the shape, position, size, number, etc. of the dense region 71 and the sparse region 72 are not limited to Figure 21 the example shown, and other patterns can be adopted. 1.3 Effects
[0060] As described above, in the imaging device according to the present embodiment, the structures of the plurality of color filters 11 vary according to regions in the plane, so that the desired image quality can be obtained.
[0061] Note that the effects described in this specification are only examples and are not limited thereto, and may also include other effects. This also applies to the effects of the following other embodiments. 2. Other Embodiments
[0062] The technology according to the present invention is not limited to the above embodiments and can be modified in various ways.
[0063] For example, the present technology may also have the following configurations. According to the present technology having the following configuration, the structures of the plurality of color filters vary according to regions in the plane. Therefore, the desired image quality can be obtained.
[0064] The exemplary embodiments may be configured according to the following: (1) An image sensor, comprising: a plurality of pixels, wherein the pixels are arranged in an array; a plurality of color filters, wherein each of the plurality of color filters is associated with one of the pixels included in the plurality of pixels, wherein the color filters are arranged in a first pattern in a first region of the array, and wherein the color filters are arranged in a second pattern in a second region of the array. (2) The image sensor according to (1), wherein the first region of the array includes the center of the array, and wherein the second region includes the periphery of the array. (3) The image sensor according to (2), wherein the color filter is arranged in a third pattern in the third region of the array, and wherein the third region is located between the first region of the array and the second region of the array. (4) The image sensor according to (3), wherein the color filter is arranged in a fourth pattern in the fourth region of the array, and wherein the fourth region is located between the third region of the array and the second region of the array. (5) The image sensor according to any one of (1) to (4), wherein the first pattern includes a first group of color filter types, and wherein the second pattern includes a second group of color filter types. (6) The image sensor according to any one of (1) to (5), wherein the first pattern includes a first number of different color filters, and wherein the second pattern includes a second number of different color filters. (7) The image sensor according to any one of (1) to (6), wherein the first pattern is applied in a plurality of regions of the array, and wherein the second region of the array where the second pattern is applied includes regions of the color filter other than the plurality of regions where the first pattern is applied. (8) The image sensor according to (7), wherein the density of the plurality of regions where the first pattern is applied within a first distance from the center of the array is greater than the density outside the first distance from the center of the array. (9) The image sensor according to (2), wherein the first pattern includes red, green, blue, cyan, magenta, and yellow color filters, and wherein the second pattern includes red, green, and blue color filters. (10) The image sensor according to (3), wherein the first pattern includes red, green, blue, cyan, magenta, and yellow color filters, wherein the third pattern includes red, green, blue, cyan, magenta, and yellow color filters forming an arrangement different from the arrangement in the first pattern, and wherein the second pattern includes green and blue color filters. (11) The image sensor according to (3), wherein the first pattern includes red, green, and blue color filters, wherein the third pattern includes red, green, blue, cyan, magenta, and yellow color filters, and wherein the second pattern includes cyan, magenta, and yellow color filters. (12) The image sensor according to (4), wherein the first pattern includes red, green, and blue color filters, wherein the third pattern includes red, green, blue, and yellow color filters, wherein the fourth pattern includes red, green, blue, and yellow color filters forming an arrangement different from that in the third pattern, and wherein the second pattern includes red, yellow, and blue color filters. (13) The image sensor according to (4), wherein the first pattern includes red, green, blue, cyan, magenta, and yellow color filters, wherein the third pattern includes red, green, blue, and cyan color filters, wherein the fourth pattern includes red, green, and blue color filters, and wherein the second pattern includes red, green, blue, and white color filters. (14) The image sensor according to (13), wherein each instance of the first pattern includes one each of red, green, blue, cyan, magenta, and yellow color filters, wherein each instance of the third pattern includes one each of red, green, blue, and cyan color filters, wherein each instance of the fourth pattern includes one red color filter, one blue color filter, and two green color filters, and wherein each instance of the second pattern includes one each of red, green, blue, and white color filters. (15) The image sensor according to (4), wherein the first pattern includes red, green, blue, cyan, magenta, and yellow color filters, wherein the third pattern includes red, green, blue, and cyan color filters, wherein the fourth pattern includes red, green, and blue color filters, and wherein the second pattern includes red, yellow, and blue color filters. (16) The image sensor according to (15), wherein each instance of the first pattern includes one each of red, green, blue, cyan, magenta, and yellow color filters, wherein each instance of the third pattern includes one each of red, green, blue, and cyan color filters, wherein each instance of the fourth pattern includes one red color filter, one blue color filter, and two green color filters, and wherein each instance of the second pattern includes one red color filter, one blue color filter, and two yellow color filters. (17) The image sensor according to (4), wherein the first pattern is a Bayer pattern having a 1×1 color filter period, wherein the third pattern is a Bayer pattern having a 2×2 color filter period, wherein the fourth pattern is a Bayer pattern having a 3×3 color filter period, and wherein the second pattern is a Bayer pattern having a 4×4 color period. (18) The image sensor according to (7), wherein the density of the first pattern at the center of the array is greater than the density towards the periphery of the array. (19) The image sensor according to (7), wherein the first pattern includes red, green, blue, cyan, magenta, and yellow color filters, and wherein the second pattern includes red, green, and blue color filters. (20) An electronic device, comprising: An imaging optical system; An image sensor, wherein the imaging optical system guides light to the image sensor, and the image sensor includes: A plurality of pixels, wherein the pixels are arranged in an array; A plurality of color filters, wherein each color filter of the plurality of color filters is associated with one pixel included in the plurality of pixels, wherein the color filters are arranged in a first pattern in a first region of the array, and wherein the color filters are arranged in a second pattern in a second region of the array.
[0065] Those skilled in the art should understand that various modifications, combinations, sub - combinations, and changes can be made according to design requirements and other factors, as long as they are within the scope of the appended claims or their equivalents. List of reference numerals
[0066] 1 Pixel array 2 Imaging optical system 10 Color filter layer 11 Color filter 11R R (red) color filter 11G G (green) color filter 11B B (blue) color filter 11C C (cyan) color filter 11M M (magenta) color filter 11Y Y (yellow) color filter 20 Light receiving layer (semiconductor substrate) 21 Light receiving element (PD (photodiode)) 30 Microlens 40 Image height center region 50 Peripheral area (peripheral image height area) 61 Other areas 62 Specific area (a part of the area) 71 Dense area 72 Sparse area 100 Pixel 101 Pixel array (imaging device)
Claims
1. An image sensor, comprising: a plurality of pixels, wherein the pixels are arranged in an array; a plurality of color filters, wherein each color filter of the plurality of color filters is associated with one pixel included in the plurality of pixels, wherein the color filters are arranged in a first pattern in a first region of the array, and wherein the color filters are arranged in a second pattern in a second region of the array.
2. The image sensor according to claim 1, wherein, The first region of the array includes the center of the array, and wherein the second region includes the periphery of the array.
3. The image sensor according to claim 2, wherein, The color filters are arranged in a third pattern in a third region of the array, and wherein the third region is located between the first region of the array and the second region of the array.
4. The image sensor according to claim 3, wherein, The color filters are arranged in a fourth pattern in a fourth region of the array, and wherein the fourth region is located between the third region of the array and the second region of the array.
5. The image sensor according to claim 1, wherein, The first pattern includes a first set of color filter types, and wherein the second pattern includes a second set of color filter types.
6. The image sensor according to claim 1, wherein, The first pattern includes a first number of different color filters, and wherein the second pattern includes a second number of different color filters.
7. The image sensor according to claim 1, wherein, The first pattern is applied to a plurality of regions of the array, and wherein the second region of the array to which the second pattern is applied includes regions other than the plurality of regions to which the first pattern is applied.
8. The image sensor according to claim 7, wherein, The density of the plurality of regions to which the first pattern is applied within a first distance from the center of the array is greater than the density outside the first distance from the center of the array.
9. The image sensor according to claim 2, wherein, The first pattern includes red, green, blue, cyan, magenta, and yellow color filters, and wherein the second pattern includes red, green, and blue color filters.
10. The image sensor according to claim 3, wherein, The first pattern includes red, green, blue, cyan, magenta, and yellow color filters, wherein the third pattern includes red, green, blue, cyan, magenta, and yellow color filters forming an arrangement different from the arrangement in the first pattern, and wherein the second pattern includes green and blue color filters.
11. The image sensor according to claim 3, wherein, The first pattern includes red, green, and blue color filters, wherein the third pattern includes red, green, blue, cyan, magenta, and yellow color filters, and wherein the second pattern includes cyan, magenta, and yellow color filters.
12. The image sensor according to claim 4, wherein, The first pattern includes red, green, blue, cyan, magenta, and yellow color filters, wherein the third pattern includes red, green, blue, and yellow color filters, wherein the fourth pattern includes red, green, blue, and yellow color filters forming an arrangement different from the arrangement in the third pattern, and 13. The image sensor according to claim 4, wherein, wherein the second pattern includes red, yellow, and blue color filters. The first pattern includes red, green, blue, cyan, magenta, and yellow color filters, wherein the third pattern includes red, green, blue, and cyan color filters, wherein the fourth pattern includes red, green, and blue color filters, and wherein the second pattern includes red, green, blue, and white color filters.
14. The image sensor according to claim 13, wherein, Each instance of the first pattern includes one red, green, blue, cyan, magenta, and yellow color filter, wherein each instance of the third pattern includes one red, green, blue, and cyan color filter, wherein each instance of the fourth pattern includes one red color filter, one blue color filter, and two green color filters, and wherein each instance of the second pattern includes one red, green, blue, and white color filter.
15. The image sensor according to claim 4, wherein, The first pattern includes red, green, blue, cyan, magenta, and yellow color filters, wherein the third pattern includes red, green, blue, and cyan color filters, wherein the fourth pattern includes red, green, and blue color filters, and wherein the second pattern includes red, yellow, and blue color filters.
16. The image sensor according to claim 15, wherein, Each instance of the first pattern includes one red, green, blue, cyan, magenta, and yellow color filter, wherein each instance of the third pattern includes one red, green, blue, and cyan color filter, wherein each instance of the fourth pattern includes one red color filter, one blue color filter, and two green color filters, and wherein each instance of the second pattern includes one red color filter, one blue color filter, and two yellow color filters.
17. The image sensor according to claim 4, wherein, The first pattern is a Bayer pattern with a 1×1 color filter period, wherein the third pattern is a Bayer pattern with a 2×2 color filter period, wherein the fourth pattern is a Bayer pattern with a 3×3 color filter period, and wherein the second pattern is a Bayer pattern with a 4×4 color period.
18. The image sensor according to claim 7, wherein, The density of the first pattern at the center of the array is greater than the density towards the periphery of the array.
19. The image sensor according to claim 7, wherein, The first pattern includes red, green, blue, cyan, magenta, and yellow color filters, and wherein the second pattern includes red, green, and blue color filters.
20. An electronic device, comprising: An imaging optical system; An image sensor, wherein the imaging optical system guides light to the image sensor, and the image sensor includes: A plurality of pixels, wherein the pixels are arranged in an array; A plurality of color filters, wherein each color filter in the plurality of color filters is associated with one pixel included in the plurality of pixels, wherein the color filters are arranged in a first pattern in a first region of the array, and wherein the color filters are arranged in a second pattern in a second region of the array.
Citation Information
Patent Citations
Visualization of software defined process control system for industrial process plant
JP2022192056A
Solid-state imaging device and electronic apparatus
WO2021171797A1