Light detection device

Abstract

[Problem] To expand dynamic range by improving both sensitivity and resolution. [Solution] This light detection device comprises: a photoelectric conversion region having a photoelectric conversion part for each pixel; a color filter region disposed on the side closer to a light incident surface than the photoelectric conversion region and having a plurality of unit pixel group regions for separating a plurality of wavelength components included in incident light; and a light control region disposed closer to the light incident surface than the color filter region and controlling the incident light. The light control region has a plurality of unit structures each controlling an opening range for capturing the incident light. Each of the plurality of unit structures has a plurality of microstructures. The size of the unit structures is larger than the size of the unit pixel group regions.

Description

Photodetector

[0001] The present disclosure relates to a light detection device.

[0002] Meta-optical elements containing nanostructures can achieve a variety of optical effects that cannot be achieved with existing optical elements, and can also be made much smaller in external dimensions than existing optical elements.

[0003] For example, Patent Document 1 discloses a meta-optical element that arranges nanostructures across multiple layers to adjust the refractive index and dispersion changes of each layer, thereby realizing a phase delay profile with almost no discontinuities.

[0004] Japanese Patent Application Laid-Open No. 2021-140152

[0005] The meta-optical element is configured by periodically arranging unit structures, each of which includes a nanostructure, in a two-dimensional direction. By arranging the meta-optical element closer to the light incident side than the color filter, light collected by the meta-optical element can be incident on the color filter. The color filter has a plurality of unit pixel group regions arranged in a two-dimensional direction, and each unit pixel group region has a plurality of pixels in, for example, a Bayer array. By making the period of the unit structures of the meta-optical element the same as the period of the unit pixel group regions of the color filter, light that has passed through the unit structures can be incident on the corresponding unit pixel group region of the color filter. The unit structures can collect light over a wider range than the size of each pixel included in the unit pixel group region, thereby improving the quantum efficiency Qe of each pixel.

[0006] However, if the period of the unit structures of the meta-optical element is the same as the period of the unit pixel group region of the color filter, the sensitivity and resolution of each pixel will be fixed, and the function of the meta-optical element, which can achieve a variety of optical effects, will not be fully utilized. Generally, to improve sensitivity, it is necessary to collect light from a wider area, and widening the light aperture range per pixel will result in a decrease in resolution. Conversely, narrowing the light aperture range will increase resolution but decrease sensitivity. Thus, there is a trade-off between sensitivity and resolution.

[0007] Therefore, the present disclosure provides a photodetector capable of improving both sensitivity and resolution and widening the dynamic range.

[0008] In order to solve the above problems, according to the present disclosure, there is provided a photodetector device comprising: a photoelectric conversion region having a photoelectric conversion unit for each pixel; a color filter region arranged closer to the light incident surface than the photoelectric conversion region, and having a plurality of unit pixel group regions that disperse the plurality of wavelength components contained in the incident light; and a light control region arranged closer to the light incident surface than the color filter region, and controlling the incident light, wherein the light control region has a plurality of unit structures that respectively control an aperture range that takes in the incident light, each of the plurality of unit structures having a plurality of microstructures, and the size of the unit structures is larger than the size of the unit pixel group region.

[0009] The plurality of unit pixel group regions may be periodically arranged in a two-dimensional direction, the plurality of unit structures may be periodically arranged in the two-dimensional direction, and the arrangement period of the unit structures in the two-dimensional direction may be longer than the arrangement period of the unit pixel group regions.

[0010] Each of the plurality of unit structures may condense incident light taken in through the aperture ranges of two or more different sizes for each wavelength of the incident light, and cause the light to be incident on the unit pixel group region.

[0011] Light that has passed through the plurality of unit pixel group regions in the color filter region is incident on the photoelectric conversion region and photoelectrically converted, the photoelectric conversion region has a plurality of pixels onto which light that has passed through the corresponding unit pixel group region is incident, and incident light that has been taken in by any of the opening ranges in the corresponding unit structure may be concentrated and incident on at least some of the plurality of pixels.

[0012] The plurality of pixels may include, for each wavelength of incident light, at least one first pixel and at least one second pixel having higher sensitivity than the first pixel and lower resolution than the first pixel.

[0013] The image sensor may further include a signal processing unit that generates an image with improved sensitivity and resolution based on pixel signals obtained by photoelectrically converting light that has passed through each of the plurality of unit pixel group regions and is incident on the plurality of pixels.

[0014] Each of the plurality of unit structures may focus incident light captured through two or more types of opening ranges that differ in at least one of size, shape, or opening direction for each wavelength of the incident light, and direct the light to be incident on a corresponding pixel position in the corresponding unit pixel group region.

[0015] At least two or more of the plurality of pixels corresponding to each of the plurality of unit pixel group regions may be incident with light that is captured and concentrated by two or more types of opening ranges that differ in at least one of the size, shape, or opening direction of the corresponding unit structure.

[0016] The two or more types of opening ranges may include an opening range having a size larger than the combined size of two or more of the pixels.

[0017] Each of the plurality of unit structures may cause first light and second light that are captured and concentrated by two opening ranges of different sizes for each wavelength of incident light to be incident on a corresponding pixel position in the corresponding unit pixel group region.

[0018] The first light may be light captured and collected by a first aperture range having a size equal to or larger than two of the pixels, and the second light may be light captured and collected by a second aperture range having a size smaller than the first aperture range.

[0019] The first opening area and the second opening area may be circular.

[0020] The two or more types of opening ranges may include two or more opening ranges whose opening directions are different from each other.

[0021] Each of the plurality of unit structures may cause first light and second light that are captured and concentrated in two of the opening ranges, each having a different opening direction, for each wavelength of incident light to be incident on a corresponding pixel position in the corresponding unit pixel group region.

[0022] The two opening areas may be elliptical in shape with their long and short sides oriented in different directions and the same size.

[0023] Each of the plurality of unit structures causes light incident on the circular or elliptical opening range having a length a in a first direction and a length b in a second direction perpendicular to the first direction to be incident on one pixel of the photoelectric conversion region, and the one pixel has a length x in the first direction and a length y in the second direction, and when the distance in the first direction between two adjacent pixels of the same color is X and the distance in the second direction is Y, the sizes of a and b of the light control region may be set so as to satisfy the following formulas (1) and (2).

[0024] x<a<2X-x...(1) y<b<2Y-y...(2)

[0025] At least one of the plurality of pixels onto which light that has passed through the unit pixel group region is incident may be designed so that light captured within the opening range of the unit structure corresponding to the unit pixel group region is not incident.

[0026] The opening range of each of the plurality of unit structures may be controlled by controlling at least one of the diameter of the microstructure, the height of the microstructure, the distance between two adjacent microstructures, or the pitch between two adjacent microstructures.

[0027] Each of the plurality of unit pixel group regions may be a pixel block in which pixels of a plurality of colors are arranged in a predetermined array.

[0028] The predetermined arrangement may be a Bayer arrangement or a quad arrangement.

[0029] 4A is a block diagram showing a schematic configuration of a light detection device according to an embodiment of the present disclosure. FIG. 4B is a cross-sectional view of a main portion of a light detection device according to the present embodiment. FIG. 4A is a top view showing a specific example of a light control region according to the present disclosure, and FIG. 4B is a cross-sectional view showing the relationship between the size, sensitivity, and resolution of an aperture range of a unit structure. FIG. 4B is a diagram showing the red and blue aperture ranges of a unit structure according to the present embodiment. FIG. 4C is a diagram showing the green aperture range of a unit structure according to the present embodiment. FIG. 4D is a diagram showing the red and blue aperture ranges of a unit structure according to a comparative example. FIG. 4E is a diagram showing the green aperture range of a unit structure according to a comparative example. FIG. 4F is a diagram showing the size of the aperture range of a unit structure according to the present embodiment. FIG. 4G is a diagram showing an example in which a unit structure has two or more types of aperture ranges that are the same size but have different opening directions. FIG. 4H is a diagram showing an example in which two types of elliptical or circular aperture ranges are different in size. FIG. 4H is a diagram showing the red and blue aperture ranges of a unit structure in a quad arrangement. FIG. 4I is a diagram showing the green aperture range of a unit structure in a quad arrangement. A block diagram showing an example of the schematic configuration of a vehicle control system. FIG. 4I is an explanatory diagram showing an example of the installation positions of an outside vehicle information detection unit and an imaging unit.

[0030] Hereinafter, an embodiment of a photodetector will be described with reference to the drawings. The following description will focus on the main components of the photodetector, but the photodetector may include components and functions that are not shown or described. The following description does not exclude components and functions that are not shown or described.

[0031] 1 is a block diagram showing a schematic configuration of a photodetector 1 according to an embodiment of the present disclosure. The photodetector 1 in FIG. 1 is intended to capture an image of incident light in the visible light band, but may also capture an image of IR light.

[0032] The photodetector device 1 in FIG. 1 includes a pixel array section 2, a vertical drive circuit 3, a column signal processing circuit 4, a horizontal drive circuit 5, an output circuit 6, and a control circuit 7.

[0033] The pixel array section 2 has a plurality of pixels 10 arranged in row and column directions, a plurality of signal lines L1 extending in the column direction, and a plurality of row selection lines L2 extending in the row direction. Although not shown in FIG. 1 , each pixel 10 has a photoelectric conversion section and a readout circuit that reads out a pixel signal corresponding to a photoelectrically converted charge to the signal line L1. The pixel array section 2 is a laminated body in which a photoelectric conversion region in which photoelectric conversion sections are arranged in a two-dimensional direction and a readout circuit region in which readout circuits are arranged in a two-dimensional direction are stacked.

[0034] The vertical drive circuit 3 drives the plurality of row selection lines L2. Specifically, the vertical drive circuit 3 supplies drive signals to the plurality of row selection lines L2 in a line-sequential manner, thereby selecting each row selection line L2 in a line-sequential manner.

[0035] A plurality of signal lines L1 extending in the column direction are connected to the column signal processing circuit 4. The column signal processing circuit 4 performs analog-to-digital (AD) conversion on a plurality of pixel signals supplied via the plurality of signal lines L1. More specifically, the column signal processing circuit 4 compares the pixel signal on each signal line L1 with a reference signal and generates a digital pixel signal based on the time it takes for the signal levels of the pixel signal and the reference signal to match. The column signal processing circuit 4 sequentially generates a digital pixel signal (P-phase signal) at the reset level of the floating diffusion layer in the pixel 10 and a digital pixel signal (D-phase signal) at the pixel signal level, and performs correlated double sampling (CDS).

[0036] The horizontal drive circuit 5 controls the timing at which the output signal of the column signal processing circuit 4 is transferred to the output circuit 6 .

[0037] The control circuit 7 controls the vertical drive circuit 3, the column signal processing circuit 4, and the horizontal drive circuit 5. The control circuit 7 generates a reference signal that is used by the column signal processing circuit 4 to perform AD conversion.

[0038] The photodetector 1 in FIG. 1 can be constructed by stacking a first substrate on which a pixel array section 2 and the like are arranged and a second substrate on which a vertical drive circuit 3, a column signal processing circuit 4, a horizontal drive circuit 5, an output circuit 6, a control circuit 7 and the like are arranged, using Cu-Cu connections, bumps, vias, or the like.

[0039] The photodiode PD of each pixel 10 in the pixel array unit 2 is disposed in a photoelectric conversion region. Although not shown in FIG. 1 , the photodetector 1 according to this embodiment also includes a light control region disposed closer to the light incident surface than the photoelectric conversion region. The light control region separates incident light according to wavelength. The light control region has, for example, a microstructure for each pixel 10.

[0040] Figure 2 is a diagram explaining the principle of the microstructure, and shows an example in which region A and region B, which each transmit light, are adjacent to each other. Region A and region B have a length L in the direction of light propagation. Region B has a refractive index of n0. In contrast, a portion of region A (L-L1) has a refractive index of n0, and the remaining region L1 has a refractive index of n1.

[0041] The optical path length dA of region A and the optical path length dB of region B in FIG. 2 are expressed by the following formulas (1) and (2), respectively.

[0042] dA=n0×(L−L1)+n1×L1 (1) dB=n0×L (2) Therefore, the optical path length difference Δd between the A region and the B region is expressed by the following equation (3).

[0043] Δd=dB−dA=L1(n0−n1) (3) Furthermore, the phase difference φ between the A region and the B region is expressed by the following equation (4).

[0044] φ=2πL1(n0-n1) / λ (4) As shown in equation (4), the optical path length of light propagating through area A and area B changes depending on the difference in refractive index between area A and area B, and the propagation direction differs depending on the refractive index difference. The difference in propagation direction depends on the wavelength of the light. Therefore, by preselecting a material with a refractive index appropriate for the wavelength band of the incident light, the light control area can be used as a color filter.

[0045] The light control region according to this embodiment is also called a color splitter (CFS: Color Filter Splitter). A color splitter can bend incident light at an angle according to its wavelength, and therefore can function similarly to a color filter. A color filter transmits only light of a specific wavelength band, and light of wavelength bands other than the specific wavelength band is wasted. However, the color splitter described above can bend light at different angles for each wavelength band, thereby increasing the light utilization efficiency.

[0046] If only a color splitter is used, there is a risk that the bent light will enter adjacent pixels 10, making it impossible to obtain the desired spectral characteristics. Therefore, a color filter can be used in combination with a color splitter. In this case, to prevent color mixing, the thickness of the color filter may be thinner than that of a color filter for a normal photodetector 1. As described above, this embodiment is characterized in that a color filter region is provided separately from the light control region, and the range of light incident on the light control region is controlled for each pixel 10 of each color in the color filter region.

[0047] FIG. 3 is a cross-sectional view of a main portion of the photodetector 1 according to this embodiment. As shown in FIG. 3, the photodetector 1 according to this embodiment includes a stacked body including a photoelectric conversion region 11, a color filter region 12, and a light control region 13. One end surface of the light control region 13 is a light incident surface S1. The photoelectric conversion region 11 includes a photoelectric conversion unit for each pixel 10. The photoelectric conversion unit is, for example, a photodiode. The color filter region 12 is disposed closer to the light incident surface S1 than the photoelectric conversion region 11 and includes a plurality of unit pixel group regions 14 that separate the incident light into a plurality of wavelength components. The light control region 13 is disposed closer to the light incident surface S1 than the color filter region 12 and controls the incident light. The light control region 13 includes a plurality of unit structures that each control the aperture range that captures the incident light.

[0048] 4A and 4B are diagrams showing a specific example of the light control region 13 according to the present disclosure, with FIG. 4A being a top view and FIG. 4B being a cross-sectional view.

[0049] The light control region 13 according to the present disclosure has a plurality of unit structures 15 periodically arranged in two dimensions. Fig. 4A shows a top view of one unit structure 15, and Fig. 4B is a cross-sectional view taken along line A-A in Fig. 4A. The unit structure 15 has a plurality of microstructures 16. The microstructures 16 do not necessarily have the same shape and size, and the spacing between two adjacent microstructures 16 is not necessarily the same. Fig. 4 shows an example in which the unit structure 15 has four microstructures 16, and a plurality of microstructures 16 are provided on the boundary region between two adjacent unit structures 15, but the number, size, and shape of the microstructures 16 included in the unit structure 15 are arbitrary.

[0050] The microstructure 16 is a columnar body having a length h extending in the light propagation direction, as shown in the cross-sectional view of FIG. 4B, for example. While FIG. 4 shows an example in which the microstructure 16 is cylindrical, it may also be rectangular. The periphery of the microstructure 16 is covered with a light-transmitting region 17 made of, for example, SiO2. Here, "transmitting" means transmitting incident light in the wavelength band required to generate a captured image. The refractive index n1 of the microstructure 16 is set to be larger than the refractive index n0 of the light-transmitting region 17. The material of the microstructure 16 is, for example, SiN.

[0051] Light incident on the microstructure 16 propagates while being confined inside the microstructure 16 due to the refractive index difference with the light-transmitting region 17. Therefore, the microstructure 16 functions as an optical waveguide for the incident light. As shown in the above-mentioned formula (4), the light propagating inside the microstructure 16 generates a phase difference (amount of phase delay) φ according to the refractive index difference with the light-transmitting region 17. The amount of phase delay φ varies depending on the wavelength λ of the light.

[0052] 4, by providing a plurality of types of microstructures 16 with different diameters, it is possible to impart different phase delay distributions to light propagating inside the microstructures 16 for different wavelength regions, thereby changing the optical wavefront. Since the propagation direction of light is determined by the optical wavefront, the microstructures 16 can focus light in different ranges for each wavelength. In this specification, the range that a unit structure 15 having the microstructures 16 can capture incident light is referred to as the aperture range.

[0053] In this embodiment, the incident light includes light in the red, green, and blue visible light wavelength bands, and the incident light propagates inside each microstructure 16 of the unit structure 15, thereby allowing the aperture range of the incident light to be controlled for each color.

[0054] The aperture range of the incident light can be controlled by adjusting, for example, at least one of the diameter of the microstructure 16, the height of the microstructure 16, the interval between two adjacent microstructures 16, or the pitch between two adjacent microstructures 16. Here, the diameter of the microstructure 16 refers to the diameter or width of the microstructure 16, as indicated by symbols d1 and d2 in FIG. 4A . The height of the microstructure 16 refers to the height of the microstructure 16 in the light propagation direction, as indicated by symbol h in FIG. 4B . The interval between two adjacent microstructures 16 refers to the shortest distance between the outer circumferential surfaces of the two microstructures 16, as indicated by symbol d3 in FIG. 4A . The pitch between two adjacent microstructures 16 refers to the distance d4 between the center positions of the two microstructures 16, as indicated by symbol d3 in FIG. 4A .

[0055] Fig. 5 is a diagram showing the relationship between the size, sensitivity, and resolution of the opening range of the unit structure 15. Fig. 5 shows a plan view, a cross-sectional view, the amount of incident light (input), the amount of received light (output), the imaged image corresponding to the incident image, sensitivity, and resolution for cases where the opening range of the unit structure 15 is small and large. The cross-sectional structure in Fig. 5 shows the cross-sectional structure of the photodetector 1 according to this embodiment.

[0056] 5, when the opening range of the unit structure 15 is small, the amount of incident light taken in is smaller than when the opening range is large, resulting in a decrease in sensitivity. However, when the opening range is small, light is taken in from a narrow range of the subject, resulting in less image blurring and improved resolution. As the opening range of the unit structure 15 increases, light can be taken in from a wider range, resulting in an increase in sensitivity, but at the same time, image blurring increases and resolution decreases.

[0057] 5 shows how an image of multiple numbers, which are the subject, is formed in an overlapping manner when the aperture range of the unit structure 15 is large, and how an image of only the numbers in the center of the subject is formed in an image when the aperture range is small. The fact that multiple numbers are formed in an overlapping manner indicates that light can be collected from a wide range, improving sensitivity but reducing resolution. On the other hand, the fact that only the center of the subject is formed in an image indicates that light can only be taken in from a narrow range, reducing sensitivity but improving resolution.

[0058] 6A and 6B are diagrams showing unit structures 15 of the light control region 13 of a photodetector 1 according to an embodiment of the present disclosure, aperture ranges of the unit structures 15, and unit pixel group regions 14 of the color filter region 12. FIGS. 6A and 6B show an example in which the unit pixel group regions 14 are in a Bayer array consisting of 2×2 pixel blocks. FIG. 6A shows red and blue aperture ranges RL, RS, BL, and BS in the unit structure 15, and FIG. 6B shows green aperture ranges GL and GS. FIGS. 6A and 6B show an example in which the red, green, and blue aperture ranges are all circular. In FIGS. 6A and 6B, the red and blue aperture ranges RL, RS, BL, and BS in the unit structure 15 are shown separately from the green aperture ranges GL and GS, but this is merely for ease of viewing.

[0059] 6A and 6B show 6 × 6 = 36 pixels 10 in the color filter region 12. The color filter region 12 has a structure in which a plurality of unit pixel group regions 14 are arranged two-dimensionally with no gaps between them. Each unit pixel group region 14 has a pixel block made up of a plurality of pixels 10 in a predetermined color array. The predetermined color array is, for example, a Bayer array. There are various variations in the color array of the unit pixel group region 14, and color arrays other than the Bayer array can also be applied. For example, the predetermined color array may be a quad array in which a plurality of pixels 10 of the same color are arranged in a Bayer array, as will be described later.

[0060] Light that has passed through each unit pixel group region 14 is incident on the photoelectric conversion region 11. The photoelectric conversion region 11 has a plurality of pixels 10 that match the division of the plurality of pixels 10 that make up each unit pixel group region 14. In this specification, the smallest unit of the photoelectric conversion region 11 and the smallest unit of each unit pixel group region 14 in the color filter region 12 are both referred to as pixels 10. In the photodetector 1 according to this embodiment, incident light that has been taken in by any of the aperture ranges in the corresponding unit structures 15 is condensed and incident on at least some of the pixels 10 in the photoelectric conversion region 11 and the color filter region 12.

[0061] 6A and 6B, nine red pixels (R) 10 and nine green pixels (B) 10 are provided, and 18 green pixels (G) 10 are provided. The unit pixel group region 14 of the color filter region 12 has a size of 2×2 pixels in a Bayer array. The unit structure 15 of the light control region 13 has a size of 4×4 pixels.

[0062] The color filter region 12 is formed by periodically arranging a plurality of unit pixel group regions 14 in a two-dimensional direction. The light control region 13 is formed by periodically arranging a plurality of unit structures 15 in a two-dimensional direction. The size of the unit structures 15 is larger than the size of the unit pixel group regions 14, and the arrangement period of the unit structures 15 in the two-dimensional direction is longer than the arrangement period of the unit pixel group regions 14.

[0063] Each of the plurality of unit structures 15 collects the incident light taken in through opening ranges of two or more different sizes for each wavelength of the incident light, and causes the light to be incident on one of the pixels 10 in the unit pixel group region 14. In this way, the unit structures 15 use each of the opening ranges of two or more different sizes to take in and collect the incident light, and cause the light to be incident on the corresponding pixel 10 in the corresponding unit pixel group region 14.

[0064] For example, the unit structure 15 has two sizes of aperture ranges (hereinafter referred to as large size and small size) for each pixel 10 of each color in the color filter region 12. Figures 6A and 6B show an example in which the unit structure 15 collects incident light captured by a large aperture range RL corresponding to the red pixel 10, a small aperture range RS corresponding to the red pixel 10, a large aperture range BL corresponding to the blue pixel 10, a small aperture range BS corresponding to the blue pixel 10, a large aperture range GL corresponding to the green pixel 10, and a small aperture range GS corresponding to the green pixel 10, and directs the collected light to the corresponding pixel 10. For example, light incident on the large red aperture range RL is incident on one red pixel 10 located in its center. Light incident on the small red aperture range RS is incident on one pixel 10 of approximately the same size as the aperture range RS. The same applies to the other colors.

[0065] A plurality of microstructures 16 are arranged in the unit structure 15. Although Figures 6A and 6B illustrate an example in which the range (aperture range) of light taken in by the plurality of microstructures 16 is circular, the shape of the aperture range is arbitrary. The diameter and pitch of each microstructure 16 are arbitrary. As shown in Figures 4 and 5, by controlling the diameter, height, number, pitch, etc. of the plurality of microstructures 16, it is possible to set aperture ranges of the sizes shown in Figures 6A and 6B for each color (wavelength).

[0066] In the examples of Figures 6A and 6B, of the 16 pixels 10 included within the range of a unit structure 15 having a size of 4 x 4 pixels, light from the large-sized opening range RL is incident on two red pixels 10, light from the small-sized opening range RS is incident on the remaining two red pixels 10, light from the large-sized opening range BL is incident on two blue pixels 10, light from the small-sized opening range BS is incident on the remaining two blue pixels 10, light from the large-sized opening range GL is incident on two green pixels 10, and light from the small-sized opening range GS is incident on the remaining two green pixels 10.

[0067] Furthermore, the remaining four green pixels 10n included within the range of the unit structure 15 are not designed to receive light from the unit structure 15, but receive a small amount of leaked light that has passed through the unit structure 15. In this way, the pixels 10n receiving the leaked light do not contribute to improving the sensitivity, but do contribute to improving the resolution.

[0068] Light that has passed through a plurality of unit pixel group regions 14 in the color filter region 12 is incident on the photoelectric conversion region 11 and undergoes photoelectric conversion. The photoelectric conversion region 11 has a plurality of pixels 10 onto which light that has passed through the corresponding unit pixel group regions 14 is incident. Incident light that has been taken in by any of the opening ranges in the corresponding unit structures 15 is condensed and incident on at least some of the pixels 10.

[0069] The plurality of pixels 10 includes, for each wavelength of incident light, at least one first pixel and at least one second pixel having higher sensitivity than the first pixel but lower resolution than the first pixel. Therefore, by combining pixel signals captured by the first pixel and the second pixel for each wavelength of incident light, it is possible to improve sensitivity and resolution.

[0070] The column signal processing circuit 4 shown in FIG. 1 or a subsequent signal processing unit not shown in FIG. 1 generates an image with improved sensitivity and resolution based on pixel signals obtained by photoelectrically converting light that has passed through each of the multiple unit pixel group regions 14 and is incident on the multiple pixels 10.

[0071] Each of the plurality of unit structures 15 collects the incident light taken in through two or more types of opening ranges that differ in at least one of size, shape, and opening direction for each wavelength of the incident light, and causes the light to be incident on a corresponding pixel position in a corresponding unit pixel group region 14. At least one of the size, shape, and opening direction of the opening range may differ for each wavelength of the incident light.

[0072] Although Figures 6A and 6B show two types of opening ranges with different sizes, the unit structure 15 may have multiple types of opening ranges that are the same size or differ in at least one of the shape or opening direction.

[0073] At least two or more of the plurality of pixels 10 corresponding to each of the plurality of unit pixel group regions 14 are incident with light that is captured and concentrated by two or more types of opening ranges that differ in at least one of the size, shape, and opening direction of the corresponding unit structures 15. The two or more types of opening ranges include an opening range that is larger than the combined size of the two or more pixels 10.

[0074] For example, each of the plurality of unit structures 15 causes first light and second light, which are captured and collected by two aperture ranges of different sizes for each wavelength of incident light, to be incident on a corresponding pixel position in the corresponding unit pixel group region 14. The first light is light which is captured and collected by a first aperture range (e.g., aperture range RL in FIG. 6A ) having a size corresponding to two or more pixels 10, and the second light is light which is captured and collected by a second aperture range (e.g., aperture range RS in FIG. 6A ) having a size smaller than the first aperture range.

[0075] 7A and 7B are diagrams showing unit structures 15, unit pixel group regions 14, and aperture ranges of unit structures 15 according to one comparative example. In this comparative example, the unit pixel group regions 14 and unit structures 15 have the same size, and multiple unit pixel group regions 14 and multiple unit structures 15 are arranged at the same interval in the two-dimensional direction. In this comparative example, the sizes of the aperture ranges RA, BA, and GA for each color are all the same, and the sensitivity and resolution of all pixels 10 are fixed.

[0076] Therefore, the sensitivity and resolution are determined by the sizes of the opening ranges RA, BA, and GA. Therefore, if the sizes of the opening ranges RA, BA, and GA are increased, the sensitivity increases but the resolution decreases. Conversely, if the sizes of the opening ranges RA, BA, and GA are decreased, the resolution increases but the sensitivity decreases.

[0077] As described above, in the unit structure 15 according to the comparative example, it is not possible to increase both the sensitivity and the resolution, and therefore it is difficult to expand the dynamic range.

[0078] 8 is a diagram illustrating the size of the opening range GL of the unit structure 15 according to this embodiment. In Fig. 8, the lengths of the pixel 10 in the first direction (horizontal direction) and the second direction (vertical direction) are respectively defined as x and y, the distances in the first direction and the second direction between two adjacent pixels 10 of the same color are respectively defined as X and Y, and the lengths in the first direction and the second direction of the opening range are respectively defined as a and b.

[0079] In order to make the opening range GL as large as possible while preventing the two opening ranges GL corresponding to two adjacent pixels 10 of the same color from overlapping, the relationship between the following equations (5) and (6) must be satisfied.

[0080] x<a<2X-x (5) y<b<2Y-y (6) In this way, by setting the sizes a and b of the aperture range GL so as to satisfy both equations (5) and (6), it is possible to improve the sensitivity and resolution.

[0081] In the above description, an example in which each opening area of ​​the unit structure 15 in this embodiment is circular has been described. However, the shape of each opening area is not necessarily limited to a circle. FIGS. 9A and 9B are diagrams showing a unit structure 15, a unit pixel group region 14, and opening areas of the unit structure 15 according to a modified example of this embodiment. FIGS. 9A and 9B show an example in which the opening areas RA, GA, and BA of the unit structure 15 are elliptical. FIG. 9A also shows an example in which all opening areas RA and BA provided in the unit structure 15 are the same size, and each pixel 10 of each color has two types of elliptical opening areas RA and BA with different opening directions. For example, the unit structure 15 has four opening areas RA that allow light to enter the red pixel 10, two of which are elliptical with their long sides aligned in a first direction (horizontal direction), and the remaining two are elliptical with their long sides aligned in a second direction (vertical direction). The same applies to the other colors.

[0082] In this way, the multiple opening areas RA, BA provided in the unit structure 15 do not necessarily have two or more different sizes. Fig. 9A shows an example in which the unit structure 15 has two or more different opening areas RA, GA, BA that are the same size but have different opening directions. In this case, the sensitivity or resolution in a specific opening direction can be improved.

[0083] 9B shows an example in which there are two different sizes of elliptical or circular opening areas GL and GS. Three large opening areas GL are provided, two of which have opening directions that differ by 90 degrees from the remaining one. Four small opening areas GS are provided.

[0084] In the above description, an example was shown in which the unit pixel group region 14 in the color filter region 12 is in a Bayer array, but the unit pixel group region 14 may be in a pixel array other than the Bayer array. FIGS. 10A and 10B show an example in which the unit pixel group region 14 in the color filter region 12 is in a quad array. A quad array has an arrangement in which each of the four pixels 10 constituting the Bayer array is replaced with 2 × 2 = 4 pixels 10 of the same color. The unit pixel group region 14 of the quad array shown in FIGS. 10A and 10B has 4 × 4 = 16 pixels. Hereinafter, multiple adjacent pixels 10 of the same color are referred to as a pixel block IB. Alternatively, the pixel array of the color filter region 12 may be an octa array or a nona array.

[0085] 10A and 10B , the unit structures 15 corresponding to the unit pixel group regions 14 have two different sizes (hereinafter referred to as large and small) of aperture ranges RL, RS, GL, GS, BL, and BS for each color. For example, for each of red, green, and blue, there are two large aperture ranges RL, GL, and BL and one small aperture range RS, GS, and BS. In FIG. 10A , light incident on the large red aperture range RL is incident on the red unit pixel group region (pixel block) 14, which includes 2×2=4 pixels 10 located in its center. Light incident on the small red aperture range is incident on the unit pixel group region (pixel block) 14B, which includes 2×2=4 pixels 10 of approximately the same size as the aperture range. The same applies to the other colors.

[0086] In the example of Figures 10A and 10B, of the 64 pixels included within the range of a unit structure 15 having a size of 8 x 8 pixels 10, light from the large-sized opening range RL is incident on two red unit pixel group regions 14, light from the small-sized opening range RS is incident on the remaining two red unit pixel group regions 14, light from the large-sized opening range BL is incident on two blue unit pixel group regions 14, light from the small-sized opening range BS is incident on the remaining two blue unit pixel group regions 14, light from the large-sized opening range GL is incident on two green unit pixel group regions 14, and light from the small-sized opening range GS is incident on the remaining two green unit pixel group regions 14.

[0087] Furthermore, the remaining four green unit pixel group regions 14 included within the range of the unit structure 15 are not designed to receive light from the unit structure 15, but receive a small amount of leaked light that has passed through the unit structure 15. In this way, the pixel blocks IB into which the leaked light is incident do not contribute to improving the sensitivity, but do contribute to improving the resolution.

[0088] As described above, in this embodiment, the light control region 13 is disposed closer to the light incident surface S1 than the color filter region 12, and the size of the unit structures 15 in the light control region 13 is made larger than the size of the unit pixel group region 14 in the color filter region 12. This allows the aperture range of the unit structures 15 to be wider, and allows incident light taken in through the aperture range of the unit structures 15 to be condensed and incident on the corresponding pixel 10 in the unit pixel group region 14. Furthermore, by providing the unit structures 15 with a plurality of types of aperture ranges having different sizes, it is possible to improve the sensitivity to incident light taken in through larger aperture ranges and improve the resolution to incident light taken in through smaller aperture ranges, thereby improving both the sensitivity and resolution of the photodetector 1. Since the unit structures 15 have a plurality of microstructures 16, the aperture range of incident light can be arbitrarily controlled by controlling, for example, at least one of the diameter of the microstructures 16, the height of the microstructures 16, the spacing between two adjacent microstructures 16, or the pitch between two adjacent microstructures 16.

[0089] <Application to a Mobile Body> The technology according to the present disclosure (the present technology) can be applied to various products. For example, the technology according to the present disclosure may be realized as a device mounted on any type of mobile body, such as an automobile, an electric vehicle, a hybrid electric vehicle, a motorcycle, a bicycle, personal mobility, an airplane, a drone, a ship, or a robot.

[0090] FIG. 11 is a block diagram showing a schematic configuration example of a vehicle control system, which is an example of a mobile object control system to which the technology according to the present disclosure can be applied.

[0091] The vehicle control system 12000 includes a plurality of electronic control units connected via a communication network 12001. In the example shown in Fig. 11, the vehicle control system 12000 includes a drive system control unit 12010, a body system control unit 12020, an outside-vehicle information detection unit 12030, an inside-vehicle information detection unit 12040, and an integrated control unit 12050. Also shown as functional components of the integrated control unit 12050 are a microcomputer 12051, an audio / video output unit 12052, and an in-vehicle network I / F (Interface) 12053.

[0092] The drivetrain control unit 12010 controls the operation of devices related to the drivetrain of the vehicle in accordance with various programs. For example, the drivetrain control unit 12010 functions as a control device for a drive force generating device for generating a drive force of the vehicle, such as an internal combustion engine or a drive motor, a drive force transmission mechanism for transmitting the drive force to the wheels, a steering mechanism for adjusting the steering angle of the vehicle, and a braking device for generating a braking force of the vehicle.

[0093] The body system control unit 12020 controls the operation of various devices equipped in the vehicle body according to various programs. For example, the body system control unit 12020 functions as a control device for a keyless entry system, a smart key system, a power window device, or various lamps such as headlamps, backup lamps, brake lamps, turn signals, and fog lamps. In this case, radio waves transmitted from a portable device that serves as a key or signals from various switches can be input to the body system control unit 12020. The body system control unit 12020 receives these radio waves or signals and controls the vehicle's door lock device, power window device, lamps, etc.

[0094] The outside-vehicle information detection unit 12030 detects information outside the vehicle equipped with the vehicle control system 12000. For example, an imaging unit 12031 is connected to the outside-vehicle information detection unit 12030. The outside-vehicle information detection unit 12030 causes the imaging unit 12031 to capture images outside the vehicle and receives the captured images. The outside-vehicle information detection unit 12030 may perform object detection processing or distance detection processing for people, cars, obstacles, signs, characters on the road surface, etc. based on the received images.

[0095] The imaging unit 12031 is an optical sensor that receives light and outputs an electrical signal corresponding to the amount of light received. The imaging unit 12031 can output the electrical signal as an image or as distance measurement information. The light received by the imaging unit 12031 may be visible light or invisible light such as infrared light.

[0096] The in-vehicle information detection unit 12040 detects information inside the vehicle. For example, a driver state detection unit 12041 that detects the state of the driver is connected to the in-vehicle information detection unit 12040. The driver state detection unit 12041 includes, for example, a camera that captures an image of the driver, and the in-vehicle information detection unit 12040 may calculate the degree of fatigue or concentration of the driver based on the detection information input from the driver state detection unit 12041, or may determine whether the driver is dozing off.

[0097] The microcomputer 12051 can calculate control target values ​​for the driving force generating device, steering mechanism, or braking device based on the information inside and outside the vehicle acquired by the outside-vehicle information detection unit 12030 or the inside-vehicle information detection unit 12040, and output control commands to the drive system control unit 12010. For example, the microcomputer 12051 can perform cooperative control aimed at realizing the functions of an ADAS (Advanced Driver Assistance System), including vehicle collision avoidance or impact mitigation, following driving based on the distance between vehicles, maintaining vehicle speed, vehicle collision warning, vehicle lane departure warning, etc.

[0098] In addition, the microcomputer 12051 can perform cooperative control for the purpose of autonomous driving, which allows the vehicle to travel autonomously without relying on driver operation, by controlling the driving force generating device, steering mechanism, braking device, etc. based on information about the surroundings of the vehicle obtained by the outside vehicle information detection unit 12030 or the inside vehicle information detection unit 12040.

[0099] Furthermore, the microcomputer 12051 can output a control command to the body system control unit 12020 based on the information outside the vehicle acquired by the outside information detection unit 12030. For example, the microcomputer 12051 can control the headlamps according to the position of a preceding vehicle or an oncoming vehicle detected by the outside information detection unit 12030, and perform cooperative control aimed at preventing glare, such as switching from high beams to low beams.

[0100] The audio / video output unit 12052 transmits at least one of audio and video output signals to an output device capable of visually or audibly notifying the passengers of the vehicle or the outside of the vehicle of information. In the example of Fig. 11, the output devices are exemplified by an audio speaker 12061, a display unit 12062, and an instrument panel 12063. The display unit 12062 may include, for example, at least one of an on-board display and a head-up display.

[0101] FIG. 12 is a diagram showing an example of the installation position of the imaging unit 12031.

[0102] In FIG. 12, the imaging unit 12031 includes imaging units 12101, 12102, 12103, 12104, and 12105.

[0103] The imaging units 12101, 12102, 12103, 12104, and 12105 are provided, for example, at positions such as the front nose, side mirrors, rear bumper, back door, and the top of the windshield inside the vehicle cabin of the vehicle 12100. The imaging unit 12101 provided on the front nose and the imaging unit 12105 provided on the top of the windshield inside the vehicle cabin mainly acquire images of the front of the vehicle 12100. The imaging units 12102 and 12103 provided on the side mirrors mainly acquire images of the sides of the vehicle 12100. The imaging unit 12104 provided on the rear bumper or back door mainly acquires images of the rear of the vehicle 12100. The imaging unit 12105 provided on the top of the windshield inside the vehicle cabin is mainly used to detect preceding vehicles, pedestrians, obstacles, traffic lights, traffic signs, lanes, etc.

[0104] 12 shows an example of the imaging ranges of the imaging units 12101 to 12104. Imaging range 12111 indicates the imaging range of the imaging unit 12101 provided on the front nose, imaging ranges 12112 and 12113 indicate the imaging ranges of the imaging units 12102 and 12103 provided on the side mirrors, respectively, and imaging range 12114 indicates the imaging range of the imaging unit 12104 provided on the rear bumper or back door. For example, by overlaying the image data captured by the imaging units 12101 to 12104, an overhead image of the vehicle 12100 viewed from above can be obtained.

[0105] At least one of the image capturing units 12101 to 12104 may have a function of acquiring distance information. For example, at least one of the image capturing units 12101 to 12104 may be a stereo camera made up of multiple image capturing elements, or may be an image capturing element having pixels for phase difference detection.

[0106] For example, based on the distance information obtained from the imaging units 12101 to 12104, the microcomputer 12051 can calculate the distance to each three-dimensional object within the imaging ranges 12111 to 12114 and the change in this distance over time (relative speed with respect to the vehicle 12100), thereby extracting as a preceding vehicle, in particular, the three-dimensional object that is the closest three-dimensional object on the path of the vehicle 12100 and traveling in approximately the same direction as the vehicle 12100 at a predetermined speed (e.g., 0 km / h or higher). Furthermore, the microcomputer 12051 can set a vehicle-to-vehicle distance to be maintained in advance in front of the preceding vehicle, and perform automatic braking control (including follow-up stop control), automatic acceleration control (including follow-up start control), etc. In this way, cooperative control can be performed for the purpose of autonomous driving, which allows the vehicle to travel autonomously without relying on driver operation.

[0107] For example, the microcomputer 12051 classifies and extracts three-dimensional object data regarding three-dimensional objects into two-wheeled vehicles, ordinary vehicles, large vehicles, pedestrians, utility poles, and other three-dimensional objects based on distance information obtained from the imaging units 12101 to 12104, and can use the data for automatic obstacle avoidance. For example, the microcomputer 12051 distinguishes obstacles around the vehicle 12100 into obstacles that are visible to the driver of the vehicle 12100 and obstacles that are difficult to see. The microcomputer 12051 then determines a collision risk that indicates the risk of collision with each obstacle, and when the collision risk is equal to or greater than a set value and a collision is possible, the microcomputer 12051 can provide driving assistance for collision avoidance by outputting an alarm to the driver via the audio speaker 12061 or the display unit 12062, or by performing forced deceleration or avoidance steering via the drive system control unit 12010.

[0108] At least one of the image capturing units 12101 to 12104 may be an infrared camera that detects infrared rays. For example, the microcomputer 12051 can recognize a pedestrian by determining whether a pedestrian is present in the images captured by the image capturing units 12101 to 12104. Such pedestrian recognition is performed, for example, by extracting feature points from the images captured by the image capturing units 12101 to 12104 as infrared cameras and performing pattern matching on a series of feature points that indicate the outline of an object to determine whether the object is a pedestrian. When the microcomputer 12051 determines that a pedestrian is present in the images captured by the image capturing units 12101 to 12104 and recognizes the pedestrian, the audio / image output unit 12052 controls the display unit 12062 to superimpose a rectangular outline on the recognized pedestrian for emphasis. The audio / image output unit 12052 may also control the display unit 12062 to display an icon or the like indicating the pedestrian at a desired position.

[0109] The present technology may have the following configuration: (1) A photodetector including: a photoelectric conversion region having a photoelectric conversion unit for each pixel; a color filter region arranged closer to a light incident surface than the photoelectric conversion region, the color filter region having a plurality of unit pixel group regions that separates incident light into a plurality of wavelength components; and a light control region arranged closer to the light incident surface than the color filter region and controlling the incident light, wherein the light control region has a plurality of unit structures that respectively control an aperture range that takes in incident light, each of the plurality of unit structures having a plurality of microstructures, and the size of the unit structures is larger than the size of the unit pixel group region. (2) The photodetector according to (1), wherein the plurality of unit pixel group regions are periodically arranged in a two-dimensional direction, the plurality of unit structures are periodically arranged in the two-dimensional direction, and the arrangement period of the unit structures in the two-dimensional direction is longer than the arrangement period of the unit pixel group regions. (3) The photodetector according to (1) or (2), wherein each of the plurality of unit structures condenses incident light taken in through the aperture ranges of two or more different sizes for each wavelength of the incident light and causes the light to enter the unit pixel group region. (4) The photodetector according to (3), wherein light that has passed through the plurality of unit pixel group regions in the color filter region is incident on the photoelectric conversion region and undergoes photoelectric conversion, the photoelectric conversion region has a plurality of pixels onto which light that has passed through the corresponding unit pixel group region is incident, and incident light taken in through any of the aperture ranges in the corresponding unit structure is condensed and incident on at least some of the plurality of pixels. (5) The photodetector according to (4), wherein the plurality of pixels include, for each wavelength of the incident light, at least one first pixel and at least one second pixel having higher sensitivity than the first pixel and lower resolution than the first pixel. (6) The photodetector according to (4) or (5), further comprising a signal processing unit that generates an image with improved sensitivity and resolution based on pixel signals obtained by photoelectrically converting light that has passed through each of the plurality of unit pixel group regions and is incident on the plurality of pixels.(7) A photodetector device according to any one of (4) to (6), wherein each of the plurality of unit structures focuses incident light captured through two or more types of opening ranges that differ in at least one of size, shape, or opening direction for each wavelength of the incident light, and directs the light to a corresponding pixel position in the corresponding unit pixel group region. (8) The photodetector according to any one of (4) to (6), wherein light that is captured and collected by two or more types of aperture ranges that differ in at least one of the size, shape, or opening direction of the corresponding unit structures is incident on at least two or more pixels among the plurality of pixels corresponding to each of the plurality of unit pixel group regions. (9) The photodetector according to (7) or (8), wherein the two or more types of aperture ranges include an aperture range that is larger than the combined size of two or more of the pixels. (10) The photodetector according to (9), wherein each of the plurality of unit structures causes, for each wavelength of incident light, first light and second light that are captured and collected by two aperture ranges that are different in size to be incident on a corresponding pixel position of the corresponding unit pixel group region. (11) The photodetector according to (10), wherein the first light is light that is captured and collected by a first aperture range that is the size of two or more of the pixels, and the second light is light that is captured and collected by a second aperture range that is smaller in size than the first aperture range. (12) The photodetector according to (11), wherein the first opening range and the second opening range are circular. (13) The photodetector according to (7) or (8), wherein the two or more types of opening ranges include two or more opening ranges having different opening directions. (14) The photodetector according to (13), wherein each of the plurality of unit structures causes first light and second light that are captured and concentrated by two of the opening ranges having different opening directions for each wavelength of incident light to be incident on corresponding pixel positions in the corresponding unit pixel group region. (15) The photodetector according to (14), wherein the two opening ranges are elliptical in shape with long and short sides facing different directions but of the same size.(16) The photodetector according to any one of (1) to (15), wherein each of the plurality of unit structures causes light incident on the circular or elliptical aperture range having a length a in a first direction and a length b in a second direction orthogonal to the first direction to be incident on one of the pixels in the photoelectric conversion region, and the one pixel has a length x in the first direction and a length y in the second direction, and where the spacing in the first direction between two adjacent pixels of the same color is X and the spacing in the second direction is Y, the light control region sets the sizes of a and b to satisfy the following formulas (1) and (2): x<a<2X-x (1) y<b<2Y-y (2) (17) The photodetector according to any one of (1) to (16), wherein at least one pixel among the plurality of pixels onto which light that has transmitted through the unit pixel group region is incident is designed so that light taken in by the aperture range of the unit structure corresponding to the unit pixel group region is not incident. (18) The optical detection device described in any one of (1) to (17), wherein the aperture range of each of the plurality of unit structures is controlled by controlling at least one of the diameter of the microstructure, the height of the microstructure, the spacing between two adjacent microstructures, or the pitch between two adjacent microstructures. (19) The optical detection device described in any one of (1) to (18), wherein each of the plurality of unit pixel group regions is a pixel block in which pixels of a plurality of colors are arranged in a predetermined array. (20) The optical detection device described in any one of (1) to (19), wherein the predetermined array is a Bayer array or a quad array.

[0110] The aspects of the present disclosure are not limited to the individual embodiments described above, but include various modifications that may be conceived by those skilled in the art, and the effects of the present disclosure are not limited to the above-described contents. In other words, various additions, modifications, and partial deletions are possible within the scope of the conceptual idea and spirit of the present disclosure, which is derived from the contents defined in the claims and their equivalents.

[0111] REFERENCE SIGNS LIST 1 Photodetector device, 2 Pixel array section, 3 Vertical drive circuit, 4 Column signal processing circuit, 5 Horizontal drive circuit, 6 Output circuit, 7 Control circuit, 10 Pixel, 11 Photoelectric conversion region, 12 Color filter region, 13 Light control region, 14 Unit pixel group region, 15 Unit structure, 16 Microstructure, 17 Light transmission region

Claims

1. A photodetection device comprising: a photoelectric conversion region having a photoelectric conversion unit for each pixel; a color filter region arranged closer to the light incident surface than the photoelectric conversion region and having a plurality of unit pixel group regions that disperse a plurality of wavelength components contained in the incident light; and a light control region arranged closer to the light incident surface than the color filter region and controlling the incident light, wherein the light control region has a plurality of unit structures each controlling an opening range that captures the incident light, each of the plurality of unit structures having a plurality of microscopic structures, and a size of the unit structures is larger than a size of the unit pixel group region.

2. The photodetection device of claim 1, wherein the plurality of unit pixel group regions are periodically arranged in a two-dimensional direction, the plurality of unit structures are periodically arranged in the two-dimensional direction, and the arrangement period of the unit structures in the two-dimensional direction is longer than the arrangement period of the unit pixel group regions.

3. The photodetection device according to claim 1, wherein each of the plurality of unit structures focuses incident light captured through the aperture ranges of two or more different sizes depending on the wavelength of the incident light, and causes the light to enter the unit pixel group region.

4. The photodetection device described in claim 3, wherein light that has passed through the plurality of unit pixel group regions in the color filter region is incident on the photoelectric conversion region and photoelectrically converted, the photoelectric conversion region has a plurality of pixels onto which light that has passed through a corresponding one of the unit pixel group regions is incident, and incident light captured in any one of the opening ranges in the corresponding unit structure is concentrated and incident on at least some of the plurality of pixels.

5. The light detection device according to claim 4, wherein the plurality of pixels include, for each wavelength of incident light, at least one first pixel and at least one second pixel having a higher sensitivity than the first pixel and a lower resolution than the first pixel.

6. The photodetection device according to claim 4, further comprising a signal processing unit that generates an image with improved sensitivity and resolution based on pixel signals obtained by photoelectrically converting light that has passed through each of the plurality of unit pixel group regions and is incident on the plurality of pixels.

7. The optical detection device according to claim 4, wherein each of the plurality of unit structures focuses incident light captured through two or more types of aperture ranges that differ in at least one of size, shape, and aperture direction for each wavelength of the incident light, and directs the focused light to be incident on a corresponding pixel position in the corresponding unit pixel group region.

8. The optical detection device of claim 4, wherein at least two of the plurality of pixels corresponding to each of the plurality of unit pixel group regions receive light that is captured and concentrated by two or more types of the opening ranges that differ in at least one of the size, shape, and opening direction of the corresponding unit structure.

9. The photodetection device according to claim 7, wherein the two or more types of aperture ranges include an aperture range having a size larger than a combined size of two or more of the pixels.

10. The optical detection device according to claim 9, wherein each of the plurality of unit structures causes a first light and a second light that are captured and focused by two opening ranges having different sizes for each wavelength of incident light to be incident on a corresponding pixel position in the corresponding unit pixel group region.

11. The optical detection device described in claim 10, wherein the first light is light captured and focused by a first aperture range having a size equal to or larger than two of the pixels, and the second light is light captured and focused by a second aperture range having a size smaller than the first aperture range.

12. The optical detection device according to claim 11, wherein the first opening area and the second opening area are circular.

13. The optical detection device according to claim 7, wherein the two or more types of opening ranges include two or more opening ranges each having a different opening direction.

14. The optical detection device described in claim 13, wherein each of the plurality of unit structures causes a first light and a second light that are captured and focused in two of the opening ranges, each having a different opening direction, for each wavelength of incident light to be incident on a corresponding pixel position in the corresponding unit pixel group region.

15. The optical detection device according to claim 14, wherein the two opening ranges are elliptical in shape with their long and short sides oriented in different directions and the same size.

16. The photodetector according to claim 1, wherein each of the plurality of unit structures causes light incident on the circular or elliptical opening range having a length a in a first direction and a length b in a second direction perpendicular to the first direction to be incident on one of the pixels in the photoelectric conversion region, and the one pixel has a length x in the first direction and a length y in the second direction, and when the interval in the first direction between two adjacent pixels of the same color is X and the interval in the second direction is Y, the light control region sets the sizes of a and b so as to satisfy the following formulas (1) and (2): x<a<2X-x ... (1) y<b<2Y-y ... (2) 17. The photodetection device according to claim 1, wherein at least one pixel among a plurality of pixels onto which light that has passed through the unit pixel group region is incident is designed so that light captured through the opening range of the unit structure corresponding to the unit pixel group region is not incident thereon.

18. The optical detection device according to claim 1, wherein each of the plurality of unit structures controls the aperture range by controlling at least one of the diameter of the microstructure, the height of the microstructure, the distance between two adjacent microstructures, or the pitch of two adjacent microstructures.

19. The photodetection device according to claim 1, wherein each of the plurality of unit pixel group regions is a pixel block in which pixels of a plurality of colors are arranged in a predetermined array.

20. The optical detection device according to claim 19, wherein the predetermined array is a Bayer array or a quad array.

Images