Light detection device

Abstract

[Problem] To expand the dynamic range by improving sensitivity and resolution. [Solution] This light detection device is provided with: a photoelectric conversion region having photoelectric conversion units for each pixel; a color filter region disposed on a side closer to a light incident surface than the photoelectric conversion region, and having a plurality of unit pixel group regions separating a plurality of wavelength components included in incident light; and a light control region disposed closer to the light incident surface than the color filter region, and controlling the incident light. The light control region has a plurality of unit structures each controlling an opening range for capturing the incident light. Each of the plurality of unit structures has a plurality of microstructures. The size of the unit structure is larger than the size of the unit pixel group region.

Description

Technical Field

[0001] This disclosure relates to a light detection device. Background Technology

[0002] Super-optical elements, including those with nanostructures, can achieve a variety of optical effects that are impossible with existing optical elements. In addition, they can make the external dimensions much smaller than those of existing optical elements.

[0003] For example, Patent Document 1 discloses a super optical element in which nanostructures are arranged on multiple layers to adjust the refractive index and distribution of each layer, and to achieve a phase delay distribution with almost no discontinuities. List of cited references Patent documents

[0004] Patent Document 1: Japanese Patent Application Publication No. 2021-140152 Summary of the Invention The problem the invention aims to solve

[0005] Super-optical elements are constructed by periodically arranging unit structures, each comprising a nanostructure, in a two-dimensional direction. By arranging the super-optical elements on the light-incident side of a color filter, light focused by the super-optical elements can be incident on the color filter. The color filter comprises multiple unit pixel groups arranged in a two-dimensional direction, and each unit pixel group region includes, for example, multiple pixels in a Bayer array. By setting the period of the unit structures of the super-optical elements to be the same as the period of the unit pixel group regions of the color filter, light transmitted through the unit structures can be incident on the corresponding unit pixel group regions of the color filter. Since the unit structures can focus light over a wider range than the size of the individual pixels included in the unit pixel group regions, the quantum efficiency Qe of each pixel can be improved.

[0006] However, if the period of a unit structure of a super-optical element is made the same as the period of a unit pixel group region of a color filter, the sensitivity and resolution of each pixel are fixed, and the various optical effects that the super-optical element can achieve cannot be fully utilized. Typically, to improve sensitivity, light from a wider range needs to be converged. If the light aperture range of each pixel widens, the resolution decreases. Conversely, if the light aperture range narrows, although the resolution increases, the sensitivity decreases. In this way, there is a trade-off between sensitivity and resolution.

[0007] Therefore, this disclosure provides a light detection device that can improve sensitivity and resolution and expand dynamic range. Solution to the problem

[0008] To address the aforementioned problems, according to this disclosure, a light detection device is provided, the light detection device comprising: The photoelectric conversion region includes photoelectric conversion units for each pixel; A color filter region, located closer to the light incident surface than the photoelectric conversion region, and including multiple unit pixel groups that split the multiple wavelength components included in the incident light; and A light control region, which is located closer to the light incident surface than the color filter region, is configured to control the incident light, wherein... The light control region includes multiple unit structures that each control the aperture range used to capture incident light. Each of the plurality of unit structures includes a plurality of microstructures, and The size of each unit structure is larger than the size of each unit pixel group region.

[0009] The multiple unit pixel group regions can be arranged periodically in a two-dimensional direction. The multiple unit structures can be arranged periodically in a two-dimensional direction, and The arrangement period of the unit structure in the two-dimensional direction can be longer than the arrangement period of the unit pixel group region.

[0010] For each wavelength of incident light, each of the plurality of unit structures can converge the incident light captured in two or more types of opening ranges of different sizes, and cause the incident light to be incident on the unit pixel group region.

[0011] Light passing through the plurality of unit pixel groups in the color filter region can be incident on the photoelectric conversion region and undergo photoelectric conversion. The photoelectric conversion region may include multiple pixels, and light passing through the corresponding unit pixel group region is incident on the multiple pixels, and Incident light captured in any of the opening ranges of the respective unit structures can be converged and incident on at least some of the plurality of pixels.

[0012] For each wavelength of incident light, the plurality of pixels may include at least one first pixel and at least one second pixel, the second pixel having higher sensitivity and lower resolution than the first pixel.

[0013] A signal processing unit may be provided, which is configured to generate an image with improved sensitivity and resolution based on pixel signals obtained by photoelectric conversion of light passing through each of the plurality of unit pixel group regions and incident on the plurality of pixels.

[0014] For each wavelength of incident light, each of the plurality of unit structures can converge incident light captured in two or more types of opening ranges that are different in at least one of the sizes, shapes or opening directions, and each of the plurality of unit structures can cause the incident light to be incident on a corresponding pixel position in the corresponding unit pixel group region.

[0015] Converging light is incident on at least two of the plurality of pixels corresponding to each of the plurality of unit pixel group regions, and the light is captured in the opening range of at least two different types of the corresponding unit structures in the unit structure, in terms of size, shape, or opening direction.

[0016] The opening range of the two or more types may include an opening range with a size greater than the combined size of two or more of the pixels.

[0017] For each wavelength of incident light, each of the plurality of unit structures causes the converging first and second light to be incident on the corresponding pixel position of the corresponding unit pixel group region of the unit pixel group region, capturing the first and second light in two opening ranges of different sizes.

[0018] The first light can be light that is captured and converged within a first opening area having a size of two or more of the aforementioned pixels, and The second light can be light that is captured and converged in a second opening range that is smaller in size than the first opening range.

[0019] The first opening range and the second opening range may have a circular shape.

[0020] The two or more types of opening ranges may include two or more opening ranges with different opening directions.

[0021] For each wavelength of incident light, each of the plurality of unit structures causes the converging first and second light to be incident on the corresponding pixel position of the corresponding unit pixel group region of the unit pixel group region, capturing the first and second light in two aperture ranges with different aperture directions.

[0022] The two openings can be elliptical in shape, with the long and short sides having different orientations and equal dimensions.

[0023] Each of the plurality of unit structures allows light to be incident on one of the pixels in the photoelectric conversion region, the light being incident on an opening having a circular or elliptical shape and a length of 'a' in a first direction and a length of 'b' in a second direction orthogonal to the first direction. The pixel can have a length of x in the first direction and a length of y in the second direction, and If the interval between two adjacent pixels of the same color in the first direction is defined as X and the interval in the second direction is defined as Y, In the light control region, the dimensions of a and b can be set to satisfy the following formulas (1) and (2).

[0024] x < a < 2X - x ...(1) y < b < 2Y - y ...(2)

[0025] At least one of a plurality of pixels on which light passing through a unit pixel group region is incident can be designed such that light not incident on the opening range in the unit structure corresponding to the unit pixel group region is not captured.

[0026] Each of the plurality of unit structures can control the opening range by controlling at least one of the diameter of each microstructure, the height of each microstructure, the interval between two adjacent microstructures, or the spacing between two adjacent microstructures.

[0027] Each of the multiple unit pixel group regions can be a pixel block of pixels of various colors arranged in a predetermined array.

[0028] The predetermined array can be a Bayer array or a quaternion array. Attached Figure Description

[0029] Figure 1 This is a block diagram illustrating a schematic construction of a light detection device according to an embodiment of the present disclosure. Figure 2 It is a diagram used to illustrate the principles of microstructure. Figure 3 This is a cross-sectional view of the main parts of the optical detection device according to this embodiment. Figure 4 This is a diagram illustrating a specific example of a light control region according to the present disclosure, wherein Figure 4 A is the top view, and Figure 4 B is a cross-sectional view. Figure 5 It is a graph showing the relationship between the size of the opening range of a unit structure, sensitivity, and resolution. Figure 6A This is a diagram showing the range of red and blue openings in the unit structure of this embodiment. Figure 6B This is a diagram showing the extent of the green opening in the unit structure of this embodiment. Figure 7A This is a diagram showing the range of red and blue openings in a unit structure of a comparative example. Figure 7B This is a diagram showing the extent of the green opening in the unit structure of the comparative example. Figure 8 This is a diagram used to illustrate the dimensions of the opening range of the unit structure according to this embodiment. Figure 9A This is a diagram illustrating an example of a unit structure comprising two or more types of openings of the same size but with different opening directions. Figure 9B This is a diagram showing examples of two types of elliptical or circular opening ranges with different sizes. Figure 10A This is a diagram showing the range of red and blue openings in the unit structure of a quaternion array. Figure 10B This is a diagram showing the extent of the green openings in the unit structure of a quaternion array. Figure 11 This is a block diagram illustrating an example of a schematic construction of a vehicle control system. Figure 12 This is an explanatory diagram showing an example of the installation location of the vehicle exterior information detection unit and the camera unit. Detailed Implementation

[0030] The following description, with reference to the accompanying drawings, will illustrate an embodiment of the optical detection device. The main components of the optical detection device will be described below; however, the optical detection device may have components and functions not shown or described. The following description is not intended to exclude components and functions not shown or described.

[0031] Figure 1 This is a block diagram illustrating a schematic construction of the light detection device 1 according to an embodiment of the present disclosure. Assuming... Figure 1 The light detection device 1 images incident light in the visible light band, but it can also image infrared light.

[0032] Figure 1 The light detection device 1 includes a pixel array unit 2, a vertical driving circuit 3, a column signal processing circuit 4, a horizontal driving circuit 5, an output circuit 6, and a control circuit 7.

[0033] The pixel array unit 2 includes a plurality of pixels 10 arranged in the row and column directions, a plurality of signal lines L1 extending in the column direction, and a plurality of row selection lines L2 extending in the row direction. Although Figure 1Although not shown, pixel 10 includes a photoelectric conversion unit and a readout circuit, which reads the pixel signal corresponding to the photoelectric conversion charge to signal line L1. Pixel array unit 2 is a stack obtained by stacking a photoelectric conversion region in which photoelectric conversion units are arranged in a two-dimensional direction and a readout circuit region in which readout circuits are arranged in a two-dimensional direction.

[0034] The vertical drive circuit 3 drives multiple row selection lines L2. Specifically, the vertical drive circuit 3 supplies drive signals to the multiple row selection lines L2 sequentially, row by row, so as to select each row selection line L2 sequentially.

[0035] Multiple signal lines L1 extending in the column direction are connected to the column signal processing circuit 4. The column signal processing circuit 4 performs analog-to-digital (AD) conversion on multiple pixel signals supplied via the multiple signal lines L1. More specifically, the column signal processing circuit 4 compares the pixel signal on each signal line L1 with a reference signal and generates a digital pixel signal based on the time until the signal levels of the pixel signal and the reference signal match. The column signal processing circuit 4 sequentially generates a digital pixel signal (P-phase signal) at the reset level of the floating diffusion layer of pixel 10 and a digital pixel signal (D-phase signal) at the pixel signal level, and performs correlated double sampling (CDS).

[0036] The horizontal drive circuit 5 controls the timing of transmitting the output signal of the column signal processing circuit 4 to the output circuit 6.

[0037] Control circuit 7 controls vertical drive circuit 3, column signal processing circuit 4, and horizontal drive circuit 5. Control circuit 7 generates the reference signal used by column signal processing circuit 4 for AD conversion.

[0038] Figure 1 The light detection device 1 can be constructed by stacking a first substrate with pixel array units 2 and the like on it using Cu-Cu connections, bumps, through holes, etc., and a second substrate with vertical driving circuit 3, column signal processing circuit 4, horizontal driving circuit 5, output circuit 6 and control circuit 7 arranged on it.

[0039] The photodiodes (PDs) of each pixel 10 in pixel array unit 2 are arranged in the photoelectric conversion region. Although Figure 1 Not shown, but the light detection device 1 according to this embodiment includes a light control region arranged on a side closer to the light incident surface than the photoelectric conversion region. The light control region disperses the incident light according to the wavelength. The light control region includes, for example, microstructures for each pixel 10.

[0040] Figure 2 It is a diagram used to illustrate the principles of microstructure, and Figure 2An example is shown where regions A and B of transmitted light are adjacent to each other. Regions A and B have a length L in the direction of light propagation. The refractive index of region B is n0. In contrast, a portion of region A (L - L1) has a refractive index n0, and the remainder of L1 has a refractive index n1.

[0041] Figure 2 The optical path length dA in region A and the optical path length dB in region B are represented by the following formulas (1) and (2), respectively.

[0042] dA = n0 × (L - L1) + n1 × L1 (1) dB = n0 × L (2) Therefore, the optical path length difference Δd between region A and region B is represented by the following formula (3).

[0043] Δd = dB – dA = L1(n0 – n1) (3) Furthermore, the phase difference φ between region A and region B is represented by the following formula (4).

[0044] φ = 2πL1(n0 - n1) / λ (4) As shown in formula (4), the light propagating through regions A and B has a path length that varies according to the refractive index difference between regions A and B, and this difference manifests in the propagation direction. The difference in propagation direction depends on the wavelength of the light. Therefore, by pre-selecting a material with a refractive index suitable for the incident light wavelength band, the light control region can be used as a color filter.

[0045] The light control region according to this embodiment is also called a dichroic splitter (color filter splitter: CFS). A dichroic splitter can perform functions similar to a color filter because it can bend incident light at a certain angle according to wavelength. Since a color filter only transmits light of a specific wavelength band, it wastefully discards light of wavelength bands outside that specific band. However, in the dichroic splitter described above, light can be bent at different angles for each wavelength band, thereby improving light utilization efficiency.

[0046] If only a color separator is used, the bent light will enter adjacent pixels 10, and the desired spectral characteristics cannot be obtained. Therefore, a color filter can be used in combination with a color separator. In this case, to prevent color mixing, the thickness of the color filter can be thinner than that of the color filter in a conventional light detection device 1. As described above, in this embodiment, the color filter area is set separately from the light control area, and the capture range of incident light to the light control area is controlled for each pixel 10 of each color in the color filter area.

[0047] Figure 3This is a cross-sectional view of the main parts of the optical detection device 1 according to this embodiment. For example... Figure 3 As shown, the light detection device 1 according to this embodiment includes a stack of a photoelectric conversion region 11, a color filter region 12, and a light control region 13. One end face of the light control region 13 is a light incident surface S1. The photoelectric conversion region 11 includes a photoelectric conversion unit for each pixel 10. The photoelectric conversion unit is, for example, a photodiode. The color filter region 12 is arranged closer to the light incident surface S1 than the photoelectric conversion region 11 and includes multiple unit pixel group regions 14 that split the multiple wavelength components included in the incident light. The light control region 13 is arranged closer to the light incident surface S1 than the color filter region 12 and controls the incident light. The light control region 13 includes multiple unit structures that respectively control the aperture range for capturing the incident light.

[0048] Figure 4 This is a diagram illustrating a specific example of the light control region 13 according to the present disclosure, wherein Figure 4 A is the top view, and Figure 4 B is a cross-sectional view.

[0049] According to this disclosure, the light control region 13 includes a plurality of unit structures 15 periodically arranged in a two-dimensional direction. Figure 4 A is a top view of a unit structure 15, and Figure 4 B is along Figure 4 The cross-sectional view taken by line AA in A. The unit structure 15 includes multiple microstructures 16. The shapes and sizes of the multiple microstructures 16 are not necessarily the same, and the spacing between two adjacent microstructures 16 is also not necessarily the same. Figure 4 An example is shown where the unit structure 15 includes four microstructures 16, and multiple microstructures 16 are disposed on the boundary region between two adjacent unit structures 15. However, the number, size, and shape of the microstructures 16 included in the unit structure 15 can be freely determined.

[0050] For example, such as Figure 4 As shown in the cross-sectional view of B, microstructure 16 is a columnar body of length h extending along the direction of light propagation. Note that although... Figure 4 An example of a cylindrical shape for microstructure 16 is shown, but the microstructure can also have a cuboid shape. For example, the periphery of microstructure 16 is covered with a light-transmitting region 17, such as SiO2. Here, "transmission" refers to the transmission of incident light in the wavelength band required to generate the captured image. The refractive index n1 of microstructure 16 is greater than the refractive index n0 of light-transmitting region 17. The material of microstructure 16 is, for example, SiN.

[0051] Light incident on microstructure 16 propagates within microstructure 16 due to the refractive index difference relative to the light transmission region 17. Therefore, microstructure 16 serves as an optical waveguide for the incident light. As shown in equation (4) above, the light propagating within microstructure 16 generates a phase difference (phase delay) φ based on the refractive index difference relative to the light transmission region 17. The phase delay φ has different values ​​depending on the wavelength λ of the light.

[0052] In addition, such as Figure 4 As shown, by setting various types of microstructures 16 with different diameters, different phase delay distributions can be provided for light propagating into the microstructure 16 for each wavelength region, and the optical wavefront can be changed. Since the direction of light propagation is determined by the optical wavefront, the microstructure 16 can converge different ranges of light for each wavelength. In this specification, the range in which the unit structure 15 including the microstructure 16 can capture incident light is referred to as the aperture range.

[0053] In this embodiment, the incident light includes light in the visible light wavelength bands of red, green and blue, and the incident light propagates within the individual microstructures 16 of the unit structure 15, thereby allowing control of the aperture range of the incident light for each color.

[0054] The aperture range of the incident light can be controlled, for example, by adjusting at least one of the diameter of the microstructure 16, the height of the microstructure 16, the spacing between two adjacent microstructures 16, or the distance between two adjacent microstructures 16. Here, the diameter of the microstructure 16 is as follows: Figure 4 The symbols d1 and d2 in A represent the diameter or width of microstructure 16. The height of microstructure 16 is as follows: Figure 4 The height of microstructure 16 in the light propagation direction is shown by reference numeral h in Figure B. The spacing between two adjacent microstructures 16 is as follows: Figure 4 The figure shows the shortest distance between the outer peripheral surfaces of two microstructures 16, as indicated by reference numeral d3 in Figure A. The spacing between two adjacent microstructures 16 is as follows: Figure 4 The distance d4 between the center positions of the two microstructures 16 shown in A.

[0055] Figure 5 This is a graph showing the relationship between the size of the opening range, sensitivity, and resolution of the unit structure 15. Figure 5 Plan view, cross-sectional view, incident light quantity (input), received light quantity (output), formed image corresponding to the incident image, sensitivity and resolution are shown for the unit structure 15 with small opening range and large opening range. Figure 5 The cross-sectional structure shown illustrates the cross-sectional structure of the optical detection device 1 according to this embodiment.

[0056] like Figure 5As shown, when the aperture range of unit structure 15 is small, the amount of incident light to be captured is less than when the aperture range is large, thus reducing sensitivity. However, with a small aperture range, a narrow range of light from the subject is captured, resulting in reduced image blur and improved resolution. As the aperture range of unit structure 15 increases, a wider range of light can be captured, thereby improving sensitivity, but increasing image blur and reducing resolution.

[0057] Figure 5 The diagram illustrates a state where multiple digits of the subject overlap and form an image when the opening range of unit structure 15 is large, and a state where only the digits in the central portion of the subject form an image when the opening range is small. The state where multiple digits overlap and form an image shows that light from a wide range can be converged, and sensitivity is improved, but resolution degrades. Furthermore, the state where only the central portion of the subject forms an image shows that light from a narrow range can only be captured, and sensitivity is reduced, but resolution is improved.

[0058] Figure 6A and Figure 6B This is a diagram showing the unit structure 15 of the light control region 13 of the light detection device 1 according to an embodiment of the present disclosure, the opening range of the unit structure 15, and the unit pixel group region 14 of the color filter region 12. Figure 6A and Figure 6B An example of a Bayer array is shown where the unit pixel group region 14 is a pixel block consisting of 2 × 2 pixels. Figure 6A The red and blue opening ranges RL, RS, BL, and BS in unit structure 15 are shown, and Figure 6B The green opening ranges GL and GS are shown. Figure 6A and Figure 6B Examples are shown where the red, green, and blue openings are all circular. Figure 6A and Figure 6B In the diagram, the red and blue opening ranges RL, RS, BL, and BS in unit structure 15 are shown separately from the green opening ranges GL and GS, but this is only for ease of observation.

[0059] Figure 6A and Figure 6BThe diagram shows 6 × 6 = 36 pixels 10 in a color filter region 12. The color filter region 12 has a structure in which multiple unit pixel group regions 14 are arranged without gaps in a two-dimensional direction. Each unit pixel group region 14 includes a pixel block containing multiple pixels 10 in a predetermined color array. The predetermined color array is, for example, a Bayer array. Various variations of the color array exist for the unit pixel group regions 14, and color arrays other than Bayer arrays can be applied. For example, as described later, the predetermined color array can be a quaternion array in which multiple pixels 10 of each color are arranged in a Bayer array.

[0060] Light passing through each unit pixel group region 14 is incident on the photoelectric conversion region 11. The photoelectric conversion region 11 includes a plurality of pixels 10 corresponding to the division of a plurality of pixels 10 constituting each unit pixel group region 14. In this specification, the smallest unit of the photoelectric conversion region 11 and the smallest unit of each unit pixel group region 14 of the color filter region 12 are both referred to as pixel 10. In the light detection device 1 according to this embodiment, incident light captured within any opening range of the corresponding unit structure 15 is converged and incident on at least some of the pixels 10 of the photoelectric conversion region 11 and the color filter region 12.

[0061] exist Figure 6A and Figure 6B In the example, there are 9 red pixels (R) 10 and 9 green pixels (B) 10, and 18 green pixels (G) 10. The unit pixel group area 14 of the color filter area 12 has a size of 2 × 2 pixels for a Bayer array. The unit structure 15 of the light control area 13 has a size of 4 × 4 pixels.

[0062] A color filter region 12 is constructed by periodically arranging multiple unit pixel group regions 14 in a two-dimensional direction. A light control region 13 is constructed by periodically arranging multiple unit structures 15 in a two-dimensional direction. The size of the unit structure 15 is larger than the size of the unit pixel group region 14, and the arrangement period of the unit structure 15 in the two-dimensional direction is longer than the arrangement period of the unit pixel group region 14.

[0063] For each wavelength of incident light, each of the multiple unit structures 15 converges the incident light within an opening of two or more different sizes, and directs the incident light onto any pixel 10 in the unit pixel group region 14. In this way, the unit structure 15 uses each of two or more openings of different sizes to capture and converge the incident light, and directs the incident light onto the corresponding pixel 10 in the corresponding unit pixel group region 14.

[0064] For example, for each pixel 10 of various colors in the color filter region 12, the unit structure 15 has an opening range of two types of sizes (hereinafter referred to as large size and small size). Figure 6A and Figure 6B An example is shown where unit structure 15 converges incident light into the large aperture region RL corresponding to red pixel 10, the small aperture region RS corresponding to red pixel 10, the large aperture region BL corresponding to blue pixel 10, the small aperture region BS corresponding to blue pixel 10, the large aperture region GL corresponding to green pixel 10, and the small aperture region GS corresponding to green pixel 10, and unit structure 15 causes the incident light to be incident on the respective pixel 10. For example, light incident on the large red aperture region RL is incident on a red pixel 10 located in the center of the aperture region RL. Light incident on the small red aperture region RS is incident on a pixel 10 that is approximately the same size as the aperture region RS. This also applies to other colors.

[0065] Multiple microstructures 16 are arranged in the unit structure 15. Figure 6A and Figure 6B An example is shown where the light-capturing area (aperture range) of multiple microstructures 16 is circular, but the shape of the aperture range can be freely determined. The diameter and spacing of each microstructure 16 can also be freely determined. Figure 4 and Figure 5 As shown, by controlling the diameter, height, number, and spacing of multiple microstructures 16, a specific configuration can be set for each color (wavelength). Figure 6A and 6B The opening range of the dimensions shown.

[0066] exist Figure 6A and Figure 6B In the example, within the 16 pixels 10 included in the range of a unit structure 15 of size 4 × 4 pixels, light from the large aperture range RL is incident on two red pixels 10, light from the small aperture range RS is incident on the remaining two red pixels 10, light from the large aperture range BL is incident on two blue pixels 10, light from the small aperture range BS is incident on the remaining two blue pixels 10, light from the large aperture range GL is incident on two green pixels 10, and light from the small aperture range GS is incident on the remaining two green pixels 10.

[0067] Furthermore, the remaining four green pixels 10n included within the unit structure 15 are not designed so that light incident from the unit structure 15 is incident on them, but rather on some leaked light that has already passed through the unit structure 15. In this way, the pixels 10n on which leaked light is incident do not contribute to the improvement of sensitivity, but do contribute to the improvement of resolution.

[0068] Light passing through the plurality of unit pixel groups 14 of the color filter region 12 is incident on the photoelectric conversion region 11 and is photoelectrically converted. The photoelectric conversion region 11 includes a plurality of pixels 10, on which light passing through the respective unit pixel groups 14 is incident. Incident light captured in any opening range of the respective unit structure 15 is converged and incident on at least some of the plurality of pixels 10.

[0069] For each wavelength of incident light, the plurality of pixels 10 includes at least one first pixel and at least one second pixel, the second pixel having higher sensitivity and lower resolution than the first pixel. Therefore, by combining the pixel signals captured by the first pixel and the second pixel for each wavelength of incident light, it is possible to improve both sensitivity and resolution.

[0070] Figure 1 The column signal processing circuit 4 shown is... Figure 1 The signal processing unit in the subsequent stage (not shown) generates an image with improved sensitivity and resolution based on the pixel signal obtained by photoelectric conversion of light passing through each of the multiple unit pixel group regions 14 and incident on the multiple pixels 10.

[0071] For each wavelength of incident light, each of the plurality of unit structures 15 converges to capture the incident light in two or more types of aperture ranges, wherein at least one of the size, shape, or aperture orientation differs within these aperture ranges, and each of the plurality of unit structures 15 directs the incident light onto a corresponding pixel location in a corresponding unit pixel group region 14. For each wavelength of incident light, at least one of the size, shape, or aperture orientation of the aperture range may differ.

[0072] although Figure 6A and Figure 6B Two types of opening ranges of different sizes are shown, but unit structure 15 may include multiple types of opening ranges of the same size but different shapes or opening directions.

[0073] Light, captured and then converged, is incident on at least two of the plurality of pixels 10 corresponding to each of the plurality of pixel group regions 14 in two or more types of opening ranges that differ in at least one of the size, shape, or opening direction of the respective unit structure 15. The two or more types of opening ranges include opening ranges whose size is larger than the combined size of the two or more pixels 10.

[0074] For example, for each wavelength of incident light, each of the plurality of unit structures 15 causes a first light and a second light, which are captured and converged in two opening ranges of different sizes, to be incident on a corresponding pixel position in a corresponding unit pixel group region 14. The first light is in a first opening range of two or more pixels 10 (e.g., Figure 6A The light that is captured and then converged is captured in the opening range RL of the first opening range, and the second light is captured in a second opening range (e.g., a smaller size than the first opening range). Figure 6A The light that converges after being captured in the opening range (RS) of the middle.

[0075] Figure 7A and Figure 7B This diagram illustrates the unit structure 15, unit pixel group region 14, and aperture range of unit structure 15 according to a comparative example. In the comparative example, the unit pixel group region 14 and unit structure 15 are of the same size, and multiple unit pixel group regions 14 and multiple unit structures 15 are arranged along the two-dimensional direction with the same period. In the comparative example, the aperture ranges RA, BA, and GA of each color are of the same size, and the sensitivity and resolution of all pixels 10 are fixed.

[0076] Therefore, sensitivity and resolution are determined by the dimensions of the aperture ranges RA, BA, and GA. Thus, increasing the dimensions of RA, BA, and GA will increase sensitivity but decrease resolution. Conversely, decreasing the dimensions of RA, BA, and GA will increase resolution but decrease sensitivity.

[0077] In this way, in the unit structure 15 according to the comparative example, it is difficult to expand the dynamic range since both sensitivity and resolution cannot be improved.

[0078] Figure 8 This is a diagram illustrating the dimensions of the opening range GL of the unit structure 15 according to this embodiment. Figure 8 In the image, the lengths of pixel 10 in the first direction (horizontal direction) and the second direction (vertical direction) are x and y, respectively. The intervals between two adjacent pixels 10 of the same color in the first direction and the second direction are X and Y, respectively. The lengths of the opening range in the first direction and the second direction are a and b, respectively.

[0079] In order to maximize the opening range GL while preventing the two opening ranges GL corresponding to two adjacent pixels 10 of the same color from overlapping, the following relationship of formulas (5) and (6) needs to be satisfied.

[0080] x < a < 2X – x (5) y < b < 2Y – y (6) In this way, by setting the dimensions a and b of the opening range GL to satisfy formulas (5) and (6), sensitivity and resolution can be improved.

[0081] In the above description, an example of circular shapes for each opening range of the unit structure 15 in this embodiment has been given, but the shape of each opening range is not limited to a circular shape. Figure 9A and Figure 9B This is a diagram showing the unit structure 15, the unit pixel group region 14, and the opening range of the unit structure 15 according to a variation of this embodiment. Figure 9A and Figure 9B An example is shown where the opening ranges RA, GA, and BA of unit structure 15 are elliptical in shape. Furthermore, Figure 9A An example is shown where all openings RA and BA in unit structure 15 are of the same size, and two types of elliptical openings RA and BA with different opening directions are provided for each pixel 10 of each color. For example, unit structure 15 has four openings RA for allowing light to be incident on red pixel 10, two of which are ellipses with their long sides arranged in a first direction (horizontal direction), and the remaining two are ellipses with their long sides arranged in a second direction (vertical direction). This also applies to other colors.

[0082] In this way, the multiple opening ranges RA and BA set in the unit structure 15 do not need to have more than two types of sizes. Figure 9A An example of unit structure 15 is shown, comprising two or more types of opening ranges RA, GA, and BA with the same size but different opening directions. In this case, it is possible to improve the sensitivity or resolution in a specific opening direction.

[0083] However, Figure 9B This illustrates examples of two types of elliptical or circular opening ranges GL and GS, each with a different size. Three large-sized opening ranges GL are provided, with two of them differing from the third by 90 degrees in the opening direction. Additionally, four small-sized opening ranges GS are provided.

[0084] In the above description, an example of a Bayer array being used for the unit pixel group region 14 in the color filter region 12 has been given, but the unit pixel group region 14 can be a pixel array other than a Bayer array. Figure 10A and Figure 10B The example shown is a unit pixel group region 14 in the color filter region 12, which is a quaternion array. The quaternion array has an array of 2 × 2 = 4 pixels 10, each of the four pixels 10 that constitute the Bayer array, being replaced with the same color. Figure 10A and Figure 10B The unit pixel group region 14 of the shown quad array has 4 × 4 = 16 pixels. In the following text, multiple pixels 10 of the same color arranged adjacent to each other are referred to as pixel blocks IB. Furthermore, the pixel array of the color filter region 12 can also be applied to octagonal patterns, nona patterns, etc.

[0085] and Figure 10A and Figure 10B The unit structure 15 corresponding to the unit pixel group region 14 has opening ranges RL and RS, GL and GS, and BL and BS. Each pair of opening ranges has two types with different sizes for their respective colors (hereinafter referred to as large size and small size). For example, for red, green, and blue, the unit structure 15 includes two large-size opening ranges RL, GL, and BL, and one small-size opening range RS, GS, and BS, respectively. Figure 10A In the diagram, light incident on the large red aperture RL is incident on a red unit pixel group region (pixel block) 14, which comprises 2 × 2 = 4 pixels 10 and is located at the center of the aperture RL. Light incident on the small red aperture is incident on a unit pixel group region (pixel block) 14B, which comprises 2 × 2 = 4 pixels 10 and is approximately the same size as the aperture. This also applies to other colors.

[0086] exist Figure 10A and Figure 10B In the example, within the 64 pixels included in the range of a unit structure 15 having a size of 8 × 8 pixels 10, light from the large aperture range RL is incident on two red unit pixel group regions 14, light from the small aperture range RS is incident on the remaining two red unit pixel group regions 14, light from the large aperture range BL is incident on two blue unit pixel group regions 14, light from the small aperture range BS is incident on the remaining two blue unit pixel group regions 14, light from the large aperture range GL is incident on two green unit pixel group regions 14, and light from the small aperture range GS is incident on the remaining two green unit pixel group regions 14.

[0087] Furthermore, the remaining four green unit pixel group regions 14 included within the unit structure 15 are not designed to receive light from the unit structure 15, but rather to receive some leaked light that has already passed through the unit structure 15. In this way, the pixel block IB on which the leaked light is incident does not contribute to the improvement of sensitivity, but it does contribute to the improvement of resolution.

[0088] As described above, in this embodiment, the light control region 13 is arranged on the light incident surface S1 side relative to the color filter region 12, and the size of the unit structure 15 in the light control region 13 is larger than the size of the unit pixel group region 14 in the color filter region 12. Therefore, the opening range of the unit structure 15 can be further expanded, and the incident light captured within the opening range of the unit structure 15 is converged and incident on the corresponding pixel 10 in the unit pixel group region 14. Furthermore, by providing multiple types of opening ranges with different sizes in the unit structure 15, the sensitivity of incident light captured in large opening ranges can be improved, and the resolution of incident light captured in small opening ranges can be improved. Therefore, the sensitivity and resolution of the light detection device 1 can be improved. Since the unit structure 15 includes multiple microstructures 16, the opening range of the incident light can be freely controlled, for example, by controlling at least one of the diameter of the microstructure 16, the height of the microstructure 16, the spacing between two adjacent microstructures 16, or the distance between two adjacent microstructures 16.

[0089] <Application Examples of Mobile Bodies> The technology disclosed herein (the Technology) can be applied to a variety of products. For example, the Technology disclosed herein can be implemented as a device installed on any mobile body such as a car, electric car, hybrid car, motorcycle, bicycle, personal mobility device, airplane, drone, ship or robot.

[0090] Figure 11 This is a block diagram illustrating a schematic construction example of a vehicle control system, which is an example of a mobile body control system to which the technology according to this disclosure can be applied.

[0091] The vehicle control system 12000 includes multiple electronic control units interconnected via a communication network 12001. Figure 11 In the example shown, the vehicle control system 12000 includes a drive system control unit 12010, a body system control unit 12020, an external information detection unit 12030, an internal information detection unit 12040, and an integrated control unit 12050. Furthermore, as part of the functional configuration of the integrated control unit 12050, a microcomputer 12051, an audio / image output unit 12052, and an in-vehicle network interface (I / F) 12053 are shown.

[0092] The drive system control unit 12010 controls the operation of devices related to the vehicle's drive system according to various types of programs. For example, the drive system control unit 12010 is used as a control device for devices such as internal combustion engines, drive motors and other drive force generating devices for generating vehicle driving force, drive force transmission mechanisms for transmitting driving force to the wheels, steering mechanisms for adjusting the vehicle's steering angle, and braking devices for generating vehicle braking force.

[0093] The body system control unit 12020 controls the operation of various types of devices installed on the vehicle body according to various types of programs. For example, the body system control unit 12020 is used as a control device for keyless entry systems, smart key systems, power windows, or various lights such as headlights, reversing lights, brake lights, turn signals, fog lights, etc. In this case, radio waves or signals of various types of switches sent from a keyless entry device can be input to the body system control unit 12020. The body system control unit 12020 receives these radio waves or signal inputs and controls the vehicle's door locks, power windows, lights, etc.

[0094] The exterior information detection unit 12030 detects information about the exterior of the vehicle, including information from the vehicle control system 12000. For example, the exterior information detection unit 12030 is connected to a camera unit 12031. The exterior information detection unit 12030 causes the camera unit 12031 to capture images of the exterior of the vehicle and receives the captured images. Based on the received images, the exterior information detection unit 12030 can perform detection processing for objects such as people, vehicles, obstacles, signs, and characters on the road surface, or it can perform distance detection processing for these objects.

[0095] The camera unit 12031 is an optical sensor that receives light and outputs an electrical signal corresponding to the amount of light received. The camera unit 12031 can output the electrical signal as an image or as ranging information. Furthermore, the light received by the camera unit 12031 can be visible light or invisible light such as infrared light.

[0096] The in-vehicle information detection unit 12040 detects information inside the vehicle. The in-vehicle information detection unit 12040 is connected, for example, to a driver state detection unit 12041 that detects the driver's state. The driver state detection unit 12041 includes, for example, a camera that captures images of the driver. Based on the detection information input from the driver state detection unit 12041, the in-vehicle information detection unit 12040 can calculate the driver's fatigue level or concentration level, or determine whether the driver is dozing off.

[0097] The microcomputer 12051 can calculate control target values ​​for the drive force generating device, steering mechanism, or braking device based on information about the exterior or interior of the vehicle obtained by the exterior information detection unit 12030 or the interior information detection unit 12040, and output control commands to the drive system control unit 12010. For example, the microcomputer 12051 can perform cooperative control aimed at realizing advanced driver assistance system (ADAS) functions, including collision avoidance or impact mitigation, distance-based following, speed maintenance, collision warning, lane departure warning, etc.

[0098] Furthermore, by controlling the driving force generating device, steering mechanism, braking device, etc., based on information about the exterior or interior of the vehicle obtained by the exterior information detection unit 12030 or the interior information detection unit 12040, the microcomputer 12051 can perform coordinated control aimed at achieving autonomous driving, etc., which enables the vehicle to drive autonomously without relying on the driver's operation.

[0099] Furthermore, based on the information about the exterior of the vehicle obtained by the exterior information detection unit 12030, the microcomputer 12051 can output control commands to the body system control unit 12020. For example, the microcomputer 12051 can, for instance, perform coordinated control aimed at preventing glare by controlling the headlights to switch from high beam to low beam, based on the position of the vehicle ahead or oncoming vehicle detected by the exterior information detection unit 12030.

[0100] The sound / image output unit 12052 sends an output signal of at least one of sound and image to an output device capable of visually or audibly notifying passengers of the vehicle or external to the vehicle. Figure 11 In the example, as an example of an output device, an audio speaker 12061, a display unit 12062, and a dashboard 12063 are shown. For example, the display unit 12062 may include at least one of an in-vehicle display and a head-up display.

[0101] Figure 12 This is a diagram showing an example of the mounting position of the camera unit 12031.

[0102] exist Figure 12 In the middle, the camera unit 12031 includes camera units 12101, 12102, 12103, 12104 and 12105.

[0103] Cameras 12101, 12102, 12103, 12104, and 12105 are installed, for example, on the front nose, rearview mirrors, rear bumper, and rear door of vehicle 12100, as well as on the upper part of the windshield inside the passenger compartment. Camera 12101 on the front nose and camera 12105 on the upper part of the windshield inside the passenger compartment primarily acquire images of the front of vehicle 12100. Cameras 12102 and 12103 on the rearview mirrors primarily acquire images of the sides of vehicle 12100. Camera 12104 on the rear bumper or rear door primarily acquires images of the rear of vehicle 12100. Camera 12105 on the upper part of the windshield inside the passenger compartment is mainly used to detect vehicles, pedestrians, obstacles, traffic lights, traffic signs, lanes, etc., ahead.

[0104] Incidentally, Figure 12 Examples of the camera ranges of camera units 12101 to 12104 are shown. Camera range 12111 represents the camera range of camera unit 12101 located at the front nose. Camera ranges 12112 and 12113 represent the camera ranges of camera units 12102 and 12103 located at the rearview mirrors, respectively. Camera range 12114 represents the camera range of camera unit 12104 located at the rear bumper or rear door. For example, by overlaying image data captured by camera units 12101 to 12104, a bird's-eye view of the vehicle 12100 viewed from above is obtained.

[0105] At least one of the camera units 12101 to 12104 may have the function of obtaining distance information. For example, at least one of the camera units 12101 to 12104 may be a stereo camera composed of multiple camera elements, or may be a camera element having pixels for phase difference detection.

[0106] For example, based on distance information obtained from cameras 12101 to 12104, microcomputer 12051 can determine the distance to each three-dimensional object within the camera range 12111 to 12114 and the time change of said distance (relative speed to vehicle 12100). Therefore, it extracts the nearest three-dimensional object as the vehicle ahead, specifically, this nearest three-dimensional object exists on the driving path of vehicle 12100 and is traveling at a predetermined speed (e.g., equal to or greater than 0 km / h) in approximately the same direction as vehicle 12100. Furthermore, microcomputer 12051 can preset the distance to be maintained between the vehicle ahead and the vehicle ahead, and execute automatic braking control (including follow-stop control), automatic acceleration control (including follow-start control), etc. Therefore, cooperative control, such as autonomous driving, can be performed to enable the vehicle to drive autonomously without relying on driver operation.

[0107] For example, based on distance information obtained from cameras 12101 to 12104, microcomputer 12051 can classify three-dimensional object data into three-dimensional object data for two-wheeled vehicles, standard vehicles, large vehicles, pedestrians, utility poles, and other three-dimensional objects, extract the classified three-dimensional object data, and use the extracted three-dimensional object data to automatically avoid obstacles. For example, microcomputer 12051 identifies obstacles around vehicle 12100 as obstacles that the driver of vehicle 12100 can visually recognize and obstacles that the driver of vehicle 12100 cannot visually recognize. Then, microcomputer 12051 determines a collision risk to indicate the risk of collision with each obstacle. If the collision risk is equal to or higher than a set value and therefore there is a possibility of collision, microcomputer 12051 outputs a warning to the driver via audio speaker 12061 or display unit 12062, and performs forced deceleration or evasive steering via drive system control unit 12010. Therefore, microcomputer 12051 can assist driving to avoid collisions.

[0108] At least one of the camera units 12101 to 12104 can be an infrared camera that detects infrared light. The microcomputer 12051 can identify a pedestrian, for example, by determining whether a pedestrian exists in the captured images of the camera units 12101 to 12104. For example, this pedestrian identification is performed by the following steps: extracting feature points from the captured images of the camera units 12101 to 12104, which are infrared cameras; and performing pattern matching processing on a series of feature points representing the outline of an object to determine whether it is a pedestrian. If the microcomputer 12051 determines that a pedestrian exists in the captured images of the camera units 12101 to 12104 and thus identifies the pedestrian, the sound / image output unit 12052 controls the display unit 12062 to display an emphasized square outline superimposed on the identified pedestrian. The sound / image output unit 12052 can also control the display unit 12062 to display an icon or similar symbol representing a pedestrian at a desired location.

[0109] In addition, this technology can have the following structure. (1) A light detection device, comprising: The photoelectric conversion region includes photoelectric conversion units for each pixel; A color filter region, located closer to the light incident surface than the photoelectric conversion region, and including multiple unit pixel groups that split the multiple wavelength components included in the incident light; and A light control region, which is located closer to the light incident surface than the color filter region, is configured to control the incident light, wherein... The light control region includes multiple unit structures that each control the aperture range used to capture incident light. Each of the plurality of unit structures includes a plurality of microstructures, and The size of each unit structure is larger than the size of each unit pixel group region. (2) The optical detection device according to (1), wherein The multiple unit pixel groups are arranged periodically in a two-dimensional direction. The plurality of unit structures are arranged periodically in a two-dimensional direction, and The arrangement period of the unit structure in the two-dimensional direction is longer than the arrangement period of the unit pixel group region. (3) The optical detection device according to (1) or (2), wherein For each wavelength of incident light, each of the plurality of unit structures converges the incident light into two or more types of opening ranges of different sizes, capturing the incident light and causing the incident light to be incident on the unit pixel group region. (4) The optical detection device according to (3), wherein Light passing through the plurality of unit pixel groups in the color filter region is incident on the photoelectric conversion region and is subjected to photoelectric conversion. The photoelectric conversion area includes multiple pixels, and light passing through the corresponding unit pixel group area is incident on the multiple pixels, and Incident light captured in any of the opening ranges of the respective unit structures is converged and incident on at least some of the plurality of pixels. (5) The optical detection device according to (4), wherein For each wavelength of the incident light, the plurality of pixels includes at least one first pixel and at least one second pixel, the second pixel having higher sensitivity and lower resolution than the first pixel. (6) The optical detection device according to (4) or (5) further includes: The signal processing unit is configured to generate an image with improved sensitivity and resolution based on pixel signals obtained by photoelectric conversion of light passing through each of the plurality of unit pixel group regions and incident on the plurality of pixels. (7) The light detection device according to any one of (4) to (6), wherein For each wavelength of incident light, each of the plurality of unit structures converges the incident light into at least two or more types of opening ranges that are different in size, shape or opening direction, and each of the plurality of unit structures causes the incident light to be incident on a corresponding pixel position in the corresponding unit pixel group region. (8) The light detection device according to any one of (4) to (6), wherein Converging light is incident on at least two of the plurality of pixels corresponding to each of the plurality of unit pixel group regions, and the light is captured in the opening range of at least two different types of the corresponding unit structures in the unit structure, in terms of size, shape, or opening direction. (9) The optical detection device according to (7) or (8), wherein The opening range of the two or more types includes an opening range whose size is greater than the combined size of two or more of the pixels. (10) The optical detection device according to (9), wherein For each wavelength of incident light, each of the plurality of unit structures causes the converging first and second light to be incident on the corresponding pixel position of the corresponding unit pixel group region of the unit pixel group region, capturing the first and second light in two opening ranges of different sizes. (11) The optical detection device according to (10), wherein The first light is light that is captured and converged within a first opening area having a size of two or more of the aforementioned pixels, and The second light is light that is captured and converged in a second opening range that is smaller in size than the first opening range. (12) The optical detection device according to (11), wherein The first opening range and the second opening range have a circular shape. (13) The optical detection device according to (7) or (8), wherein The two or more types of opening ranges include two or more opening ranges with different opening directions. (14) The optical detection device according to (13), wherein For each wavelength of incident light, each of the plurality of unit structures causes the converging first and second light to be incident on the corresponding pixel position of the corresponding unit pixel group region of the unit pixel group region, capturing the first and second light in two aperture ranges with different aperture directions. (15) The optical detection device according to (14), wherein The two openings are elliptical in shape with their long and short sides having different orientations and equal dimensions. (16) The light detection apparatus according to any one of (1) to (15), wherein Each of the plurality of unit structures causes light to be incident on one of the pixels in the photoelectric conversion region, the light being incident on an opening having a circular or elliptical shape and a length of 'a' in a first direction and a length of 'b' in a second direction orthogonal to the first direction. The length of a pixel in the first direction is x and the length in the second direction is y, and If the interval between two adjacent pixels of the same color in the first direction is defined as X and the interval in the second direction is defined as Y, In the light control region, the dimensions of a and b are set to satisfy the following formulas (1) and (2): x < a < 2X – x (1); y < b < 2Y – y (2). (17) The light detection apparatus according to any one of (1) to (16), wherein Light passing through the unit pixel group region and incident on at least one of the plurality of pixels thereon is designed such that light not incident on the opening range of the unit structure corresponding to the unit pixel group region is captured. (18) The light detection apparatus according to any one of (1) to (17), wherein Each of the plurality of unit structures controls the opening range by controlling at least one of the diameter of each of the microstructures, the height of each of the microstructures, the interval between two adjacent microstructures, or the spacing between two adjacent microstructures. (19) The light detection apparatus according to any one of (1) to (18), wherein Each of the multiple unit pixel group regions is a pixel block of pixels of various colors arranged in a predetermined array. (20) The light detection apparatus according to any one of (1) to (19), wherein The predetermined array is a Bayer array or a quaternion array.

[0110] This disclosure is not limited to the various embodiments described above, but includes various modifications that can be conceived by those skilled in the art, and the effects of this disclosure are not limited to the foregoing. In other words, various additions, modifications, and partial deletions can be made without departing from the conceptual idea and spirit of this disclosure derived from the matters defined in the claims and their equivalents. List of reference numerals

[0111] 1. Optical detection device 2-pixel array unit 3 Vertical drive circuit 4-column signal processing circuits 5. Horizontal drive circuit 6 Output Circuit 7. Control Circuit 10 pixels 11 Photoelectric conversion region 12 Color Filter Areas 13 Light Control Area 14 unit pixel group area 15 Unit Structure 16 Microstructure 17. Light transmission area.

Claims

1. A light detection device, comprising: The photoelectric conversion region includes photoelectric conversion units for each pixel; The color filter region is located on a side closer to the light incident surface than the photoelectric conversion region, and includes a plurality of unit pixel groups that split the multiple wavelength components included in the incident light. as well as A light control region, located closer to the light incident surface than the color filter region, controls the incident light, wherein... The light control region includes multiple unit structures that each control the aperture range used to capture incident light. Each of the plurality of unit structures has a plurality of microstructures, and The size of the unit structure is larger than the size of the unit pixel group region.

2. The optical detection device according to claim 1, wherein... The multiple unit pixel groups are arranged periodically in a two-dimensional direction. The plurality of unit structures are arranged periodically in a two-dimensional direction, and The arrangement period of the unit structure in the two-dimensional direction is longer than the arrangement period of the unit pixel group region.

3. The optical detection device according to claim 1, wherein... For each wavelength of incident light, each of the plurality of unit structures converges the incident light into two or more types of opening ranges of different sizes, capturing the incident light and causing the incident light to be incident on the unit pixel group region.

4. The optical detection device according to claim 3, wherein... Light passing through the plurality of unit pixel groups in the color filter region is incident on the photoelectric conversion region and is subjected to photoelectric conversion. The photoelectric conversion area includes multiple pixels, and light passing through the corresponding unit pixel group area is incident on the multiple pixels, and Incident light captured in any of the opening ranges of the respective unit structures is converged and incident on at least some of the plurality of pixels.

5. The optical detection device according to claim 4, wherein... For each wavelength of the incident light, the plurality of pixels includes at least one first pixel and at least one second pixel, the second pixel having higher sensitivity and lower resolution than the first pixel.

6. The optical detection device according to claim 4, comprising: The signal processing unit generates an image with improved sensitivity and resolution based on pixel signals obtained by photoelectric conversion of light that passes through each of the plurality of unit pixel group regions and is incident on the plurality of pixels.

7. The optical detection device according to claim 4, wherein... For each wavelength of incident light, each of the plurality of unit structures converges the incident light into at least two or more types of opening ranges that are different in size, shape or opening direction, and each of the plurality of unit structures causes the incident light to be incident on a corresponding pixel position in the corresponding unit pixel group region.

8. The optical detection device according to claim 4, wherein Converging light is incident on at least two of the plurality of pixels corresponding to each of the plurality of unit pixel group regions, and the light is captured in the opening range of at least two different types of the corresponding unit structures in the unit structure, in terms of size, shape, or opening direction.

9. The optical detection device according to claim 7, wherein... The opening range of the two or more types includes an opening range whose size is greater than the combined size of two or more of the pixels.

10. The optical detection device according to claim 9, wherein... For each wavelength of incident light, each of the plurality of unit structures causes the converging first and second light to be incident on the corresponding pixel position of the corresponding unit pixel group region of the unit pixel group region, capturing the first and second light in two opening ranges of different sizes.

11. The optical detection device according to claim 10, wherein... The first light includes light that is captured and converged within a first opening range having a size of two or more of the aforementioned pixels, and The second light includes light that is captured and converged in a second opening range that is smaller in size than the first opening range.

12. The optical detection device according to claim 11, wherein... The first opening range and the second opening range have a circular shape.

13. The optical detection device according to claim 7, wherein... The two or more types of opening ranges include two or more opening ranges with different opening directions.

14. The optical detection device according to claim 13, wherein... For each wavelength of incident light, each of the plurality of unit structures causes the converging first and second light to be incident on the corresponding pixel position of the corresponding unit pixel group region of the unit pixel group region, capturing the first and second light in two aperture ranges with different aperture directions.

15. The optical detection device according to claim 14, wherein... The two openings are elliptical in shape with their long and short sides having different orientations and equal dimensions.

16. The optical detection device according to claim 1, wherein... Each of the plurality of unit structures causes light to be incident on one of the pixels in the photoelectric conversion region, the light being incident within the circular or elliptical opening of length 'a' in a first direction and length 'b' in a second direction orthogonal to the first direction. The length of a pixel in the first direction is x and the length in the second direction is y, and If the interval between two adjacent pixels of the same color in the first direction is defined as X and the interval in the second direction is defined as Y, In the light control region, the dimensions of a and b are set to satisfy the following formulas (1) and (2): x < a < 2X – x (1); and y < b < 2Y – y (2).

17. The optical detection device according to claim 1, wherein... At least one of the plurality of pixels on which light passing through the unit pixel group region is incident is designed not to be incident on light captured in the opening range of the unit structure corresponding to the unit pixel group region.

18. The optical detection device according to claim 1, wherein... Each of the plurality of unit structures controls the opening range by controlling at least one of the following: the diameter of the microstructure, the height of the microstructure, the interval between two adjacent microstructures, or the spacing between two adjacent microstructures.

19. The optical detection device according to claim 1, wherein Each of the plurality of unit pixel group regions comprises a pixel block of pixels of multiple colors arranged in a predetermined array.

20. The optical detection device according to claim 19, wherein... The predetermined array includes a Bayer array or a quaternary array.

Images