Spectroscopic element array, imaging element, and imaging device

The use of microscopic spectroscopic elements in a two-dimensional pixel array enhances light utilization and spatial resolution in image sensors by separating light into multiple wavelength regions, addressing sensitivity and uniformity issues in conventional technologies.

JP7590657B2Active Publication Date: 2024-11-27NIPPON TELEGRAPH & TELEPHONE CORP
View PDF 25 Cites 0 Cited by

Patent Information

Application Number
JP2021551022
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Filing Date
2019-10-09
Publication Date
2024-11-27
Estimated Expiration
2039-10-09

AI Technical Summary

Technical Problem

Conventional image sensors suffer from low light utilization efficiency due to the use of color filters, which limit sensitivity and spatial resolution, especially with pixel miniaturization, and existing spectroscopic elements face issues with noise, temporal resolution, and non-uniform spatial resolution.

Method used

A two-dimensional pixel array with microscopic spectroscopic elements that separate incident light into multiple wavelength regions along two-dimensional directions, allowing direct detection without signal processing, compatible with existing manufacturing processes.

Benefits of technology

Enhances light utilization efficiency, improves sensitivity, and achieves uniform spatial resolution without altering microlens or pixel shapes, maintaining compatibility with existing imaging systems.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007590657000001
    Figure 0007590657000001
  • Figure 0007590657000002
    Figure 0007590657000002
  • Figure 0007590657000003
    Figure 0007590657000003
Patent Text Reader

Abstract

This imaging element is provided with: a two-dimensional pixel array in which a plurality of pixels including photoelectric conversion elements are arranged in an array on a substrate; a transparent layer formed on the two-dimensional pixel array; and a two-dimensional spectral element array in which a plurality of spectral elements are arranged in an array either within or on the transparent layer. Each of the spectral elements includes a plurality of fine structures formed from a material having a higher refractive index than the refractive index of the transparent layer. The plurality of fine structures have a fine structure pattern. Light incident on each of the spectral elements is separated thereby in accordance with wavelength range into first deflected light, second deflected light, third deflected light, and fourth deflected light each having a different propagation direction. First pixels, second pixels, third pixels, and fourth pixels adjacent to each other and directly below each of the spectral elements detect each of the first deflected light, the second deflected light, the third deflected light, and the fourth deflected light.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a spectroscopic element array, an image sensor, and an imaging device including the image sensor. [Background technology]

[0002] Generally, in an imaging element equipped with a photoelectric conversion element such as a CCD (Charge Coupled Device) sensor or a CMOS (Complementary Metal Oxide Semiconductor) sensor, in order to obtain color information of an object to be imaged, it is necessary to perform color separation of incident light on each pixel that includes a photoelectric conversion element.

[0003] 1 shows a cross-sectional view of a general color image sensor. In a conventional color image sensor 100, photoelectric conversion elements 102 are arranged on electrical wiring 112, and subtractive color filters 104 made of organic or inorganic materials are arranged to face each pixel including the photoelectric conversion elements 102. A microlens 103 is arranged on the color filter 104. When light is incident from the microlens 103, the color filter 104 is used to transmit only light of a desired wavelength band and absorb or reflect light of unnecessary wavelength bands, thereby obtaining signals from the three photoelectric conversion elements 102 corresponding to red (R), green (G), and blue (B) for each pixel, thereby generating a color two-dimensional image.

[0004] However, in a typical color image sensor 100 as described above, when the incident light has a ratio of 1:1:1 between RGB, the total amount of light after passing through the color filter 104 is inevitably reduced to about 1 / 3. The remaining lost light is lost due to absorption or reflection by the color filter 104 and cannot be used to construct an image. Therefore, the light utilization efficiency of the incident light is at most about 30%, and the sensitivity of the image sensor is significantly limited. In recent years, with the advancement of miniaturization of pixels (higher image resolution), the amount of light received by one pixel is inevitably reduced, and it is desirable to reduce the above-mentioned limitation on the sensitivity of the image sensor.

[0005] As an approach to alleviate the limitations of the sensitivity of the image sensor, it has been proposed to configure a color image sensor using a spectroscopic element such as a prism or a dichroic mirror capable of splitting incident light according to wavelength bands instead of the color filter 104. In principle, this approach can greatly reduce the loss of incident light, and therefore can greatly improve the light utilization efficiency compared to the case where the color filter 104 is used. However, in recent years, with the advancement of miniaturization of pixels, it is difficult to integrate a spectroscopic element such as a prism or a dichroic mirror on a photoelectric conversion element while maintaining its functions and characteristics.

[0006] In recent years, it has been proposed to configure a color imaging element using a dispersive element made of a fine structure that can be relatively easily integrated on a photoelectric conversion element. Non-Patent Document 1 proposes a method of theoretically eliminating light loss in color separation and improving light utilization efficiency by using two types of fine structures that can separate incident light into two wavelength regions.

[0007] FIG. 2(a) shows a top view of a color image sensor 200 proposed in Non-Patent Document 1, FIG. 2(b) shows a cross-sectional view of the same along line IIb-IIb, and FIG. 2(c) shows a cross-sectional view of the same along line IIc-IIc. As shown in the figure, the color image sensor 200 separates incident light into light that travels straight and light that is deflected to the left and right according to the wavelength region by fine beam structures 206-1 and 206-2 arranged corresponding to pixels (photoelectric conversion elements 102) instead of the color filters 104. This is because the phase delay effect felt by the incident light in and around the fine beam structures is significantly different in one wavelength region and is almost equal in the other wavelength region. Therefore, by alternately arranging two types of fine beam structures 206-1 and 206-2 with different structural thicknesses on a two-dimensional pixel array for each row, it becomes possible for four adjacent photoelectric conversion elements 102 to receive light having different wavelength components. As a result, a color image can be generated by performing signal processing using a matrix operation on the photoelectric conversion signals output from the respective photoelectric conversion elements 102 to reproduce color information.

[0008] In addition, non-patent document 2 proposes a method of improving light utilization efficiency by placing a binary microstructure of constant thickness, which can separate incident light into three wavelength regions, on a pixel (photoelectric conversion element 102).

[0009] FIG. 3(a) shows a top view of a color image sensor 300 having a microspectroscopic element 306 proposed in Non-Patent Document 2, and FIG. 3(b) shows a cross-sectional view taken along line IIIb-IIIb of the color image sensor 300. By using the color image sensor 300 of Non-Patent Document 2, a color image can be generated by color information reconstruction using signal processing, as in the case of using the color image sensor 200 of Non-Patent Document 1. Furthermore, the light utilization efficiency of the color image sensor 300 of Non-Patent Document 2 exceeds that of the color image sensor 200 of Non-Patent Document 1. Furthermore, the color image sensor 200 of Non-Patent Document 2 has the advantage of being free from the polarization dependency that was a problem with the color image sensor 200 of Non-Patent Document 1, and being easy to fabricate due to its binary structure. [Prior art documents] [Non-patent literature]

[0010] [Non-Patent Document 1] Seiji Nishiwaki, Tatsuya Nakamura, Masao Hiramoto, Toshiya Fujii and Masa-aki Suzuki, “Efficient color splitters for high-pixel-density image sensors,” Nature Photonics, Vol. 7, March 2013, pp.240-246 [Non-Patent Document 2] Masashi Miyata, Mitsumasa Nakajima, Toshikazu Hashimoto, “High-Sensitivity Color Imaging Using Pixel-Scale Color Splitters Based on Dielectric Metasurfaces,” ACS Photonics, March 2019, pp1442-1450

Non-Patent Document 3

Summary of the Invention

[0011] In Non-Patent Documents 1 and 2, a color reconstruction method using signal processing is proposed as a method for generating a color image. However, the techniques disclosed in Non-Patent Documents 1 and 2 have practical problems. These color image generation methods are concerned about the occurrence of color errors (noise) due to the signal processing, and there is a risk of the signal-to-noise ratio (SN ratio) of the image deteriorating. Therefore, even if the light utilization efficiency, i.e., the amount of light received by the sensor, is increased by the spectroscopic element, the SN ratio of the captured image may not improve due to the addition of new noise due to the signal processing, and there is a risk that the actual sensitivity will not be improved. Furthermore, since new signal processing time is required, there is a concern that the time resolution of the image will decrease. As disclosed in Non-Patent Document 2, it is possible to consider a form in which color information is obtained directly from the signal intensity without using signal processing by changing the shape of the microlens, which is usually a perfect circle, to an ellipse, or the shape of the pixel, which is usually a square, to a rectangle, but changing the shape of the lens or pixel is not compatible with the existing manufacturing process, post-processing, pixel arrangement, etc., and there is a risk of disturbing the uniformity of the spatial resolution of the image, so it is poorly feasible. Furthermore, both of the spectral elements disclosed in Non-Patent Documents 1 and 2 are elements that separate the color of incident light only along one axis direction on the pixel array. Therefore, the effect of optical crosstalk between pixels is significantly different between the color separation axis and the axis perpendicular thereto. This raises the concern that the effective spatial resolution of the generated color image will differ between the two axes perpendicular to each other.

[0012] The present disclosure has been made in consideration of the above-mentioned problems, and its purpose is to provide an imaging element and an imaging device that are highly sensitive and capable of generating images with uniform spatial resolution without using color reconstruction through signal processing.

[0013] In order to solve the above problems, an imaging element according to one embodiment of the present invention comprises a two-dimensional pixel array in which a plurality of pixels, each including a photoelectric conversion element, are arranged in an array on a substrate, a transparent layer formed on the two-dimensional pixel array, and a two-dimensional dispersing element array in which a plurality of dispersing elements are arranged in an array inside or on the transparent layer, each of the dispersing elements including a plurality of microstructures formed from a material having a refractive index higher than the refractive index of the transparent layer, the plurality of microstructures having a microstructure pattern, each of the dispersing elements dispersing incident light in two-dimensional directions, and the plurality of pixels respectively detect the light dispersing in the two-dimensional directions. In one embodiment, in the above-mentioned imaging element, each of the spectroscopic elements separates the incident light into first polarized light, second polarized light, third polarized light, and fourth polarized light having different propagation directions depending on the wavelength region, and adjacent first, second, third, and fourth pixels located directly below each of the spectroscopic elements detect the first polarized light, second polarized light, third polarized light, and fourth polarized light, respectively.

[0014] According to one embodiment of the present invention, by using a micro-spectroscopic element capable of separating incident light into a plurality of wavelength regions along two axial directions of a plane, it is possible to realize an image sensor and an image sensor device capable of generating an image with high sensitivity and uniform spatial resolution without using color reconstruction by signal processing. In addition, since the image sensor according to one embodiment of the present invention is compatible with the Bayer arrangement, which is a widely used pixel arrangement, it is possible to achieve high sensitivity by replacing the color filters with the micro-spectroscopic elements without significantly changing the configuration of a general color image sensor and the electronic circuitry thereafter. [Brief description of the drawings]

[0015] [Figure 1] A cross-sectional view of a typical color image sensor. [Diagram 2] FIG. 1A is a top view of a color imaging element proposed in Non-Patent Document 1, FIG. 1B is a cross-sectional view taken along line IIb-IIb of the same, and FIG. 1C is a cross-sectional view taken along line IIc-IIc of the same. [Diagram 3] FIG. 3(a) is a top view of the color imaging element proposed in Non-Patent Document 2, and FIG. 3(b) is a cross-sectional view taken along line IIIa-IIIb of FIG. [Figure 4] 1 is a side view showing a schematic configuration of an imaging device 10 according to an embodiment of the present invention. [Diagram 5] 1A is a schematic diagram showing a portion of the configuration of an image sensor 500 including a pixel array and a spectroscopic element array as viewed from above, FIG. 1B is a schematic diagram showing the Vb-Vb cross section, and FIG. 1C is a schematic diagram showing the Vc-Vc cross section. [Figure 6] 1A is a schematic diagram showing a portion of the configuration of an image sensor 600 including a pixel array and a spectroscopic element array as viewed from above, FIG. 1B is a schematic diagram showing the VIb-VIb cross section, and FIG. 1C is a schematic diagram showing the VIc-VIc cross section. [Figure 7] (a) is a diagram showing the phase delay distribution of wavelengths corresponding to a first wavelength region (R), (b) is a diagram showing the phase delay distribution of wavelengths corresponding to a second wavelength region (G), and (c) is a diagram showing the phase delay distribution of wavelengths corresponding to a third wavelength region (B). [Figure 8] 1A is a top view of an example of a microstructure constituting the microspectroscopic element 101 according to this embodiment, and FIG. 1B is a side view of the example of the microstructure. [Figure 9] 9A is a schematic diagram showing a portion of the configuration of an image sensor 900 including a pixel array and a spectroscopic element array as viewed from above, FIG. 9B is a schematic diagram showing the IXb-IXb cross section, and FIG. 9C is a schematic diagram showing the IXc-IXc cross section. [Figure 10] 1A is a schematic diagram showing a portion of the configuration of an image sensor 900 including a pixel array and a spectroscopic element array as viewed from above, FIG. 1B is a schematic diagram showing the Xb-Xb cross section, and FIG. 1C is a schematic diagram showing the Xc-Xc cross section. [Figure 11](a) is a diagram showing the phase delay distribution of wavelengths corresponding to a first wavelength region (R), (b) is a diagram showing the phase delay distribution of wavelengths corresponding to a second wavelength region (G), (c) is a diagram showing the phase delay distribution of wavelengths corresponding to a third wavelength region (B), and (d) is a diagram showing the phase delay distribution of wavelengths corresponding to a fourth wavelength region (IR). DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0016] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. However, it goes without saying that the following embodiments are merely examples and the present invention is not limited to these embodiments.

[0017] 4 is a side view showing a schematic configuration of an image pickup device 10 according to an embodiment of the present invention. The image pickup device 10 includes a lens optical system 11, an image pickup element 12, and a signal processing unit 13 that processes a photoelectric conversion signal output from the image pickup element 12 to generate an image signal.

[0018] Light such as natural light or illumination light is irradiated onto the object 1, and the light transmitted / reflected / scattered by the object 1, or the light emitted from the object 1, is passed through the lens optical system 11 to form an optical image on the image sensor 12 including a photoelectric conversion element such as a CCD or a CMOS. Generally, the lens optical system is composed of a lens group consisting of a plurality of lenses arranged along an optical axis to correct various optical aberrations, but in FIG. 4, the lens optical system is simplified and shown as a single lens. The signal processing unit 13 processes the photoelectric conversion signal output from the image sensor 12 to generate an image signal, and has an image signal output that transmits the generated image signal to the outside. The image pickup device 10 of the present invention may include known components such as an infrared light blocking optical filter, an electronic shutter, a viewfinder, a power source (battery), and a flashlight, but the description of these components is omitted because they are not particularly necessary for understanding the embodiment of the present invention. The above configuration is merely an example, and in one embodiment of the present invention, known elements can be appropriately combined and used for the components other than the lens optical system 11, the image sensor 12, and the signal processing unit 13.

[0019] Before describing the details of the embodiment of the present invention, an overview of the image sensor 12 in the embodiment of the present invention will be given. The image sensor 12 in the embodiment of the present invention includes a micro-spectroscopic element 101 and a pixel including a photoelectric conversion element 102. A plurality of pixels including the photoelectric conversion element 102 are arranged two-dimensionally to form a pixel array. A plurality of micro-spectroscopic elements 101 are arranged two-dimensionally to form a spectroscopic element array. Four adjacent pixels are partially provided at corresponding positions of one spectroscopic element. The corresponding positions of the spectroscopic elements include, for example, a state in which four adjacent pixels of the pixel array partially overlap with a projection plane that is lowered from an area occupied by the spectroscopic element to the pixel array in a direction perpendicular to the element surface.

[0020] Fig. 5(a) shows a part of the configuration of an image sensor 500 including a pixel array and a spectroscopic element array as seen from above as an example of the image sensor 12, Fig. 5(b) shows a part of the configuration of the image sensor 500 in the Vb-Vb cross section, and Fig. 5(c) shows a part of the configuration of the image sensor 500 in the Vc-Vc cross section. The spectroscopic element array faces the pixel array. The spectroscopic element array is disposed on the side where light from the lens optical system 11 is incident. A transparent layer 111 is provided between the spectroscopic element array and the pixel array and on the lens optical system 11 side of the spectroscopic element array. Electrical wiring 112 (not shown) is provided on the opposite side of the pixel array to the spectroscopic element array.

[0021] Each of the micro-spectroscopic elements 101 constituting the spectroscopic element array has a microstructure pattern with a constant thickness (length in the z-axis direction). More specifically, each of the micro-spectroscopic elements 101 has a microstructure pattern with a constant thickness but with the shapes of the upper and lower surfaces varying depending on the position of the arrangement. The thickness of the micro-spectroscopic elements 101 may be a microstructure with a different thickness depending on the position. There is no limitation on the microstructure pattern, and various arrangement forms are possible. The imaging element 12 of the embodiment of the present invention may include known components such as microlenses and light-shielding walls, but the description of these is not particularly necessary for understanding the outline of the present invention and is therefore omitted in FIGS. 5(a) to 5(c).

[0022] In the description of this embodiment, the light incident on the imaging element 12 is classified into a first wavelength region, a second wavelength region, a third wavelength region, and a fourth wavelength region according to the wavelength region. The combination of the first to fourth wavelength regions is generally a combination of three primary colors of red (R: having a light intensity peak in a red wavelength region of 600 nm or more), green (G: having a light intensity peak in a green wavelength region of 500 nm to 600 nm), and blue (B: having a light intensity peak in a blue wavelength region of 500 nm or less) and near-infrared light (IR: having a light intensity peak in a near-infrared wavelength region of 800 nm or more), but is not limited thereto. For example, the combination of the wavelength regions may be a combination of three primary colors of red (R), green (G), and blue (B) and ultraviolet light (UV: having a light intensity peak in an ultraviolet wavelength region of 380 nm or less), a combination of a plurality of wavelength regions different from each other in the wavelength region of infrared light, or a combination of a plurality of wavelength regions different from each other in the wavelength region of ultraviolet light. Alternatively, the first to third wavelength regions may be different from each other, and the fourth wavelength region may be the same as one of the first to third wavelength regions. Each of the micro-spectroscopic elements 101 constituting the spectroscopic element array in the embodiment of the present invention has a function of changing the propagation direction of light incident on the image sensor 12 according to the above-mentioned first to third wavelength regions or the first to fourth wavelength regions by utilizing a phase delay effect caused by a microstructure described later and its structural size dependency and wavelength dependency, and spatially separating the light on the pixel array. That is, in the embodiment of the present invention, the light incident on the image sensor 12 is separated into four directions, namely, a first direction (upper right), a second direction (lower right), a third direction (lower left), and a fourth direction (upper left), by each of the micro-spectroscopic elements 101, and is incident on a part of four pixels adjacent to each other. As a more detailed example, a case will be described in which the micro-spectroscopic element 101 separates red (R) in a first direction (upper right), green (G) in a second direction (lower right), blue (B) in a third direction (lower left), and infrared light (IR) in a fourth direction (upper left).Light in the red (R) wavelength region is incident as a wide light (light with wavelength components arranged) spreading in a first direction to a pixel corresponding to red (adjacent to the upper side of the pixel corresponding to green and adjacent to the right side of the pixel corresponding to infrared light) among four adjacent pixels (the angle of incidence of short wavelength light and the angle of incidence of long wavelength light are different). Light in the green (G) wavelength region is incident as a wide light (light with wavelength components arranged) spreading in a second direction to a pixel corresponding to green (adjacent to the lower side of the pixel corresponding to red and adjacent to the right side of the pixel corresponding to blue) (the angle of incidence of short wavelength light and the angle of incidence of long wavelength light are different). Light in the blue (B) wavelength region is incident as a wide light (light with wavelength components arranged) spreading in a third direction to a pixel corresponding to blue (adjacent to the left side of the pixel corresponding to green and adjacent to the lower side of the pixel corresponding to infrared light) (the angle of incidence of short wavelength light and the angle of incidence of long wavelength light are different). Light in the infrared (IR) wavelength region spreads in the fourth direction as a wide beam (light with an array of wavelength components) and enters the pixel corresponding to infrared light (adjacent to the left of the pixel corresponding to red and adjacent to the top of the pixel corresponding to blue) (the angle of incidence of short-wavelength light is different from the angle of incidence of long-wavelength light).

[0023] In addition, when four micro-spectroscopic elements 101 adjacent in two plane axial directions (x-axis direction and y-axis direction of the xy plane) are regarded as one spectroscopic unit (the spectroscopic unit is square), the spectroscopic functions of the four micro-spectroscopic elements 101 constituting one spectroscopic unit are different from each other. Specifically, one spectroscopic unit includes four types of micro-spectroscopic elements. For example, a first type of micro-spectroscopic element has a spectroscopic function of separating light in a first wavelength region, a second wavelength region, a third wavelength region, and a fourth wavelength region into a first direction (upper right), a second direction (lower right), a third direction (lower left), and a fourth direction (upper left), respectively. A second type of micro-spectroscopic element has a spectroscopic function of separating light in a first wavelength region, a second wavelength region, a third wavelength region, and a fourth wavelength region into a second direction (lower right), a first direction (upper right), a fourth direction (upper left), and a third direction (lower left), respectively. The third type of micro-spectroscopic element has a spectroscopic function of separating light in the first wavelength region, the second wavelength region, the third wavelength region, and the fourth wavelength region into the third direction (lower left), the fourth direction (upper left), the first direction (upper right), and the second direction (lower right), respectively. The fourth type of micro-spectroscopic element has a spectroscopic function of separating light in the first wavelength region, the second wavelength region, the third wavelength region, and the fourth wavelength region into the fourth direction (upper left), the third direction (lower left), the third direction (lower right), and the first direction (upper right), respectively.

[0024] Therefore, by setting the distance between the micro-spectroscopic element 101 and the pixel including the photoelectric conversion element 102 to a distance at which the light separated in the first direction (upper right) by the micro-spectroscopic element 101, the light separated in the fourth direction (upper left) by the micro-spectroscopic element adjacent to the right side of the micro-spectroscopic element 101, the light separated in the third direction (lower left) by the micro-spectroscopic element adjacent to the upper right side of the micro-spectroscopic element 101, and the light separated in the second direction (lower right) by the micro-spectroscopic element adjacent to the upper side of the micro-spectroscopic element 101 are incident on the photoelectric conversion element 102, the four pixels (photoelectric conversion elements 102) directly below each spectroscopic unit receive only light in the first, second, third, and fourth wavelength regions, respectively. When light is incident on a pixel, the photoelectric conversion element 102 outputs an electric signal (photoelectric conversion signal) according to the intensity of the incident light, so that a signal according to the wavelength region (color information if three primary colors are used) is directly acquired. The above-mentioned micro-spectroscopic elements 101 and a plurality of pixels (photoelectric conversion elements 102) corresponding to the micro-spectroscopic elements are arranged two-dimensionally, so that information for each wavelength region of the optical image of the object formed by the lens optical system can be simultaneously obtained without using special signal processing. Also, in this configuration, light is separated along two axial directions of the plane, so the effect of optical crosstalk between any two pixels is equal, and therefore an image with uniform spatial resolution can be generated.

[0025] In the first embodiment described later, the first to third wavelength regions are the three primary colors of R, G, and B, and the fourth wavelength region is the same as the second wavelength region, and the incident light is spatially separated in four directions for each of the R, G, B, and G wavelength regions by the micro-spectroscopic element 101. That is, almost all of the incident light is separated into the R, G, and B wavelength regions and is incident on four adjacent pixels (photoelectric conversion elements 102) directly below the micro-spectroscopic element 101. Note that light of the same wavelength region is incident on two of the four pixels. Therefore, color information can be directly obtained from the photoelectric conversion signal obtained from the pixel (photoelectric conversion element 102).

[0026] In addition, in the second embodiment described later, the first to third wavelength regions are the three primary colors of R, G, and B, and the fourth wavelength region is infrared light IR, and the micro-spectroscopic element 101 spatially separates the incident light into four directions for each of the wavelength regions of R, G, B, and IR. That is, almost all of the incident light is separated into the wavelength regions of R, G, B, and IR and enters four adjacent pixels (photoelectric conversion elements 102) directly below the micro-spectroscopic element 101. Note that light of different wavelength regions is incident on all four pixels. Therefore, color information and IR information can be directly obtained from the photoelectric conversion signal obtained from the pixel (photoelectric conversion element 102).

[0027] According to the image sensor 12 in the embodiment of the present invention, it is possible to obtain information on each wavelength region of an optical image of an object without using a light-attenuating bandpass filter, and without using special signal processing, by light separation for each wavelength region using the microspectroscopic element 101. That is, if the first to fourth wavelength regions are the three primary colors R, G, B, and G, a color image can be obtained. Therefore, compared with an image sensor using a color filter, it is possible to increase the total amount of light reaching the pixel array, and it is possible to increase the sensitivity of color imaging. Also, if the first to fourth wavelength regions are the three primary colors R, G, and B and IR, it is possible to simultaneously obtain an IR image with high sensitivity in addition to a color image. Furthermore, since information on each wavelength region is obtained by light separation along two plane axes on the pixel array, the influence of optical crosstalk between any pixels is equal, and an image with uniform spatial resolution can be generated, so that the problems in the techniques disclosed in Non-Patent Documents 1 and 2 can be solved. Furthermore, the image sensor 12 according to the embodiment of the present invention does not require any modification of the commonly adopted microlens shape, pixel shape, or pixel arrangement such as the Bayer arrangement, and therefore has the advantage that it is highly compatible with existing manufacturing processes and image sensing systems, and the desired effect can be obtained simply by replacing the filter with a microspectroscopic element.

[0028] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. (First embodiment) The configuration of the image sensor according to this embodiment will be outlined below. In this embodiment, the first to third wavelength regions are the three primary colors of R, G, and B, the fourth wavelength region is the same as the second region, and the incident light is split into R, G, B, and G, but the number of split wavelength regions and the wavelengths in each wavelength region are not limited to this. For example, at least one of the four wavelength regions may be light of a wavelength other than the three primary colors (for example, infrared light or ultraviolet light).

[0029] Fig. 6(a) shows a schematic diagram of a part of the schematic configuration of an image sensor 600 including a pixel array and a spectroscopic element array as seen from above as an example of the image sensor 12 according to the first embodiment, Fig. 6(b) shows a part of the configuration of the image sensor 600 in the VIb-VIb cross section, and Fig. 6(c) shows a part of the configuration of the image sensor 600 in the VIc-VIc cross section. A low-refractive index transparent layer 111 made of SiO2 or the like and a plurality of microlenses 103 are laminated on a two-dimensional pixel array in which pixels including photoelectric conversion elements 102 are arranged in an array. A micro-spectroscopic element 101 is embedded inside the low-refractive index transparent layer 111.

[0030] The micro-spectroscopic element 101 includes a plurality of microstructures formed of a material such as SiN or TiO2 having a refractive index higher than that of the transparent layer 111. The plurality of microstructures are formed to have a microstructure pattern. For convenience, in the following description, an xyz Cartesian coordinate system is set in which the normal direction of the two-dimensional pixel array is the z-axis, the horizontal direction parallel to the two-dimensional pixel array is the x-axis, and the direction perpendicular to the x-axis parallel to the two-dimensional pixel array is the y-axis.

[0031] As shown in FIGS. 6(a) to 6(c), the microlenses 103, the micro-spectroscopic elements 101, and the pixels (photoelectric conversion elements 102) are arranged in a lattice pattern with the same period on the xy plane, forming an array. One micro-spectroscopic element 101 is arranged directly below each microlens 103. In addition, the microlens array and the micro-spectroscopic element array are shifted from the arrangement of the pixel array by half the length of the array period (distance between centers) along the x-axis and y-axis, respectively. The position of the micro-spectroscopic element 101 that is half the length of the array period in the x-axis direction from the boundary with the micro-spectroscopic element adjacent in the x-axis direction and that is half the length of the array period in the y-axis direction from the boundary with the micro-spectroscopic element adjacent in the y-axis direction is set as the center of the micro-spectroscopic element 101. In this case, as shown in FIG. 6(a), the center of the micro-spectroscopic element 101 is located directly above the center of a rectangle formed by four adjacent micro-spectroscopic elements 101 that are directly below the micro-spectroscopic element 101. The micro-spectroscopic element array is composed of micro-spectroscopic elements 101 that spatially separate the incident light into three wavelength regions (R, G, B) along four directions parallel to the x-axis on a plane at ±45°. If four adjacent micro-spectroscopic elements 101 are regarded as one spectroscopic unit 601 (shown by a rectangle with two-dot dashed lines in FIG. 6(a)), the micro-spectroscopic element array can be considered as a lattice-shaped array of spectroscopic units. The four adjacent micro-spectroscopic elements 101 that constitute the spectroscopic unit are arranged such that the combinations of the four directions assigned to each of the three wavelength regions are different, and light of the same wavelength region is incident on each of the four pixels directly below the unit. Note that light of the same wavelength region is incident on two of the four pixels directly below each micro-spectroscopic element 101. The above unit may be composed of one type of micro-spectroscopic element having the same spectroscopic function rotated by 90° or inverted, or may be composed of four types of micro-spectroscopic elements 101 that respectively realize four types of spectroscopic functions.The spectroscopic unit shown in Figure 6(a) includes an element with a spectroscopic function of separating R light (solid line) in a first direction (upper right), G light (dashed line) in a second direction (lower right), B light (dash-dotted line) in a third direction (lower left), and G light (dashed line) in a fourth direction (upper left), and further includes, to the right, below, and below the element, an element obtained by rotating the element by 90 degrees counterclockwise, an element obtained by rotating the element by 90 degrees clockwise, and an element obtained by inverting the element.

[0032] In the above description, as an example, a two-dimensional pixel array consisting of square pixels (photoelectric conversion elements 102) arranged in an orthogonal lattice pattern has been described, but the arrangement, shape, size, etc. of the pixels are not limited to the example in this figure. In addition, although omitted in Figures 6(a) to 6(c), a structure having a light-condensing function due to a concavo-convex structure with a higher refractive index than a transparent layer made of SiN, TiO2, etc., which operates as an internal microlens and acts to guide light from the microspectroscopic elements 101 to the photoelectric conversion elements 102 in the pixels, may be provided between the two-dimensional pixel array and the microspectroscopic element array. The structure shown in Figures 6(a) to 6(c) can be manufactured by known semiconductor manufacturing techniques.

[0033] The imaging element 600 shown in Figures 6(a) to 6(c) has a back-illuminated structure in which light is incident from the side opposite the wiring layer in which the electrical wiring 112 is formed, but this embodiment is not limited to such a structure and may have, for example, a front-illuminated structure in which light is received from the wiring layer side.

[0034] The function of each component of the image sensor 600 according to this embodiment will be described below. White light incident on the image sensor 600 is first collected by the microlens array, and almost all of the light passes through the micro-spectroscopic elements 101 corresponding to each microlens 103. The light is spatially separated into four directions for each of three wavelength regions by each micro-spectroscopic element 101, and is received by four adjacent pixels (photoelectric conversion elements 102) directly below each micro-spectroscopic element 101. Due to the configuration of the spectroscopic unit, light in any of the wavelength regions of R, G, and B is incident on each pixel of the pixel array directly below the micro-spectroscopic element array, and each pixel corresponds to detection of color information of any of R, G, and B. Note that the example of FIGS. 6(a) to 6(c) is an example conforming to a Bayer arrangement in which, when four pixels are considered as one pixel unit, the four pixels correspond to R, G, G, and B light, respectively. Depending on the configuration of each micro-spectroscopic element 101, the combination of color components and propagation directions can be freely changed, and the arrangement of the pixels corresponding to each of RGB is also changed accordingly. Finally, the photoelectric conversion is performed by the photoelectric conversion element 102 in each pixel, and the image signal containing color information is output.

[0035] It should be noted that a structure having a light-collecting function based on an uneven structure having a higher refractive index than a transparent layer made of SiN, TiO2, or the like that acts as an internal microlens may be provided between the pixel array and the microspectroscopic element 101. However, since the microspectroscopic element 101 described later can have a lens function depending on the phase delay distribution it forms, it is also possible to omit the internal microlens.

[0036] The microspectroscopic element 101 in this embodiment will be described below. In order for the micro-spectroscopic element 101 to spatially separate the incident light into three wavelength regions (R, G, B) along the four directions mentioned above, it is necessary to give the light passing through one micro-spectroscopic element 101 a different phase delay distribution for each wavelength region, thereby changing the optical wavefront.

[0037] 7(a) to 7(c) are examples of phase delay distributions possessed by the micro-spectroscopic element 101 capable of realizing the above-mentioned spectroscopic characteristics. In this example, as shown in FIG. 7(a), the phase delay distribution of the wavelength corresponding to the first wavelength region (R) forms a distribution in which the phase delay amount increases linearly from 0 to 2π from the lower left to the upper right, as shown in FIG. 7(b), the phase delay distribution of the wavelength corresponding to the second wavelength region (G) forms a distribution in which the phase delay amount increases linearly from 0 to π from the upper left to the center and decreases linearly from π to 0 from the center to the lower right, as shown in FIG. 7(c), the phase delay distribution of the wavelength corresponding to the third wavelength region (B) forms a distribution in which the phase delay amount increases linearly from 0 to 2π from the upper right to the lower left. Light transmitted through an element having such a phase delay distribution propagates while being deflected in the upper right direction for the first wavelength region (R), in the upper left and lower right directions for the second wavelength region (G), and in the lower left direction for the third wavelength region (B). The above description is merely an example, and the combination of wavelength regions and propagation directions can be freely changed depending on the phase delay distribution. The above-mentioned phase delay distribution can be realized by appropriately designing the material, number, shape, size, pattern, etc. of the microstructures, as described below. That is, the microspectroscopic element 101 in this embodiment arranges microstructures on a two-dimensional plane, gives different light wavefronts to the incident light according to the wavelength region, and spatially separates the color components.

[0038] FIG. 8(a) shows the top surface of an example of a microstructure constituting the microspectroscopic element 101 in this embodiment, and FIG. 8(b) shows a side view of the microstructure. A columnar structure 121, which is an example of a microstructure, is made of a material such as SiN or TiO2 having a refractive index n1 higher than the refractive index n0 of the transparent layer 111, and the thickness h of the structure is constant. The bottom and top surfaces of the columnar structure 121 are square. Due to the refractive index difference between the transparent layer 111 and the columnar structure 121, the columnar structure 121 can be considered as an optical waveguide that confines light within the structure and propagates it. Therefore, light incident from the top side propagates while being strongly confined within the columnar structure 121, and the effective refractive index n of the optical waveguide is n effIt is emitted from the bottom surface side under the influence of the phase delay effect determined thereby. Specifically, when the phase of the light that has propagated through the transparent layer 111 for a length equal to the thickness of the structure is taken as a reference, the phase delay amount φ caused by the columnar structure 121 is expressed by Equation (1), where λ is the wavelength of the light in a vacuum. φ=(n eff -n0)×2πh / λ ···(1) Since this phase delay amount φ varies depending on the wavelength λ of the light, in the same columnar structure 121, different phase delay amounts can be given to the light according to the wavelength region (color component). Furthermore, n eff is known to be a function of the width w of the columnar structure 121, and takes a value of n0 < n eff < n1. Therefore, in the examples shown in FIGS. 8(a) and 8(b), by changing the width w of the columnar structure 121, it is possible to set various combinations of phase delay amounts according to the wavelength λ of the light. Also, since the bottom and top surfaces of the columnar structure 121 are square, even when the polarization (polarization wave) direction of the incident light is changed, there is no change in the optical characteristics including the phase delay effect.

[0039] By setting the width w of each columnar structure 121 according to the position so as to conform to the phase delay distribution described above with reference to FIGS. 7(a) to 7(c) for the above-described structure, and arranging a plurality of them on a two-dimensional plane, the micro-spectroscopic element in the present embodiment can be realized. Also, in the arrangement of each of the above-described columnar structures 121, in order to prevent the generation of unnecessary diffracted light due to the periodic structure, it is desirable to arrange them at intervals less than the wavelength of the light. Note that, in order to efficiently deflect the light, a distribution in which the phase delay distribution changes from 0 to 2π is suitable. Therefore, in each wavelength range, it is preferable that the variable range of the phase delay amount caused by the columnar structure 121 with a constant thickness has 2π or more. Therefore, from Equation (1), if the desired central wavelength in the longest wavelength range of the separated wavelength ranges is λ r then the thickness h of the structure is h = λ rIt is desirable to set the value to be equal to or larger than n1-n0. In the above example, the bottom and top surfaces of the columnar structure 121 are described as being square, but the shape is not limited to this. In other words, as long as the surface shape includes four-fold rotational symmetry with the center of the surface as the axis of symmetry, the spectroscopic function does not depend on the polarization, and the operation as an optical waveguide that brings about a phase delay effect is not lost. Therefore, it is desirable to adopt a columnar structure having a surface with four-fold rotational symmetry, such as a square, a hollow square, a circle, a hollow circle, or a cross shape. A micro-spectroscopic element made of such a fine structure with a constant thickness is disclosed in, for example, Non-Patent Document 2.

[0040] Moreover, the micro-spectroscopic element 101 in this embodiment is not limited to the above-mentioned columnar structure 121, and various forms of microstructures can be used. For example, as disclosed in Non-Patent Document 3, a micro-structure having a constant thickness and a structural pattern optimized by a computer can form a phase delay distribution for each wavelength region by the same principle as the above-mentioned principle, and can spatially separate color components. Furthermore, according to formula (1), by changing the thickness h of the structure in addition to the width w of the columnar structure 121, it is possible to set a wider variety of combinations of phase delay amounts according to the wavelength λ of light. Therefore, the micro-spectroscopic element in this embodiment can be realized by setting the width w and thickness h of the micro-structure according to the position where the micro-structure is arranged so as to match the above-mentioned phase delay distribution, and arranging a plurality of them on a two-dimensional plane.

[0041] The micro-spectroscopic element 101 having the above-mentioned spectroscopic function can be fabricated by performing thin film deposition and patterning using known semiconductor manufacturing techniques.

[0042] As described above, it is possible to provide desired spectral characteristics by appropriately designing the material, number, shape, size, pattern, etc. of the structure constituting the micro-spectroscopic element. As a result, as described above, it is possible to separate and input light of a desired wavelength region to each pixel, and a signal corresponding to the wavelength region can be directly obtained from the photoelectric conversion signal output from the photoelectric conversion element in each pixel. In addition, if the material constituting the micro-spectroscopic element is low-loss, there is almost no light loss, so compared to an imaging element using a filter of the conventional technology, the total amount of light reaching the pixel array can be dramatically increased, and the sensitivity of color imaging can be increased. In addition, since information on each wavelength region is obtained by light separation along two plane axial directions on the pixel array, it is possible to generate an image with uniform spatial resolution with the same influence of optical crosstalk between any pixels. In addition, in this embodiment, an imaging element using the form of a single spectroscopic element array will be described, but it is also possible to realize an imaging element using a form in which multiple spectroscopic element arrays are stacked in the z-axis direction instead of a single spectroscopic element array. That is, the micro-spectroscopic element 101 constituting a single spectroscopic element array may disperse the incident light in two-dimensional directions (two axial directions on a plane), or multiple micro-spectroscopic elements stacked in the light propagation direction (z-axis direction) may disperse the incident light in two-dimensional directions. Even if the spectroscopic performance of each micro-spectroscopic element is somewhat different from the above-mentioned ideal performance, it is possible to obtain good color information by correcting and calculating the acquired signal according to the degree of the difference in performance.

[0043] In order to minimize optical crosstalk between pixels on the pixel array after the color components are separated by the micro-spectroscopic element, it is desirable for each separated light to be incident on the vicinity of the center of each pixel. Therefore, if the angle between the propagation direction of the light deflected by the micro-spectroscopic element and the normal direction of the pixel array is θ and the period of the pixel array is P, the distance between the output end of the micro-spectroscopic element and the photoelectric conversion element is 2 0.5 It is preferably in the vicinity of P / tan θ.

[0044] In the above description, the imaging element is described using only the microspectroscopic element. Next, a modified example in which a subtractive color filter is also used will be described.

[0045] 9(a) shows an image sensor 900 including a pixel array and a spectroscopic element array according to a modified example of this embodiment, FIG. 9(b) shows a part of the configuration of the image sensor 900 in the IXb-IXb cross section, and FIG. 9(c) shows a part of the configuration of the image sensor 900 in the IXc-IXc cross section. The difference from the image sensor 600 shown in FIGS. 6(a) to 6(c) is that color filters 104 corresponding to the colors of the pixels are provided above the pixels corresponding to the color components. R , 104 G , 104 B The difference is that the micro-spectroscopic element 101 is arranged in the same manner as the micro-spectroscopic element 101, and the other parts are the same. In this configuration, the incident light is color-separated by the micro-spectroscopic element 101, and then filtered by the color filter 104 directly above the pixel (photoelectric conversion element 102). In this case, since the light passes through the color filter 104 after color separation, the light utilization efficiency is improved compared to the conventional configuration of only color filters, but since the light must pass through two elements, the light utilization efficiency is reduced compared to the configuration of only the micro-spectroscopic element 101. In addition, the spectral characteristics of the micro-spectroscopic element 101 and the filtering characteristics of the color filter 104 are multiplied, and the light enters each pixel in a state in which unnecessary color components are more effectively removed, so that the color reproducibility is greatly improved compared to the configuration of only the color filter 104 and the configuration of only the micro-spectroscopic element 101. Therefore, it can be said that the configuration has a good balance between the light utilization efficiency, that is, the sensitivity and the color reproducibility.

[0046] Second embodiment Next, an outline of the configuration of an image sensor according to a second embodiment of the present invention will be described. FIG. 10(a) shows a schematic diagram of a part of the schematic configuration of an image sensor 1000 including a pixel array and a spectroscopic element array as seen from above as an example of the image sensor 12, FIG. 10(b) shows a part of the configuration of the image sensor 1000 in the Xb-Xb cross section, and FIG. 10(c) shows a part of the configuration of the image sensor 1000 in the Xc-Xc cross section. As is clear from FIGS. 10(a) to 10(c), the image sensor 1000 of this embodiment and the imaging device 10 using the image sensor 1000 are different from the image sensor of the first embodiment in that the first to fourth wavelength regions are the three primary colors of R, G, and B and infrared light (IR), and the micro spectroscopic element 101 spatially separates incident light in four directions for each of the R, G, B, and IR wavelength regions. Therefore, the four pixels (photoelectric elements 102) directly below the micro spectroscopic element 101 are separated into the R, G, B, and IR wavelength regions. R , 102 G , 102 B , 102 IR ) The other components are the same as those of the image sensor of the first embodiment. The following description will focus on the differences from the first embodiment, and a description of overlapping points will be omitted.

[0047] As shown in Figs. 10(a) to 10(c), the microlenses 103, the micro-spectroscopic elements 101, and the pixels (photoelectric conversion elements 102) are arranged in a lattice pattern with the same period on the xy plane, forming an array, and one micro-spectroscopic element 101 is arranged on the central axis of each microlens 103. The microlens array and the micro-spectroscopic element array are shifted from the pixel array arrangement by half the length of the array period along the x-axis and y-axis, respectively. The micro-spectroscopic element array is composed of micro-spectroscopic elements 101 that spatially separate the incident light into four wavelength regions (R, G, B, IR) along four directions parallel to the x-axis at ±45°. If four adjacent micro-spectroscopic elements are considered as one spectroscopic unit (shown by a two-dot dashed rectangle in Fig. 10(a)), the micro-spectroscopic element array can be considered as a spectroscopic unit arrayed in a lattice pattern. The micro-spectroscopic elements 101 constituting the spectroscopic unit are arranged such that the combinations of the four directions assigned to each of the four wavelength regions are different, and light of the same wavelength region is incident on each of the four pixels directly below the unit. Note that light of different wavelength regions is incident on all four pixels. The above unit may be configured by rotating or inverting one type of micro-spectroscopic element having the same spectroscopic function by 90°, or may be configured by four types of micro-spectroscopic elements 101 each realizing one of the four types of spectroscopic functions. The spectroscopic unit shown in Figure 10(a) includes an element with a spectroscopic function that separates R light (solid line) in a first direction (upper right), G light (dashed line) in a second direction (lower right), B light (dash-dotted line) in a third direction (lower left), and IR light (dash-dotted line) in a fourth direction (upper left), and further includes, to the right, below, and below the element, an element obtained by rotating the element by 90 degrees counterclockwise, an element obtained by rotating the element by 90 degrees clockwise, and an element obtained by inverting the element.

[0048] White light incident on the image sensor 1000 is first collected by the microlens array, and almost all of the light passes through the micro-spectroscopic element 101 corresponding to each microlens 103. Each micro-spectroscopic element 101 spatially separates the light into four directions for each of the four wavelength regions, and each of the four pixels (photoelectric conversion elements 102) directly below each micro-spectroscopic element 101 receives the light. Due to the configuration of the spectroscopic unit, each pixel of the pixel array directly below the micro-spectroscopic element array receives light in any of the wavelength regions of R, G, B, and IR, and therefore each pixel corresponds to detection of any of the wavelength region information of R, G, B, and IR. Depending on the configuration of each micro-spectroscopic element 101, the combination of the wavelength region and the propagation direction can be freely changed, and the arrangement of the pixels corresponding to R, G, B, and IR is also changed accordingly. Finally, photoelectric conversion is performed by the photoelectric conversion element 102 in each pixel, and an image signal including color information and IR information is output.

[0049] 11(a) to 11(c) are examples of phase delay distributions that realize spatial separation of four wavelength regions (R, G, B, IR) of incident light. In this example, as shown in FIG. 11(a), the phase delay distribution of the wavelength corresponding to the first wavelength region (R) forms a distribution in which the phase delay amount increases linearly from 0 to 2π from the lower left to the upper right, as shown in FIG. 10(b), the phase delay distribution of the wavelength corresponding to the second wavelength region (G) forms a distribution in which the phase delay amount increases linearly from 0 to 2π from the upper left to the lower right, as shown in FIG. 10(c), the phase delay distribution of the wavelength corresponding to the third wavelength region (B) forms a distribution in which the phase delay amount increases linearly from 0 to 2π from the upper right to the lower left, as shown in FIG. 10(d), the phase delay distribution of the wavelength corresponding to the fourth wavelength region (IR) forms a distribution in which the phase delay amount increases linearly from 0 to 2π from the lower right to the upper left. The light transmitted through the element having such a phase delay distribution propagates while being deflected in the following directions: the first wavelength region (R) is deflected in the upper right direction, the second wavelength region (G) is deflected in the lower right direction, the third wavelength region (B) is deflected in the lower left direction, and the fourth wavelength region (IR) is deflected in the upper left direction. Note that the above description is only an example, and the combination of wavelength region and propagation direction can be freely changed depending on the phase delay distribution. The above-mentioned phase delay distribution can be realized by appropriately designing the material, number, shape, size, pattern, etc. of the microstructures, as in the imaging element of the first embodiment.

[0050] As described above, in the configuration of this embodiment, it is possible to simultaneously obtain IR information in addition to color information. This embodiment is otherwise similar to the first embodiment, has the same effects as those described in the first embodiment, and can be modified in the same manner.

[0051] The above-mentioned first embodiment and second embodiment are merely preferred specific examples of the present invention, and the present invention is not limited to these, and various modifications are possible.

[0052] In the above-mentioned first and second embodiments, examples assuming SiN and TiO2 as materials for the micro-spectroscopic element are shown, but the present invention is not limited thereto. For example, when the imaging element according to the embodiment of the present invention is used in the visible light to near-infrared light region with a light wavelength in the range of 380 to 1000 nm, materials such as SiN, SiC, TiO2, and GaN are suitable as materials for the micro-spectroscopic element because they have a high refractive index and little absorption loss. For near-infrared light with a wavelength in the range of 800 to 1000 nm, materials such as Si, SiC, SiN, TiO2, GaAs, and GaN are suitable as materials with low loss for this light. Furthermore, in the near-infrared region of long wavelength bodies (such as 1.3 μm and 1.55 μm, which are communication wavelengths), InP and the like can be used in addition to the above-mentioned materials. Furthermore, when forming a micro-spectroscopic element by pasting and coating, examples of materials include polyimide such as fluorinated polyimide, BCB (benzocyclobutene), photocurable resin, UV epoxy resin, acrylic resin such as PMMA, and polymers such as general resists.

[0053] In the first and second embodiments, an example was shown in which SiO2 was assumed as the material for the transparent layer 111, but the present invention is not limited to this. Any material, such as a general glass material, SiO2, or an air layer, may be used as long as it has a refractive index lower than that of the material for the microspectroscopic element 101 and has low loss with respect to the wavelength of the incident light.

[0054] The above describes an imaging element according to an embodiment of the present invention and an imaging device using the imaging element. However, the present invention is not limited to the above-described embodiment, and various modifications are possible without departing from the spirit and scope of the present invention.

Claims

1. a two-dimensional pixel array in which a plurality of pixels, each including a photoelectric conversion element, are arranged in an array on a substrate; a transparent layer formed on the two-dimensional pixel array; a two-dimensional spectroscopic element array in which a plurality of spectroscopic elements are arranged in an array inside or on the transparent layer; An imaging element comprising: an imaging element, wherein each of the dispersive elements includes a plurality of microstructures formed from a material having a refractive index higher than the refractive index of the transparent layer, the plurality of microstructures have a microstructure pattern, the plurality of microstructures are columnar structures having faces that are four-fold rotationally symmetric with respect to a center as an axis of symmetry, a plurality of dispersive element units are adjacent to each other in a two-dimensional direction, each of the dispersive element units is composed of four dispersive elements in the two-dimensional dispersive element array, the four dispersive elements are adjacent to each other in the two-dimensional direction, the four dispersive elements of each of the dispersive element units are one type of dispersive element rotated by 90 degrees or inverted, each of the dispersive elements disperses incident light in a two-dimensional direction, and the plurality of pixels detect the light dispersed in the two-dimensional direction.

2. each of the dispersive elements separates the incident light into a first polarized light, a second polarized light, a third polarized light, and a fourth polarized light having different propagation directions according to a wavelength region; 2. The imaging element according to claim 1, wherein a first pixel, a second pixel, a third pixel, and a fourth pixel adjacent to each other and located directly below each of the spectroscopic elements detect the first polarized light, the second polarized light, the third polarized light, and the fourth polarized light, respectively.

3. a center of each of the light-splitting elements is located directly above a center of a rectangle formed by the first pixel, the second pixel, the third pixel, and the fourth pixel that are adjacent to each other and located directly below each of the light-splitting elements, wavelength regions of the first pixel, the second pixel, the third pixel, and the fourth pixel that are adjacent to each other correspond to wavelength regions of the first polarized light, the second polarized light, the third polarized light, and the fourth polarized light detected by the first pixel, the second pixel, the third pixel, and the fourth pixel, respectively; The image sensor according to claim 2 , wherein at least three of the first, second, third and fourth deflected lights have wavelength regions different from each other.

4. The image sensor according to claim 2 , wherein the plurality of microscopic structures in each of the dispersive elements have a constant thickness in a direction in which light passes.

5. The image sensor according to claim 2 , wherein the plurality of microscopic structures in each of the dispersive elements have thicknesses in a light transmitting direction that differ depending on positions.

6. When the incident light is white light, the light incident on the first pixel has a peak of light intensity in a blue wavelength region having a wavelength of 500 nm or less; the light incident on the second pixel and the third pixel has a peak of light intensity in a green wavelength region of 500 nm to 600 nm; The image sensor according to claim 2 , wherein the light incident on the fourth pixel has a peak of light intensity in a red wavelength region having a wavelength of 600 nm or more.

7. When the incident light is white light, the light incident on the first pixel has a peak of light intensity in a blue wavelength region having a wavelength of 500 nm or less; the light incident on the second pixel has a peak of light intensity in a green wavelength region of 500 nm to 600 nm; the light incident on the third pixel has a peak of light intensity in a red wavelength region of 600 nm to 800 nm; The image sensor according to claim 2 , wherein the light incident on the fourth pixel has a peak of light intensity in a near-infrared wavelength range of 800 nm or more.

8. A filter array is further provided between the two-dimensional pixel array and the two-dimensional spectroscopic element array, The filter array comprises: A first filter having a transmittance peak in a blue wavelength region having a wavelength of 500 nm or less; A second filter having a transmittance peak in a green wavelength region of 500 nm to 600 nm; A third filter having a transmittance peak in a red wavelength region of 600 nm to 800 nm; and a fourth filter having a transmittance peak in a near-infrared wavelength region having a wavelength of 800 nm or more; The imaging device according to claim 6 or 7, comprising at least one of the following:

9. The imaging device according to claim 1 , an imaging optical system for forming an optical image on an imaging surface of the imaging element; a signal processing unit that processes an electrical signal output by the imaging element; An imaging device comprising:

10. A two-dimensional spectroscopic element array in which a plurality of spectroscopic elements are arranged in an array inside or on a transparent layer, a spectroscopic element array, wherein each of the dispersive elements includes a plurality of microstructures formed from a material having a refractive index higher than the refractive index of the transparent layer, the plurality of microstructures have a microstructure pattern, the plurality of microstructures are columnar structures having faces that are four-fold rotationally symmetric with respect to a center as an axis of symmetry, a plurality of dispersive element units are adjacent to each other in a two-dimensional direction, each of the dispersive element units is composed of four dispersive elements in the two-dimensional dispersive element array, the four dispersive elements are adjacent to each other in the two-dimensional direction, the four dispersive elements of each of the dispersive element units are one type of dispersive element rotated by 90 degrees or inverted, and each of the dispersive elements disperses incident light in a two-dimensional direction.

Citation Information

Patent Citations

  • Optical device and spectrometer comprising such a device

    EP3543665A1

  • color liquid crystal display

    JP1993249318A

  • Color filter and color image display device

    JP1997189809A

  • Color filter and color image display device

    JP1999211912A

  • Solid-state image pickup element

    JP2003243640A