Light detection device

By designing multiple pixel groups and nanostructures in the photodetector, efficient detection of light in different wavelength ranges is achieved, the problem of insufficient detection performance in the prior art is solved, and the sensitivity and image quality of the light detection device are improved.

CN118922943APending Publication Date: 2024-11-08SONY SEMICON SOLUTIONS CORP
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202380029749.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2022-04-04
Filing Date
2023-03-16
Publication Date
2024-11-08

AI Technical Summary

Technical Problem

The existing light detection devices have insufficient detection performance and are difficult to effectively detect light in different wavelength ranges.

Method used

A photodetector is designed, including multiple pixels, where each pixel group is responsible for sensing light in a specific wavelength range and dispersing and redirecting light through nanostructures, ensuring that each pixel can effectively receive and convert different wavelengths. optical signal.

Benefits of technology

The sensitivity and resolution of the light detection device are improved, efficient detection performance of light in different wavelength ranges is achieved, and image quality and quantum efficiency are improved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118922943A_ABST
    Figure CN118922943A_ABST
Patent Text Reader

Abstract

A light detection device includes a plurality of pixels including a first pixel group sensing light of a first wavelength range, a second pixel group sensing light of a second wavelength range different from the first wavelength range, and a first layer including a first nanostructure over the first pixel group to redirect the light. The second pixel group is arranged between the pixels of the first pixel group.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims the benefit of Japanese Priority Patent Application JP 2022-062598 filed on Apr. 4, 2022, the entire contents of which are incorporated herein by reference. Technical Field

[0003] The present disclosure relates to a light detection device. Background Art

[0004] There has been proposed a device including a meta-optical element which is a diffraction element using a nanostructure having a sub-wavelength shape size (Patent Document 1).

[0005] [Citation list]

[0006] [Patent Document]

[0007] [Patent Document 1]: Japanese Unexamined Patent Application Publication No. 2021-140152 Summary of the invention

[0008] [Technical issues]

[0009] There is a need for light detection devices with improved detection performance.

[0010] It is desirable to provide a light detection device having good detection performance.

[0011] [Solution to the problem]

[0012] A photodetector according to an embodiment of the present disclosure includes a plurality of first pixels, a plurality of second pixels, and a plurality of third pixels. The plurality of first pixels respectively include a light scattering portion and a first photoelectric conversion portion. The light scattering portion includes a structure whose size is equal to or smaller than the wavelength of the incident light. The first photoelectric conversion portion receives light of a first wavelength that passes through the light scattering portion for photoelectric conversion. The plurality of second pixels are arranged between the plurality of first pixels, and respectively include a second photoelectric conversion portion that receives light of a second wavelength for photoelectric conversion. The plurality of third pixels are arranged between the plurality of first pixels, and respectively include a third photoelectric conversion portion that receives light of a third wavelength for photoelectric conversion. A light detection device according to an embodiment of the present disclosure includes a plurality of pixels, the plurality of pixels including: a first pixel group that senses light of a first wavelength range; a second pixel group that senses light of a second wavelength range different from the first wavelength range; and a first layer that includes a first nanostructure located above the first pixel group to redirect light. The second pixel group is arranged between pixels of the first pixel group. An electronic device may include a light detection device and a signal processor. The light detection device according to the embodiment of the present disclosure includes a plurality of pixels, the plurality of pixels including: a first pixel group that senses light of a first wavelength range; a second pixel group that senses light of a second wavelength range different from the first wavelength range; and a first layer that includes a first nanostructure located above the first pixel group to guide light to a photoelectric conversion region of the second pixel group. All sides of the second pixel group are surrounded by pixels of the first pixel group. BRIEF DESCRIPTION OF THE DRAWINGS

[0013] Figure 1 is a diagram showing an example of a schematic configuration of an image pickup device which is an example of a photodetector according to an embodiment of the present disclosure.

[0014] Figure 2 is a diagram showing an example of a pixel arrangement of an image pickup device according to an embodiment of the present disclosure.

[0015] Figure 3 : is a diagram showing an example of a cross-sectional configuration of an image pickup device according to an embodiment of the present disclosure.

[0016] Figure 4A It is an explanatory diagram of an example of zoom processing of the imaging device according to the embodiment of the present disclosure.

[0017] Figure 4B It is an explanatory diagram of an example of zoom processing of the imaging device according to the embodiment of the present disclosure.

[0018] Figure 4C It is an explanatory diagram of an example of zoom processing of the imaging device according to the embodiment of the present disclosure.

[0019] Figure 5 1 is a diagram showing an example of a cross-sectional configuration of an image pickup device according to Modification 1 of the present disclosure.

[0020] Figure 6 1 is a diagram showing an example of a cross-sectional configuration of an image pickup device according to Modification 1 of the present disclosure.

[0021] Figure 7 1 is a diagram showing another example of the cross-sectional configuration of the imaging device according to Modification 1 of the present disclosure.

[0022] Figure 8 : is a diagram showing an example of a cross-sectional configuration of an image pickup device according to Modification 2 of the present disclosure.

[0023] Fig. 9 1 is a diagram showing another example of the cross-sectional configuration of the imaging device according to Modification 2 of the present disclosure.

[0024] Fig.10 1 is a diagram showing another example of the cross-sectional configuration of the imaging device according to Modification 2 of the present disclosure.

[0025] Fig.11 1 is a diagram showing an example of a cross-sectional configuration of an image pickup device according to Modification 3 of the present disclosure.

[0026] Fig.12 It is a diagram showing another example of the cross-sectional configuration of the imaging device according to Modification 3 of the present disclosure.

[0027] Fig.13 It is a diagram showing another example of the cross-sectional configuration of the imaging device according to Modification 3 of the present disclosure.

[0028] Fig.14 It is a diagram showing another example of the cross-sectional configuration of the imaging device according to Modification 3 of the present disclosure.

[0029] Fig.15A It is a diagram showing another example of the cross-sectional configuration of the imaging device according to Modification 3 of the present disclosure.

[0030] Fig. 15B It is a diagram showing another example of the cross-sectional configuration of the imaging device according to Modification 3 of the present disclosure.

[0031] Fig.16 : is a diagram showing an example of a pixel arrangement of an image pickup device according to Modification 4 of the present disclosure.

[0032] Fig.17 is a diagram showing another example of the pixel arrangement of the image pickup device according to Modification 4 of the present disclosure.

[0033] Fig.18: is a diagram showing an example of pixel arrangement of an image pickup device according to Modification 5 of the present disclosure.

[0034] Fig.19 This is a block diagram showing a configuration example of an electronic device including an imaging device.

[0035] Fig. 20 is a block diagram showing an example of a schematic configuration of a vehicle control system.

[0036] Fig.21 It is a diagram for assisting in explaining an example of the installation positions of the vehicle exterior information detection unit and the imaging unit.

[0037] Fig. 22 : is a diagram showing an example of a schematic configuration of an endoscopic surgery system.

[0038] Fig.23 is a block diagram showing an example of the functional configuration of a camera head and a camera control unit (CCU). DETAILED DESCRIPTION

[0039] Hereinafter, embodiments of the present disclosure are described in detail with reference to the accompanying drawings. It should be noted that the description is given in the following order.

[0040] 1. Implementation Plan

[0041] 2. Modifications

[0042] 3. Application examples

[0043] 4. Application examples

[0044] <1. Implementation Plan>

[0045] Figure 1 1 is a diagram showing an example of a schematic configuration of an imaging device, which is an example of a photodetector according to an embodiment of the present disclosure. An imaging device 1 as a photodetector is a device for detecting incident light. An imaging device (also referred to herein as a photodetector or a light detecting device) 1 includes a plurality of pixels P each having a light receiving element and is configured to perform photoelectric conversion on incident light to generate a signal.

[0046] exist Figure 1 In the example shown, the imaging device 1 includes a region (pixel section 100) in which a plurality of pixels P are two-dimensionally arranged in a matrix as an imaging region. For example, the light receiving element (light receiving section) of each pixel P is a photodiode. The light receiving element receives light and can generate electric charge by photoelectric conversion.

[0047] The imaging device 1 receives incident light (image light) from a subject via an optical system (not shown) including an optical lens. The imaging device 1 captures an image of the subject formed by the optical lens system. The imaging device 1 performs photoelectric conversion on the received light to generate a pixel signal. It should be noted that the imaging device 1 as a photodetector is a device capable of receiving incident light to generate a signal; the imaging device 1 may also be referred to as a light receiving device. For example, the imaging device 1 may be used in electronic devices such as a digital camera, a video camera, or a mobile phone.

[0048] [Schematic Configuration of the Image Capture Device]

[0049] For example, the image pickup device 1 includes a vertical drive section 111, a signal processing section 112, a control section 113, a processing section 114, etc. in the peripheral area of ​​the pixel section 100. In addition, for example, the image pickup device 1 is provided with a plurality of pixel drive lines Lread and a plurality of vertical signal lines VSL.

[0050] For example, in the pixel section 100, a plurality of pixel drive lines Lread are arranged for each pixel row composed of a plurality of pixels P arranged in the horizontal direction (row direction). In addition, in the pixel section 100, a vertical signal line VSL is arranged for each pixel column composed of a plurality of pixels P arranged in the vertical direction (column direction). The pixel drive line Lread is configured to transmit a drive signal to read a signal from the pixel P. The vertical signal line VSL is configured to transmit a signal output from the pixel P.

[0051] The vertical driving section 111 is composed of a shift register, an address decoder, and the like. The vertical driving section 111 is configured to drive each pixel P of the pixel section 100. The vertical driving section 111 as a pixel driving section generates a signal for driving the pixel P, and outputs the signal to each pixel P of the pixel section 100 via a pixel driving line Lread. For example, the vertical driving section 111 generates a signal for controlling a transfer transistor, a signal for controlling a reset transistor, and the like, and supplies the signal to each pixel P via the pixel driving line Lread.

[0052] The signal processing section 112 is configured to perform signal processing on the input pixel signal. For example, the signal processing section 112 includes a load circuit section, an AD converter section, a horizontal selection switch, etc. The load circuit section is connected to the vertical signal line VSL and constitutes a source follower circuit together with the amplifying transistor of the pixel P. It should be noted that the signal processing section 112 may include an amplifying circuit section configured to amplify the signal read from the pixel P via the vertical signal line VSL.

[0053] The signal output from each pixel P selected and scanned by the vertical drive section 111 is provided to the signal processing section 112 through the vertical signal line VSL. For example, the signal processing section 112 performs signal processing such as analog-to-digital (AD) conversion and correlated double sampling (CDS). The signal of each pixel P transmitted through each vertical signal line VSL is subjected to signal processing by the signal processing section 112 and then output to the processing section 114.

[0054] The processing unit 114 is configured to perform signal processing on the input signal. For example, the processing unit 114 is composed of a circuit that performs various types of signal processing on the pixel signal. The processing unit 114 may include a processor and a memory. The processing unit 114 may perform various types of signal processing on the signal of each pixel and generate image data (image signal). The processing unit 114 may also be referred to as an image signal processing unit. For example, the processing unit 114 may perform signal processing such as noise reduction processing or grayscale correction processing.

[0055] The control section 113 is configured to control each part of the image pickup device 1. The control section 113 can receive a clock signal provided from the outside, data for commanding an operation mode, and the like, and output data such as internal information about the image pickup device 1. The control section 113 includes a timing generator, and controls the driving of the vertical driving section 111 and the signal processing section 112 based on various timing signals (pulse signals, clock signals, and the like). It should be noted that the control section 113 and the processing section 114 may be integrally configured.

[0056] Figure 2 1 is a diagram showing an example of a pixel arrangement of an image pickup device according to an embodiment. The pixel P of the image pickup device 1 includes a color filter 40. It should be noted that Figure 2 As shown, the incident direction of light from the subject is defined as the Z-axis direction, the horizontal direction on the paper orthogonal to the Z-axis direction is defined as the X-axis direction, and the vertical direction on the paper orthogonal to the Z-axis and the X-axis is defined as the Y-axis direction. In the subsequent drawings, in some cases, the directions may refer to Figure 2 Indicated by the direction of the arrow.

[0057] The color filter 40 is configured to selectively transmit light of a specific wavelength region (or wavelength range) of incident light. For example, each pixel includes a photodiode PD as a photoelectric conversion portion (also referred to as a photoelectric conversion region). Figure 2 As shown, the plurality of pixels P provided in the pixel section 100 of the image pickup device 1 include a plurality of pixels Pr, a plurality of pixels Pg, and a plurality of pixels Pb. In the pixel section 100, the plurality of pixels Pr, the plurality of pixels Pg, and the plurality of pixels Pb are repeatedly arranged.

[0058] Pixel Pr is a pixel provided with a color filter 40 that transmits red (R) light. The red color filter 40 transmits light in the red wavelength region. The photoelectric conversion unit of the pixel Pr receives light of a red wavelength for photoelectric conversion. The pixel Pr is a pixel that receives light of a red wavelength region to generate a signal. In addition, pixel Pg is a pixel provided with a color filter 40 that transmits green (G) light. The green color filter 40 transmits light of a green wavelength region. The photoelectric conversion unit of the pixel Pg receives light of a green wavelength for photoelectric conversion. The pixel Pg is a pixel that receives light of a green wavelength region to generate a signal.

[0059] Pixel Pb is a pixel provided with a color filter 40 that transmits blue (B) light. The blue color filter 40 transmits light in the blue wavelength region. The photoelectric conversion unit of pixel Pb receives light of a blue wavelength to perform photoelectric conversion. Pixel Pb is a pixel that receives light in the blue wavelength region to generate a signal. Pixel Pr, pixel Pg, and pixel Pb generate a pixel signal of an R component, pixel information of a G component, and a pixel signal of a B component, respectively. Therefore, the imaging device 1 is able to obtain pixel signals of RGB.

[0060] It should be noted that the color filter provided in the pixel P is not limited to the primary color (RGB) filter, and, for example, may be a filter of complementary colors such as Cy (cyan), Mg (magenta), and Ye (yellow). In addition, a color filter corresponding to W (white), that is, a color filter that transmits light beams of all wavelength regions of the incident light, may be arranged. It should be noted that the color filter 40 may be omitted as needed. For example, depending on the characteristics of the light dispersing portion 30, the color filter 40 may not be provided in some or all of the pixels P of the imaging device 1.

[0061] In this embodiment, considering the characteristics of the human eye, more pixels Pg are provided than pixels Pr or pixels Pb. The number of pixels Pg is greater than the sum of the number of pixels Pr and the number of pixels Pb. The pixels Pg are provided to surround the periphery of each of the pixels Pr and the pixels Pb. Figure 2 As shown, a plurality of pixels Pg are arranged around the pixel Pr, and a plurality of pixels Pg are also arranged around the pixel Pb.

[0062] exist Figure 2In the example shown, the pixels Pr and the pixels Pb are arranged in units of four pixels, respectively. It can also be said that the pixels Pr and the pixels Pb are arranged in units of 2x 2 pixels, respectively, and are periodically arranged in 2 rows x 2 columns. In the pixel portion 100, four adjacent pixels Pr and four adjacent pixels Pb are repeatedly arranged. It can also be said that the multiple pixels Pg surrounding the multiple pixels Pr and the multiple pixels Pg surrounding the multiple pixels Pb are repeatedly arranged. It should be noted that the arrangement of the pixels of the imaging device 1 is not limited to the example shown. For example, the pixel unit is not limited to 2x 2, as long as the number of pixels Pg is greater than the sum of the number of pixels Pr and the number of pixels Pb. For example, the pixels Pr and the pixels Pb can be arranged in units of 3x 3 pixels, respectively.

[0063] [Pixel composition]

[0064] Figure 3 1 is a diagram showing an example of a cross-sectional configuration of an image pickup device according to an embodiment. Figure 3 As shown, the image pickup device 1 has a configuration in which, for example, a light receiving section 10 , a light guiding section 20 , and a multilayer wiring layer 90 are stacked in the Z-axis direction.

[0065] The light receiving unit 10 includes a semiconductor substrate 11 having a first surface 11S1 and a second surface 11S2 facing each other. The light guide unit 20 is provided on the first surface 11S1 side of the semiconductor substrate 11, and the multilayer wiring layer 90 is provided on the second surface 11S2 side of the semiconductor substrate 11. It can also be said that the light guide unit 20 is provided on the side where light from the optical lens system is incident, and the multilayer wiring layer 90 is provided on the side opposite to the light incident side. The imaging device 1 is a so-called back-illuminated imaging device.

[0066] For example, the semiconductor substrate 11 is composed of a silicon substrate. The photoelectric conversion unit (herein, also referred to as a photoelectric conversion region) 12 may include a photodiode (PD) having a pn junction at a predetermined region of the semiconductor substrate 11. A plurality of photoelectric conversion units 12 are embedded and formed in the semiconductor substrate 11. In the light receiving unit 10, a plurality of photoelectric conversion units 12 are arranged along the first face 11S1 and the second face 11S2 of the semiconductor substrate 11.

[0067] The multilayer wiring layer 90 has the following structure: wherein, for example, a plurality of wiring layers are stacked with an interlayer insulating layer therebetween. For example, the wiring layers of the multilayer wiring layer 90 are formed using aluminum (Al), copper (Cu), tungsten (W), etc. In addition, the wiring layers can be formed using polysilicon (Poly-Si). For example, the interlayer insulating layer is formed by a single layer film including one of silicon oxide (SiOx), silicon nitride (SiNx), or silicon oxynitride (SiOxNy), or a stacked film including two or more of them.

[0068] A circuit (e.g., a transfer transistor, a reset transistor, an amplifier transistor, etc.) for reading a pixel signal based on the charge generated by the photoelectric conversion unit 12 is formed in the semiconductor substrate 11 and the multilayer wiring layer 90. In addition, for example, the vertical drive unit 111, the signal processing unit 112, etc. described above are formed in the semiconductor substrate 11 and the multilayer wiring layer 90.

[0069] It should be noted that the image pickup device 1 may include an antireflection film and a fixed charge film between the color filter 40 and the photoelectric conversion section 12. The fixed charge film is a film having fixed charges and suppresses generation of dark current at the interface of the semiconductor substrate 11. The above-mentioned light guide section 20 may include an antireflection film and a fixed charge film.

[0070] The light guide portion 20 is stacked on the light receiving portion 10 in the thickness direction orthogonal to the first face 11S1 of the semiconductor substrate 11. The light guide portion 20 includes a transparent layer 25, a light dispersing portion 30, and a color filter 40, and guides light incident to the light dispersing portion 30 and redirects light incident to the light dispersing portion 30 in some cases. The transparent layer 25 is a light-transmitting transparent layer and is formed of, for example, a low refractive index material such as silicon oxide (SiOx) or silicon nitride (SiNx). The light dispersing portion 30 is located above the color filter 40.

[0071] The light dispersing portion 30 includes structures 31 configured to disperse incident light. Each structure 31 may include a fine (micro) structure having a size equal to or smaller than a predetermined wavelength of the incident light, for example, a size equal to or smaller than the wavelength of visible light. The structure 31 is a columnar (columnar) structure and is disposed inside the transparent layer 25 and may have a size measured in nanometers nm. Therefore, the structure 31 may be referred to as a nanostructure 31. A plurality of structures 31 may be referred to as nanostructures 31 in this specification. The nanostructures 31 may be arranged in the transparent layer 25. A plurality of nanostructures 31 may be located above each color filter 40 to guide and / or redirect light. As Figure 3 As schematically shown, the plurality of structures 31 are arranged side by side in the horizontal direction (X-axis direction) on the paper in a manner of sandwiching a portion of the transparent layer 25. Inside the transparent layer 25, the plurality of structures 31 may be arranged at intervals equal to or less than a predetermined wavelength of the incident light, for example, at intervals equal to or less than the wavelength of visible light. In some cases, the nanostructures 31 may redirect the incident light. For example, Figure 3 As shown in FIG. 4 , the nanostructure 31 located above the pixel Pg can redirect light to an adjacent pixel (eg, Pb or Pr) that senses light in a different wavelength range.

[0072] The structure 31 has a higher refractive index than the surrounding medium. For example, the medium surrounding the structure 31 is silicon oxide (SiO), air (gap), etc. Figure 3 In the example shown, the structure 31 is made of a material having a higher refractive index than the transparent layer 25. The structure 31 is made of a high refractive index material and can also be referred to as a high refractive index portion. The transparent layer 25 can also be referred to as a low refractive index portion.

[0073] For example, the structure 31 is formed by using silicon nitride (SiN). In addition, for example, the structure 31 may be composed of a silicon compound such as silicon nitride or silicon carbide, a metal oxide such as titanium oxide, tantalum oxide, niobium oxide, hafnium oxide, indium oxide, or tin oxide, or a composite oxide thereof. In addition, the structure 31 as the high refractive index portion may also be composed of an organic substance such as siloxane.

[0074] In this way, due to the difference between the refractive index of the structure 31 and the refractive index of the medium surrounding it, the light dispersing section 30 can cause phase delay in the incident light, thereby affecting the wavefront. The light dispersing section 30 provides different phase delay amounts according to the wavelength of the light, thereby being able to adjust the propagation direction of the light and separate the incident light into light beams of various wavelength regions. The size (size), shape, refractive index, etc. of each structure 31 are determined to allow the light beams of various wavelength regions included in the incident light to travel in the desired direction.

[0075] The light dispersing section 30 is a light dispersing element capable of dispersing light by utilizing metamaterial (metasurface) technology, and may also be referred to as a separator (color separator). It can also be said that the camera device 1 has a color separator structure. The propagation direction of the light beams of each wavelength passing through the light dispersing section 30 can be adjusted by the materials (optical constants) of the structure 31 and the transparent layer 25, the shape and height of the structure 31, the arrangement interval (gap) between the structures 31, etc. The light dispersing section 30 is an optical member that guides (propagates) light.

[0076] The light dispersing portion of the pixel Pg located next to the pixel Pr (referred to as the light dispersing portion 30g1) is configured to be able to propagate green (G) light to the color filter 40 and the photoelectric converter 12 of the pixel Pg, and propagate red (R) light to the color filter 40 and the photoelectric converter 12 of the pixel Pr. That is, the light dispersing portion 30g1 of the pixel Pg separates the incident light and guides the light in the red wavelength region of the incident light to the pixel Pr.

[0077] like Figure 3 As shown, light in the red wavelength region of light incident on the light dispersing portion 30g1 of the pixel Pg around the pixel Pr travels from the light dispersing portion 30g1 toward the red color filter 40 and the photoelectric converter 12 of the pixel Pr. Figure 2As schematically shown by the dotted circle and arrow in FIG. 1 , the plurality of pixels Pg surrounding the pixel Pr can guide light of a red wavelength in the incident light to the pixel Pr.

[0078] The light dispersing portion of the pixel Pr (referred to as the light dispersing portion 30r) is configured to propagate incident light toward the pixel Pr or an adjacent pixel Pr. The light dispersing portion 30r may also be referred to as a light guiding member that guides the incident light to the color filter 40 side of the pixel Pr, and may also be referred to as a light-collecting optical member. The red color filter 40 of the pixel Pr transmits light in the red wavelength region of the incident light to propagate the light toward the photoelectric conversion portion 12.

[0079] In this way, the light of red wavelength incident on the pixel Pr and each pixel Pg around the pixel Pr can be guided to the color filter 40 and the photoelectric conversion section 12 of the pixel Pr. The light of red wavelength can be converged from the pixels around the pixel Pr to the pixel Pr. Therefore, the photoelectric conversion section 12 of the pixel Pr can receive the incident red wavelength light separated by the light dispersing section 30g1 of the pixel Pg and the red wavelength light transmitted through the light dispersing section 30r. The photoelectric conversion section 12 of the pixel Pr can effectively receive the light of the red wavelength region for photoelectric conversion and generate a charge corresponding to the amount of light reception.

[0080] The light dispersing portion of the pixel Pg located next to the pixel Pb (referred to as the light dispersing portion 30g2) is configured to be able to propagate green (G) light to the color filter 40 and the photoelectric converter 12 of the pixel Pg, and propagate blue (B) light to the color filter 40 and the photoelectric converter 12 of the pixel Pb. That is, the light dispersing portion 30g2 of the pixel Pg separates the incident light and guides the light in the blue wavelength region of the incident light to the pixel Pb.

[0081] The light in the blue wavelength region of the light incident on the light dispersing portion 30g2 of the pixel Pg around the pixel Pb travels from the light dispersing portion 30g2 toward the blue color filter 40 and the photoelectric conversion portion 12 of the pixel Pb. Figure 2 As schematically shown by the dotted circle and arrow in , the plurality of pixels Pg surrounding the pixel Pb can guide light of a blue wavelength in the incident light to the pixel Pb.

[0082] The light dispersing portion of the pixel Pb (referred to as the light dispersing portion 30b) is configured to propagate the incident light toward the pixel Pb or an adjacent pixel Pb. The light dispersing portion 30b may also be referred to as a light-guiding member that guides the incident light to the color filter 40 side of the pixel Pb, and may also be referred to as a light-collecting optical member. The blue color filter 40 of the pixel Pb transmits light in the blue wavelength region of the incident light to propagate the light toward the photoelectric conversion portion 12.

[0083] In this way, the light of blue wavelength incident on the pixel Pb and each pixel Pg around the pixel Pb can be guided to the color filter 40 and the photoelectric conversion unit 12 of the pixel Pb. The light of blue wavelength can be converged from the pixels around the pixel Pb to the pixel Pb. Therefore, the photoelectric conversion unit 12 of the pixel Pb can receive the incident blue wavelength light separated by the light dispersing unit 30g2 of the pixel Pg and the blue wavelength light transmitted through the light dispersing unit 30b. The photoelectric conversion unit 12 of the pixel Pb can effectively receive the light of the blue wavelength region for photoelectric conversion and generate a charge corresponding to the amount of light reception.

[0084] As described above, the light dispersing portion 30g1 of the pixel Pg adjacent to the pixel Pr transmits light of the green wavelength region in the incident light to propagate the light toward the color filter 40 and the photoelectric converter 12 of the pixel Pg. In the pixels Pg surrounding the pixel Pr, the photoelectric converter 12 can receive the green wavelength light transmitted through the light dispersing portion 30g1 and the color filter 40 for photoelectric conversion, and generate charges corresponding to the amount of light reception.

[0085] In addition, the light dispersing portion 30g2 of the pixel Pg adjacent to the pixel Pb transmits the light of the green wavelength region in the incident light to propagate the modified light toward the color filter 40 and the photoelectric converter 12 of the pixel Pg. In the pixels Pg around the pixel Pb, the photoelectric converter 12 can receive the green wavelength light transmitted through the light dispersing portion 30g2 and the color filter 40 for photoelectric conversion, and generate charges corresponding to the amount of light received.

[0086] In this manner, pixels of a specific color (e.g., pixel Pg) are arranged more than pixels of other colors (e.g., pixel Pr, pixel Pb) in the image pickup device 1. The light dispersing section 30 (e.g., light dispersing section 30g1, light dispersing section 30g2) of each of the pixels of the specific color is configured to propagate light from the pixel of the specific color to pixels of other colors by light splitting.

[0087] It should be noted that, for example, the structures 31 of the above-mentioned light scattering parts 30g1, 30g2, 30r, and 30b may be formed to have respectively different sizes, shapes, etc. The structures 31 of the light scattering parts 30g1, 30g2, 30r, and 30b may be formed using the same material, or may be formed using different materials.

[0088] In the present embodiment, a plurality of pixels Pr are disposed between a plurality of pixels Pg each including a light dispersing portion 30g1, and a plurality of pixels Pb are disposed between a plurality of pixels Pg each including a light dispersing portion 30g2. More green pixels Pg are disposed, and green is a color that is sensitive to the human eye, so that the imaging device 1 can have high sensitivity to green light. In addition, the photoelectric conversion portion 12 of the pixel Pg performs photoelectric conversion on green wavelength light that passes through the light dispersing portion 30g1 (or the light dispersing portion 30g2) that is the light dispersing portion of the pixel Pg. Compared with the case where green wavelength light is also absorbed from the pixels Pr or pixels Pb around it, the resolution of green (G) can be improved. The S / N ratio of the pixel signal of the G component can be improved, and the image quality of the image can be improved.

[0089] In addition, in the present embodiment, the spectroscopy in the light dispersing portion 30g1 of the pixel Pg allows red wavelength light to be guided (in this case, redirected) from the pixel Pg to the pixel Pr side. In addition, the spectroscopy in the light dispersing portion 30g2 of the pixel Pg allows blue wavelength light to be guided (in this case, redirected) from the pixel Pg to the pixel Pb side. The pixel Pr and the pixel Pb can also absorb light from the pixels Pg around them, thereby being able to improve the sensitivity to the incident light. An improvement in quantum efficiency (QE: quantum efficiency) can be achieved. In addition, compared with the case where the light dispersing portion 30 of each pixel is formed to allow each pixel of RGB to absorb light from the pixels around it, the difficulty level of the design can be reduced.

[0090] Next, refer to FIG. 4A to FIG. 4C An example of zoom processing by the image pickup device 1 will be described. Figure 4A A case where the magnification ratio (magnification) of the zoom (electronic zoom) is “large (for example, four times)” is shown. Figure 4B A case where the magnification ratio of zoom is "medium (eg, two times)" is shown. Figure 4C A case where the magnification ratio of zoom is “small (for example, one time)” is shown.

[0091] In the case of a "large" magnification ratio, the image pickup device 1 reads pixel signals of all pixels P of the pixel section 100 to obtain image data 81a including pixel signals of the respective pixels. The processing section 114 of the image pickup device 1 performs interpolation processing (remosaic processing) on ​​the image data 81a, thereby generating RGB image data 81b having pixel signals of three color components of RGB for each pixel.

[0092] The processing unit 114 Figure 4AThe RGB image data 81b in the image is subjected to cropping processing to crop (cut out) the area (portion) surrounded by the thick line in the RGB image data 81b. Using the image data obtained by the cropping processing, that is, the image data cut out (extracted) from the RGB image data 81b, it is possible to display an image with a "larger" magnification ratio.

[0093] like Figure 4B As shown, in the case of the magnification ratio "medium", the camera 1 performs a process of adding pixel signals of every four pixels of the same color (i.e., 2x 2 pixels) for all pixels P in the pixel section 100 to obtain image data 82a. The processing section 114 performs interpolation processing on the image data 82a to generate RGB image data 82b.

[0094] The processing unit 114 Figure 4B The cropping process is performed on the RGB image data 82b in order to crop the area surrounded by the bold line in the RGB image data 82. Using the image data obtained by the cropping process, an image with an enlargement ratio of "medium" can be displayed.

[0095] like Figure 4C As shown, when the magnification ratio is "small", the camera 1 performs a process of adding pixel signals of every four pixels of the same color (i.e., 2 x 2 pixels) for some pixels P in the pixel section 100 to obtain image data 83a. The processing section 114 performs interpolation processing on the image data 83a, thereby generating RGB image data 83b.

[0096] The processing unit 114 Figure 4C The RGB image data 83b in the image is subjected to cropping processing. In this case, Figure 4C As shown by the bold line in , all areas of the RGB image data 83b are cropped (extracted). Using the image data obtained by the cropping process, an image with a "smaller" magnification ratio can be displayed. As described above, in the camera device 1 according to the present embodiment, image processing can be performed according to the magnification ratio, thereby realizing seamless zooming.

[0097] [Function and Effect]

[0098] The photodetector according to the present embodiment includes a plurality of first pixels (for example, pixels Pg), a plurality of second pixels (pixels Pr) and a plurality of third pixels (pixels Pb), the first pixels respectively including a light scattering portion (light scattering portion 30) having a structure having a size equal to or smaller than the wavelength of the incident light and a first photoelectric conversion portion that receives light of the first wavelength transmitted through the light scattering portion for photoelectric conversion, the second pixels are arranged between the plurality of first pixels and respectively include a second photoelectric conversion portion that receives light of the second wavelength for photoelectric conversion, and the third pixels are arranged between the plurality of first pixels and respectively include a third photoelectric conversion portion that receives light of the third wavelength for photoelectric conversion.

[0099] In the photodetector according to the present embodiment, a plurality of pixels Pr are arranged between a plurality of pixels Pg each including a light scattering portion 30g1, and a plurality of pixels Pb are arranged between a plurality of pixels Pg each including a light scattering portion 30g2. This enables the photodetector (imaging device 1) to have high sensitivity. In addition, the resolution can be improved, thereby improving the image quality of the image. A photodetector with high detection performance can be realized.

[0100] Next, a description is given of a modified example of the present disclosure. Hereinafter, components similar to those of the foregoing embodiment are denoted by the same reference numerals, and description thereof is appropriately omitted.

[0101] <2. Modifications>

[0102] (2-1. Modification 1)

[0103] In the foregoing embodiment, a description has been given of an arrangement example of the color filter 40 , but the arrangement of the color filter 40 is not limited thereto. Figure 5 and Figure 6 1 and 2 are diagrams showing examples of cross-sectional configurations of an imaging device according to a first modification of the present disclosure. Figure 5 and Figure 6 In the example shown in the example, the color filter 40 may not be set in the pixel of a specific color (for example, the pixel Pg). In this case, the light receiving amount in the pixel of the specific color can be increased, thereby improving the sensitivity to the incident light. In addition, for example, Figure 7 As shown, the color filter 40 may not be provided in pixels of other colors (eg, pixel Pr, pixel Pb) that absorb light from the pixel of the specific color. This can improve the sensitivity to incident light.

[0104] (2-2. Modification 2)

[0105] Figure 8 is a diagram showing an example of a cross-sectional configuration of an image pickup device according to Modification 2. The image pickup device 1 may be provided with a lens portion (on-chip lens) for converging light. Figure 8 As shown in the illustrated example, the lens section 21 may be provided between the light dispersing section 30 and the color filter 40 for each pixel P. The lens section 21 is provided above the color filter 40 , and can focus light onto the color filter 40 and the photoelectric conversion section 12 .

[0106] In addition, if Fig. 9 As shown, in some pixels P of all pixels, a lens section 21 may be provided for the photoelectric conversion sections 12 adjacent to each other. For example, the left and right photoelectric conversion sections 12 receive light transmitted through different regions of the optical lens system to perform pupil division. Therefore, phase difference data (phase difference information) can be obtained by using a signal based on the charge photoelectrically converted by one photoelectric conversion section 12 and a signal based on the charge photoelectrically converted by another photoelectric conversion section 12. Phase difference autofocus (AF: Auto Focus) can be performed using the phase difference data. It should be noted that, as Fig.10 As shown, the lens portion 21 may be arranged only in pixels of a specific color.

[0107] (2-3. Modification 3)

[0108] The above embodiment shows a configuration example of the light dispersing portion 30 including a fine structure. However, the configuration example is merely illustrative, and the configuration of the light dispersing portion 30 is not limited to the above example. Fig.11 and Fig.12 As shown, the light dispersing portion 30 may include a plurality of structures 31 ( Fig.11 and Fig.12 Structure 31a and structure 31b).

[0109] like Fig.13 or Fig.14 As shown, the structure 31 may not be provided in the light dispersing portion 30g of each pixel Pg at the four corners of the plurality of pixels Pg arranged to surround the pixel Pr (or the pixel Pb). Fig.15A and Fig. 15B As shown in the illustrated example, the shape, number, etc. of the structure 31 are not limited to the illustrated example. A plurality of structures 31 may be provided in the light dispersing portion 30 of the pixel P.

[0110] (2-4. Modification 4)

[0111] In the foregoing embodiments, description has been given of an example of the arrangement of pixels, but the arrangement of pixels is not limited thereto. Fig.16 As shown, a plurality of pixels Pr may be arranged side by side in the vertical direction (Y-axis direction), and a plurality of pixels Pb may also be arranged side by side in the vertical direction. Fig.17 As shown in the illustrated example, the pixels Pr and the pixels Pb may be arranged in oblique directions, respectively.

[0112] (2-5. Modification 5)

[0113] The color filter provided in the pixel P is not limited to the example shown. For example, a pixel Py including a Ye (yellow) color filter 40 may be provided. In addition, a pixel Pw including a W (white) color filter 40 may be provided. A pixel including a Cy (cyan) color filter and a pixel including a Mg (magenta) color filter may be provided.

[0114] For example, the pixel Py, the pixel Pr, and the pixel Pb may be repeatedly arranged. Fig.18 As shown, the pixel Py can be arranged to surround each periphery of the pixel Pr and the pixel Pb. Fig.18 In the illustrated example, the light dispersing portion 30 of the pixel Py is configured to spread light from the pixel Py to pixels of other colors (pixels Pr, pixels Pb) by splitting the light.

[0115] In addition, the pixel Pw, the pixel Pr and the pixel Pb can be arranged repeatedly. The pixel Pw, the pixel Pr, the pixel Pg and the pixel Pb can be arranged. The pixel Pw can be set to surround each periphery of the pixel Pr and the pixel Pb. For example, the light dispersing portion 30 of the pixel Pw can be configured to propagate light from the pixel Pw to pixels of other colors (pixel Pr, pixel Pg and pixel Pb) by splitting light. In this modification, an effect similar to that of the aforementioned embodiment can also be obtained.

[0116] <3. Application Examples>

[0117] For example, the above-described imaging device 1 and the like may be applied to any type of electronic equipment having an imaging function, including a camera system such as a digital camera or a video camera, a mobile phone having an imaging function, and the like. Fig.19 The schematic structure of the electronic device 1000 is shown.

[0118] For example, the electronic device 1000 includes a lens group 1001, an image pickup device 1, a digital signal processor (DSP) circuit 1002, a frame memory 1003, a display unit 1004, a recording unit 1005, an operation unit 1006, and a power supply unit 1007. They are connected to each other via a bus 1008.

[0119] The lens group 1001 receives incident light (image light) from a subject and forms an image on the imaging surface of the imaging device 1. The imaging device 1 converts the amount of incident light formed as an image on the imaging surface through the lens group 1001 into an electrical signal in units of pixels, and supplies the electrical signal to the DSP circuit 1002 as a pixel signal.

[0120] The DSP circuit 1002 is a signal processing circuit that processes a signal supplied from the image pickup device 1. The DSP circuit 1002 outputs image data obtained by processing the signal from the image pickup device 1. The frame memory 1003 temporarily holds the image data processed by the DSP circuit 1002 in units of frames.

[0121] The display unit 1004 includes a panel-type display device such as a liquid crystal panel or an organic electroluminescence (EL: ElectroLuminescence) panel, for example, and records image data of moving images or still images captured by the camera 1 in a recording medium such as a semiconductor memory or a hard disk.

[0122] The operation unit 1006 outputs operation signals for various functions of the electronic device 1000 according to the user's operation. The power supply unit 1007 appropriately supplies various powers for the operation of these supply targets to the DSP circuit 1002, frame memory 1003, display unit 1004, recording unit 1005, and operation unit 1006.

[0123] <4. Application Examples>

[0124] (Application example of mobile object)

[0125] The technology according to the present disclosure (the present technology) can be applied to various products. For example, the technology according to the present disclosure can be implemented as a device installed on any type of mobile body such as an automobile, an electric car, a hybrid electric car, a motorcycle, a bicycle, a personal mobility device, an airplane, an unmanned aerial vehicle, a ship, or a robot.

[0126] Fig. 20 : is a block diagram showing a schematic configuration example of a vehicle control system as an example of a moving body control system to which the technology according to the embodiment of the present disclosure can be applied.

[0127] The vehicle control system 12000 includes a plurality of electronic control units connected to each other via a communication network 12001. Fig. 20 In the example shown, the vehicle control system 12000 includes a drive system control unit 12010, a body system control unit 12020, an external information detection unit 12030, an internal information detection unit 12040, and an integrated control unit 12050. In addition, a microcomputer 12051, a sound / image output unit 12052, and an in-vehicle network interface (I / F) 12053 are shown as the functional configuration of the integrated control unit 12050.

[0128] The drive system control unit 12010 controls the operation of devices related to the drive system of the vehicle according to various programs. For example, the drive system control unit 12010 serves as a control device for the following devices: a drive force generating device such as an internal combustion engine or a drive motor for generating a drive force for the vehicle; a drive force transmitting mechanism for transmitting the drive force to the wheels; a steering mechanism for adjusting the steering angle of the vehicle; and a braking device for generating a braking force for the vehicle, etc.

[0129] The body system control unit 12020 controls the operation of various devices provided to the vehicle body according to various programs. For example, the body system control unit 12020 is used as a control device for a keyless entry system, a smart key system, a power window device, or various lights such as a headlight, a taillight, a brake light, a turn signal light, or a fog light. In this case, radio waves transmitted from a portable device as a substitute for a key or signals of various switches can be input to the body system control unit 12020. The body system control unit 12020 receives these input radio waves or signals, and controls the door lock device, the power window device, and lights of the vehicle.

[0130] The vehicle exterior information detection unit 12030 detects information about the exterior of the vehicle having the vehicle control system 12000. For example, the vehicle exterior information detection unit 12030 is connected to the camera unit 12031. The vehicle exterior information detection unit 12030 causes the camera unit 12031 to capture an image of the exterior of the vehicle and receives the captured image. Based on the received image, the vehicle exterior information detection unit 12030 can perform detection processing on objects such as people, vehicles, obstacles, signs, or symbols on the road surface, or detection processing of the distance to these objects.

[0131] The imaging unit 12031 is an optical sensor for receiving light and outputting an electrical signal corresponding to the amount of light received. The imaging unit 12031 may output the electrical signal as an image, or may output the electrical signal as information about the measured distance. In addition, the light received by the imaging unit 12031 may be visible light, or may be invisible light such as infrared rays.

[0132] The in-vehicle information detection unit 12040 detects information about the interior of the vehicle. For example, the in-vehicle information detection unit 12040 is connected to a driver state detection unit 12041 that detects the driver's state. The driver state detection unit 12041 includes, for example, a camera that takes a picture of the driver. Based on the detection information input from the driver state detection unit 12041, the in-vehicle information detection unit 12040 can calculate the driver's fatigue level or the driver's concentration level, or can determine whether the driver is dozing off.

[0133] The microcomputer 12051 can calculate the control target value of the driving force generating device, the steering mechanism or the braking device based on the information about the inside or outside of the vehicle (the information is obtained by the outside information detection unit 12030 or the inside information detection unit 12040), and output the control command to the driving system control unit 12010. For example, the microcomputer 12051 can perform the coordinated control aimed at realizing the functions of the advanced driver assistance system (ADAS), which includes: collision avoidance or collision mitigation of the vehicle, following driving based on the vehicle-to-vehicle distance, vehicle speed maintenance driving, vehicle collision warning or vehicle lane departure warning, etc.

[0134] In addition, the microcomputer 12051 can perform collaborative control intended for autonomous driving, which enables the vehicle to drive autonomously by controlling a driving force generating device, a steering mechanism, or a braking device, etc. based on information about the interior or exterior of the vehicle (the information is obtained by the exterior information detection unit 12030 or the interior information detection unit 12040), without relying on the driver's operation.

[0135] In addition, the microcomputer 12051 can output a control command to the body system control unit 12020 based on information about the exterior of the vehicle, which is obtained by the exterior information detection unit 12030. For example, the microcomputer 12051 can perform cooperative control aimed at preventing glare by controlling the headlights to change from high beam to low beam according to the position of the preceding vehicle or the oncoming vehicle detected by the exterior information detection unit 12030.

[0136] The sound / image output unit 12052 transmits an output signal of at least one of sound and image to an output device that can visually or auditorily notify the vehicle's passengers or the outside of the vehicle of information. Fig. 20 In the example of FIG. 1 , an audio speaker 12061, a display portion 12062, and an instrument panel 12063 are shown as output devices. For example, the display portion 12062 may include at least one of an in-vehicle display and a head-up display.

[0137] Fig.21 12031 is a diagram showing an example of the installation position of the camera unit 12031.

[0138] exist Fig.21 In the figure, the camera unit 12031 includes camera units 12101, 12102, 12103, 12104 and 12105.

[0139] The camera units 12101, 12102, 12103, 12104 and 12105 are, for example, arranged at positions on the front nose, side mirrors, rear bumper and rear door of the vehicle 12100 and at positions on the upper part of the windshield inside the vehicle. The camera unit 12101 arranged on the front nose and the camera unit 12105 arranged on the upper part of the windshield inside the vehicle mainly obtain images in front of the vehicle 12100. The camera units 12102 and 12103 arranged on the side mirrors mainly obtain images on the sides of the vehicle 12100. The camera unit 12104 arranged on the rear bumper or rear door mainly obtains images at the rear of the vehicle 12100. The camera unit 12105 arranged on the upper part of the windshield inside the vehicle is mainly used to detect vehicles in front, pedestrians, obstacles, signals, traffic signs or lanes, etc.

[0140] By the way, Fig.21 An example of the photographing range of the camera units 12101 to 12104 is shown. The photographing range 12111 indicates the photographing range of the camera unit 12101 provided to the front nose. The photographing ranges 12112 and 12113 respectively indicate the photographing ranges of the camera units 12102 and 12103 provided to the side mirrors. The photographing range 12114 indicates the photographing range of the camera unit 12104 provided to the rear bumper or the rear door. For example, by superimposing the image data photographed by the camera units 12101 to 12104, an overhead image of the vehicle 12100 viewed from above is obtained.

[0141] At least one of the imaging units 12101 to 12104 may have a function of obtaining distance information. For example, at least one of the imaging units 12101 to 12104 may be a stereo camera composed of a plurality of imaging elements, or may be an imaging element having pixels for phase difference detection.

[0142] For example, the microcomputer 12051 can determine the distance to each three-dimensional object within the imaging range 12111 to 12114 and the time change of the distance (relative speed with respect to the vehicle 12100) based on the distance information obtained from the imaging units 12101 to 12104, thereby extracting the nearest three-dimensional object as the front vehicle, in particular, the three-dimensional object exists on the driving path of the vehicle 12100 and travels in substantially the same direction as the vehicle 12100 at a predetermined speed (e.g., equal to or greater than 0 km / h). In addition, the microcomputer 12051 can set the following distance to be maintained between the vehicle in front of the vehicle and the front vehicle, and perform automatic braking control (including follow-up stop control) or automatic acceleration control (including follow-up start control), etc. Therefore, it is possible to perform cooperative control intended for automatic driving, which allows the vehicle to travel autonomously without relying on the driver's operation, etc.

[0143] For example, the microcomputer 12051 can classify the three-dimensional object data about the three-dimensional object into three-dimensional object data of two-wheeled vehicles, standard-sized vehicles, large vehicles, pedestrians, utility poles, and other three-dimensional objects based on the distance information obtained from the camera units 12101 to 12104, extract the classified three-dimensional object data, and use the extracted three-dimensional object data to automatically avoid obstacles. For example, the microcomputer 12051 identifies obstacles around the vehicle 12100 as obstacles that can be visually identified by the driver of the vehicle 12100 and obstacles that are difficult for the driver of the vehicle 12100 to visually identify. Then, the microcomputer 12051 determines the collision risk representing the risk of collision with each obstacle. When the collision risk is equal to or higher than the set value and therefore there is a possibility of collision, the microcomputer 12051 outputs a warning to the driver via the audio speaker 12061 or the display unit 12062, and performs forced deceleration or evasive steering through the drive system control unit 12010. The microcomputer 12051 can thereby assist driving to avoid collision.

[0144] At least one of the camera units 12101 to 12104 may be an infrared camera that detects infrared rays. For example, the microcomputer 12051 may identify a pedestrian by determining whether there is a pedestrian in the captured images of the camera units 12101 to 12104. For example, such identification of pedestrians is performed by a program that extracts feature points in the captured images of the camera units 12101 to 12104 as infrared cameras and a program that determines whether it is a pedestrian by performing pattern matching processing on a series of feature points representing the outline of an object. When the microcomputer 12051 determines that there is a pedestrian in the captured images of the camera units 12101 to 12104 and thus identifies the pedestrian, the sound / image output unit 12052 controls the display unit 12062 so that a square contour line for emphasis is displayed in a manner superimposed on the identified pedestrian. The sound / image output unit 12052 may also control the display unit 12062 so that an icon or the like representing a pedestrian is displayed at a desired position.

[0145] The description of the mobile body control system to which the technology according to the embodiment of the present disclosure is applicable has been given above. For example, the technology according to the embodiment of the present disclosure can be applied to the camera section 12031 in the above-mentioned configuration. Specifically, for example, the camera device 1 and the like can be applied to the camera section 12031. Applying the technology according to the embodiment of the present disclosure to the camera section 12031 can obtain a captured image with high definition, thereby making it possible to perform high-precision control using the captured image in the mobile body control system.

[0146] (Application example of endoscopic surgery system)

[0147] The technology according to the embodiment of the present disclosure (the present technology) can be applied to various products. For example, the technology according to the embodiment of the present disclosure can be applied to an endoscopic surgery system.

[0148] Fig. 22 : is a view showing an example of a schematic configuration of an endoscopic surgery system to which the technology according to an embodiment of the present disclosure (the present technology) can be applied.

[0149] exist Fig. 22 , a state is shown in which an operator (doctor) 11131 is using an endoscopic surgery system 11000 to perform surgery on a patient 11132 on a bed 11133. As shown in the figure, the endoscopic surgery system 11000 includes an endoscope 11100, other surgical tools 11110 such as a pneumoperitoneum tube 11111 and an energy device 11112, a support arm device 11120 supporting the endoscope 11100 thereon, and a cart 11200 on which various devices for endoscopic surgery are mounted.

[0150] The endoscope 11100 includes a lens barrel 11101, a region of a predetermined length from the distal end of the lens barrel is inserted into the body cavity of a patient 11132, and a camera head 11102, the camera head being connected to the proximal end of the lens barrel 11101. In the example shown, the endoscope 11100 is shown as a rigid endoscope having a rigid lens barrel 11101. However, the endoscope 11100 may also be configured as a flexible endoscope having a flexible lens barrel 11101.

[0151] The lens barrel 11101 has an opening at its distal end in which an objective lens is mounted. The light source device 11203 is connected to the endoscope 11100 so that the light generated by the light source device 11203 is introduced into the distal end of the lens barrel 11101 through a light guide extending into the interior of the lens barrel 11101, and irradiated through the objective lens onto an observation target in the body cavity of the patient 11132. It should be noted that the endoscope 11100 may be a straight-view endoscope or may be an oblique-view endoscope or a side-view endoscope.

[0152] The optical system and the imaging element are arranged inside the camera head 11102 so that the reflected light (observation light) from the observation target is gathered on the imaging element through the optical system. The observation light is photoelectrically converted by the imaging element to generate an electric signal corresponding to the observation light, that is, an image signal corresponding to the observation image. The image signal is transmitted to the CCU 11201 as raw (RAW) data.

[0153] The CCU 11201 includes a central processing unit (CPU), a graphics processing unit (GPU), etc., and centrally controls the operations of the endoscope 11100 and the display device 11202. Further, for example, the CCU 11201 receives an image signal from the camera head 11102, and performs various image processing such as development processing (demosaic processing) on ​​the image signal to display an image based on the image signal.

[0154] The display device 11202 displays thereon an image based on an image signal that has been image-processed by the CCU 11201 under the control of the CCU 11201 .

[0155] For example, the light source device 11203 includes a light source such as a light emitting diode (LED) and provides the endoscope 11100 with irradiation light when imaging the surgical area.

[0156] The input device 11204 is an input interface of the endoscopic surgery system 11000. The user can input various information or instructions to the endoscopic surgery system 11000 through the input device 11204. For example, the user may input instructions to change the imaging conditions (type of irradiation light, magnification, focal length, etc.) of the endoscope 11100.

[0157] The treatment tool control device 11205 controls the driving of the energy device 11112 to burn or cut tissue, seal blood vessels, etc. The pneumoperitoneum device 11206 supplies gas into the body cavity of the patient 11132 through the pneumoperitoneum tube 11111 to expand the body cavity in order to ensure the field of view of the endoscope 11100 and to ensure the working space of the operator. The recorder 11207 is a device capable of recording various information related to the operation. The printer 11208 is a device capable of printing various information related to the operation in various forms such as text, images, or graphics.

[0158] It should be noted that the light source device 11203 that provides irradiation light to the endoscope 11100 when imaging the surgical area can be composed of a white light source, for example, a white light source composed of an LED, a laser light source, or a combination thereof. In the case where the white light source is composed of a combination of red, green, and blue (RGB) laser light sources, since the output intensity and output timing of each color (each wavelength) can be controlled with high precision, the white balance of the captured image can be adjusted by the light source device 11203. Further, in this case, if the laser beams from the respective RGB laser light sources are irradiated on the observation target in a time-division manner, the drive of the imaging element of the camera head 11102 is controlled synchronously with the irradiation timing. Then, images corresponding to the R, G, and B colors, respectively, can also be captured in a time-division manner. According to this method, a color image can be obtained even if a color filter is not configured for the imaging element.

[0159] Furthermore, the drive of the light source device 11203 can be controlled so as to change the intensity of the light to be output at predetermined intervals. By controlling the drive of the imaging element of the camera head 11102 in synchronization with the timing of the change in light intensity to acquire images in a time-division manner and synthesize the images, it is possible to create an image with a high dynamic range without underexposed shadows and overexposed highlights.

[0160] Further, the light source device 11203 can be configured to provide light of a predetermined wavelength band corresponding to special light observation. For example, in special light observation, by utilizing the wavelength dependence of light absorption of body tissue, a narrow band of light is irradiated compared to the irradiation light (i.e., white light) during ordinary observation, and narrow band observation (narrow band imaging) is performed on predetermined tissues such as blood vessels in the surface layer of the mucosa with high contrast. Alternatively, in special light observation, fluorescence observation for obtaining an image from fluorescence generated by irradiating excitation light can be performed. In fluorescence observation, fluorescence observation (autofluorescence observation) of body tissue can be performed by irradiating excitation light on body tissue, or a fluorescent image can be obtained by locally injecting a reagent such as indocyanine green (ICG) into the body tissue and irradiating excitation light corresponding to the fluorescence wavelength of the reagent on the body tissue. The light source device 11203 can be configured to provide such narrow band light and / or excitation light suitable for special light observation as described above.

[0161] Fig.23 It is shown Fig. 22 A block diagram of an example of a functional configuration of a camera head 11102 and a CCU 11201 is shown.

[0162] The camera head 11102 includes a lens unit 11401, an imaging unit 11402, a driving unit 11403, a communication unit 11404, and a camera head control unit 11405. The CCU 11201 includes a communication unit 11411, an image processing unit 11412, and a control unit 11413. The camera head 11102 and the CCU 11201 are connected via a transmission cable 11400 so as to communicate with each other.

[0163] The lens unit 11401 is an optical system provided at a connection position with the lens barrel 11101. Observation light entering from the distal end of the lens barrel 11101 is guided to the camera head 11102 and introduced into the lens unit 11401. The lens unit 11401 is composed of a combination of a plurality of lenses including a zoom lens and a focus lens.

[0164] The number of imaging elements included in the imaging unit 11402 can be one (single-board type) or multiple (multi-board type). For example, when the imaging unit 11402 is configured as a multi-board type, image signals corresponding to each R, G and B are generated by the imaging element, and the image signals can be synthesized to obtain a color image. The imaging unit 11402 can also be configured to have a pair of imaging elements for acquiring a right eye image signal and a left eye image signal corresponding to a three-dimensional (3D) display. If a 3D display is performed, then the operator 11131 can more accurately grasp the depth of the living tissue in the surgical area. It should be noted that when the imaging unit 11402 is configured as a stereoscopic type, a plurality of lens unit 11401 systems are set corresponding to each imaging element.

[0165] Further, the camera unit 11402 may not necessarily be disposed on the camera head 11102. For example, the camera unit 11402 may be disposed just behind the objective lens inside the lens barrel 11101.

[0166] The driving unit 11403 is composed of an actuator, and moves the zoom lens and the focus lens of the lens unit 11401 by a predetermined distance along the optical axis under the control of the camera head control unit 11405. Therefore, the magnification and focus of the image captured by the imaging unit 11402 can be appropriately adjusted.

[0167] The communication unit 11404 is constituted by a communication device for sending and receiving various information to and from the CCU 11201. The communication unit 11404 transmits the image signal acquired from the imaging unit 11402 to the CCU 11201 as RAW data via the transmission cable 11400.

[0168] In addition, the communication unit 11404 receives a control signal for controlling the driving of the camera head 11102 from the CCU 11201, and supplies the control signal to the camera head control unit 11405. For example, the control signal includes information related to imaging conditions, such as information specifying a frame rate of an image to be captured, information specifying an exposure value when capturing an image, and / or information specifying a magnification and a focus of an image to be captured.

[0169] It should be noted that the imaging conditions such as the frame rate, exposure value, magnification or focus may be specified by the user or may be automatically set based on the acquired image signal by the control unit 11413 of the CCU 11201. In the latter case, an automatic exposure (AE) function, an automatic focus (AF) function and an automatic white balance (AWB) function are provided in the endoscope 11100.

[0170] The camera head control unit 11405 controls the driving of the camera head 11102 based on a control signal received from the CCU 11201 through the communication unit 11404 .

[0171] The communication unit 11411 is constituted by a communication device for transmitting and receiving various information to and from the camera head 11102. The communication unit 11411 receives an image signal transmitted thereto from the camera head 11102 through the transmission cable 11400.

[0172] Further, the communication unit 11411 transmits a control signal for controlling the driving of the camera head 11102 to the camera head 11102. The image signal and the control signal may be transmitted through electrical communication, optical communication, or the like.

[0173] The image processing unit 11412 performs various image processing on the image signal in the form of RAW data transmitted thereto from the camera head 11102 .

[0174] The control unit 11413 performs various controls related to image capturing of the operation area, etc. through the endoscope 11100 and display of captured images obtained by image capturing of the operation area, etc. For example, the control unit 11413 creates a control signal for controlling the driving of the camera head 11102 .

[0175] Further, the control unit 11413 controls the display device 11202 to display a captured image in which the surgical area, etc., is photographed based on the image signal that has been image-processed by the image processing unit 11412. At this time, the control unit 11413 can use various image recognition technologies to recognize various objects in the captured image. For example, the control unit 11413 can recognize surgical tools such as surgical forceps, specific living areas, bleeding, fog when the energy device 11112 is used, etc. by detecting the shape, color, etc. of the edge of the object contained in the captured image. When the control unit 11413 controls the display device 11202 to display the captured image, it can use the recognition result to display various surgical support information in an overlapping manner with the image of the surgical area. In the case where the surgical support information is displayed in an overlapping manner and presented to the operator 11131, the burden of the operator 11131 can be reduced and the operator 11131 can reliably perform the operation.

[0176] The transmission cable 11400 connecting the camera head 11102 and the CCU 11201 to each other is an electric signal cable for electric signal communication, an optical fiber for optical communication, or a composite cable for electric communication and optical communication.

[0177] Here, although in the illustrated example, communication is performed by wired communication using the transmission cable 11400, communication between the camera head 11102 and the CCU 11201 may be performed by wireless communication.

[0178] An example of an endoscopic surgery system has been described above, to which the technology according to the embodiment of the present disclosure can be applied. For example, the technology according to the embodiment of the present disclosure can be applied to the camera unit 11402 provided in the camera head 11102 of the endoscope 11100 in the above-mentioned configuration. Applying the technology according to the embodiment of the present disclosure to the camera unit 11402 can make the camera unit 11402 have high sensitivity, thereby being able to provide the endoscope 11100 with high definition.

[0179] In view of the above, an embodiment of the present disclosure relates to a light detection device 1, which includes a plurality of pixels P, the plurality of pixels P including a first pixel group (e.g., pixel Pg) sensing light of a first wavelength range, a second pixel group (e.g., pixel Pr) sensing light of a second wavelength range different from the first wavelength range, and a first layer 25 including a first nanostructure 31 located above the first pixel group to redirect the light. In at least one embodiment, the plurality of pixels also includes a third pixel group (e.g., pixel Pb) sensing light of a third wavelength range different from the first and second wavelength ranges. The third pixel group can be arranged between pixels of the first pixel group. In some examples, the number of pixels in the first pixel group is greater than the sum of the number of pixels in the second pixel group and the number of pixels in the third pixel group. In at least one embodiment, the number of pixels in the first pixel group is three times the sum of the number of pixels in the second pixel group and the number of pixels in the third pixel group. As shown herein, the second pixel group can be surrounded by pixels in the first pixel group. In some examples, the second pixel group includes four pixels in a 2x 2 array, the third pixel group is surrounded by pixels in the first pixel group, and the third pixel group includes four pixels in a 2x 2 array. The light detection device 1 may also include a first color filter 40 (e.g., G) for pixels in the first pixel group and transmitting light in the first wavelength range, a second color filter 40 (e.g., R) for pixels in the second pixel group and transmitting light in the second wavelength range, and a third color filter 40 (e.g., B) for pixels in the third pixel group and transmitting light in the third wavelength range. The first nanostructure 31 may redirect light in the second wavelength range to the second color filter. In at least one embodiment, the pixels in the second pixel group include a photodiode that receives redirected light in the second wavelength range transmitted through the second color filter. In some embodiments, the first nanostructure 31 redirects light in the third wavelength range to the third color filter. In at least one embodiment, the pixels in the third pixel group include a photodiode that receives redirected light in the third wavelength range transmitted through the third color filter. In at least some embodiments, the first layer 25 also includes a second nanostructure 31 located above the second pixel group and a third nanostructure 31 located above the third pixel group. As shown and discussed, the first nanostructure 31 is arranged in the first material of the first layer 25, and the first nanostructure 31 has a higher refractive index than the first material. In some examples, the light detection device 1 includes a first color filter 40 (e.g., G) for the first pixel group and transmitting the first wavelength range, a second color filter (e.g., R) for the second pixel group and transmitting the second wavelength range, a first on-chip lens arranged on the first color filter, and a second on-chip lens arranged on the second color filter. In at least one embodiment, the second pixel group includes four pixels in a 2x 2 array, and the second on-chip lens covers the four pixels of the second pixel group.An electronic device (e.g., 1000) according to the present disclosure includes a signal processor (e.g., 1002) and a light detection device 1 as described in the present specification. The light detection device 1 according to an embodiment of the present disclosure includes a light detection device 1 having a plurality of pixels P, the plurality of pixels P including a first pixel group (e.g., pixel Pg) sensing light of a first wavelength range, a second pixel group (e.g., pixel Pr) sensing light of a second wavelength range different from the first wavelength range, and a first layer 25 including a first nanostructure 31 located above the first pixel group to guide light toward a photoelectric conversion region of the second pixel group. In at least one embodiment, all sides of the second pixel group are surrounded by pixels of the first pixel group.

[0180] Although the present disclosure has been described above with reference to the embodiments, variations, applicable examples, and application examples, the present technology is not limited to the aforementioned embodiments, etc., and can be modified in various ways. For example, although the aforementioned variations have been described as variations of the aforementioned embodiments, the configurations of the various variations can be appropriately combined.

[0181] In the foregoing embodiments and the like, the imaging device is exemplified and described; however, for example, it is sufficient that the photodetector of the present disclosure receives incident light and converts the light into electric charge. The signal to be output may be a signal of image information or a signal of distance measurement information.

[0182] The light detection device according to the embodiment of the present disclosure includes a plurality of first pixels, a plurality of second pixels, and a plurality of third pixels, the first pixels each include a light scattering portion having a structure with a size equal to or smaller than the wavelength of incident light, the second pixels are arranged between the plurality of first pixels, and the third pixels are arranged between the plurality of first pixels. This enables the realization of a light detection device with high detection performance.

[0183] It should be noted that the effects described here are merely exemplary and are not limited to the description, and other effects may be further included. In addition, the present disclosure may also have the following configurations.

[0184] (1) A photodetector comprising:

[0185] a plurality of first pixels, each of which includes a light scattering portion and a first photoelectric conversion portion, wherein the light scattering portion includes a structure having a size equal to or smaller than a wavelength of incident light, and the first photoelectric conversion portion receives light of a first wavelength transmitted through the light scattering portion to perform photoelectric conversion;

[0186] a plurality of second pixels disposed between the plurality of first pixels and each including a second photoelectric conversion portion that receives light of a second wavelength to perform photoelectric conversion; and

[0187] A plurality of third pixels are disposed between the plurality of first pixels and each includes a third photoelectric conversion portion that receives light of a third wavelength to perform photoelectric conversion.

[0188] (2) The photodetector according to (1), wherein the number of the first pixels is greater than the sum of the number of the second pixels and the number of the third pixels.

[0189] (3) The photodetector according to (1) or (2), wherein the plurality of first pixels include a plurality of first pixels disposed to surround the plurality of second pixels and a plurality of first pixels disposed to surround the plurality of third pixels.

[0190] (4) The photodetector according to any one of (1) to (3), wherein the plurality of first pixels include a plurality of first pixels arranged to surround four of the second pixels and a plurality of first pixels arranged to surround four of the third pixels.

[0191] (5) The photodetector according to any one of (1) to (4), wherein the first pixels each include a first color filter that transmits light of the first wavelength.

[0192] (6) The photodetector according to any one of (1) to (5), wherein

[0193] The second pixels each include a second color filter that transmits light of the second wavelength, and

[0194] The third pixels respectively include third color filters that transmit light of the third wavelength.

[0195] (7) The photodetector according to any one of (1) to (6), wherein the light dispersing portion of each of the first pixels adjacent to the second pixel guides the light of the second wavelength in the incident light to the second photoelectric conversion portion side.

[0196] (8) The photodetector according to any one of (1) to (7), wherein the light dispersing portion of each of the first pixels adjacent to the third pixel guides the light of the third wavelength in the incident light to the third photoelectric conversion portion side.

[0197] (9) The photodetector according to any one of (1) to (8), wherein the second photoelectric conversion portion photoelectrically converts light transmitted through the light scattering portion and the second color filter.

[0198] (10) The photodetector according to any one of (1) to (9), wherein the third photoelectric conversion portion photoelectrically converts light transmitted through the light scattering portion and the third color filter.

[0199] (11) The photodetector according to any one of (1) to (10), wherein the first color filter transmits light in a green wavelength region as the light of the first wavelength.

[0200] (12) The photodetector according to any one of (1) to (11), wherein

[0201] The second color filter transmits light in a red wavelength region as light of the second wavelength, and

[0202] The third color filter transmits light in a blue wavelength region as the third wavelength of light.

[0203] (13) The photodetector according to any one of (1) to (12), wherein a refractive index of the structure is higher than a refractive index of a medium adjacent to the structure.

[0204] (14) A light detection device comprising:

[0205] A plurality of pixels, the plurality of pixels comprising:

[0206] a first set of pixels that sense light in a first wavelength range;

[0207] a second pixel group that senses light of a second wavelength range different from the first wavelength range, the second pixel group being arranged between pixels of the first pixel group; and

[0208] A first layer includes a first nanostructure located above the first pixel group to redirect light.

[0209] (15) The light detection device according to (14), wherein the plurality of pixels further include:

[0210] A third pixel group senses light in a third wavelength range different from the first wavelength range and the second wavelength range, the third pixel group being arranged between pixels of the first pixel group.

[0211] (16) A light detection device according to one or more of (14) to (15), wherein the number of pixels in the first pixel group is greater than the sum of the number of pixels in the second pixel group and the number of pixels in the third pixel group.

[0212] (17) A light detection device according to one or more of (14) to (16), wherein the number of pixels in the first pixel group is three times the sum of the number of pixels in the second pixel group and the number of pixels in the third pixel group.

[0213] (18) The light detection device according to one or more of (14) to (17), wherein the second pixel group is surrounded by pixels in the first pixel group.

[0214] (19) The light detection device according to one or more of (14) to (18), wherein the second pixel group includes four pixels in a 2×2 array.

[0215] (20) The light detection device according to (15), wherein the third pixel group is surrounded by pixels in the first pixel group.

[0216] (21) The light detection device according to (15) or (20), wherein the third pixel group includes four pixels in a 2×2 array.

[0217] (22) The light detection device according to one or more of (14) to (21), further comprising:

[0218] a first color filter that is used for pixels in the first pixel group and transmits light in the first wavelength range; and

[0219] A second color filter is used for pixels in the second pixel group and transmits light in the second wavelength range.

[0220] (23) The light detection device according to one or more of (14) to (22), further comprising:

[0221] A third color filter is used for pixels in the third pixel group and transmits light in the third wavelength range.

[0222] (24) The photodetection device according to one or more of (14) to (23), wherein the first nanostructure redirects light in the second wavelength range to the second color filter.

[0223] (25) A light detection device according to one or more of (14) to (24), wherein the pixels in the second pixel group include photodiodes that receive redirected light in the second wavelength range that passes through the second color filter.

[0224] (26) The photodetection device according to one or more of (14) to (25), wherein the first nanostructure redirects the light of the third wavelength range to the third color filter.

[0225] (27) A light detection device according to one or more of (14) to (26), wherein the pixels in the third pixel group include photodiodes that receive redirected light in the third wavelength range that passes through the third filter.

[0226] (28) The light detection device according to one or more of (14) to (27), wherein the first layer further comprises:

[0227] a second nanostructure located above the second pixel group; and

[0228] A third nanostructure is located above the third pixel group.

[0229] (29) The light detecting device according to one or more of (14) to (28), wherein the first nanostructure is arranged in the first material of the first layer, and wherein the first nanostructure has a higher refractive index than the first material.

[0230] (30) The light detection device according to one or more of (14) to (29), further comprising:

[0231] A first color filter, which is used for the first pixel group and transmits the first wavelength range;

[0232] a second color filter, which is used for the second pixel group and transmits the second wavelength range;

[0233] a first on-chip lens disposed on the first color filter; and

[0234] A second on-chip lens is disposed on the second color filter.

[0235] (31) The light detection device according to (30), wherein the second pixel group includes four pixels in a 2×2 array, and wherein the second on-chip lens covers the four pixels of the second pixel group.

[0236] (32) An electronic device comprising:

[0237] a signal processor; and

[0238] A light detection device comprising:

[0239] A plurality of pixels, the plurality of pixels comprising:

[0240] a first set of pixels that sense light in a first wavelength range;

[0241] a second pixel group that senses light of a second wavelength range different from the first wavelength range, the second pixel group being arranged between pixels of the first pixel group; and

[0242] A first layer includes a first nanostructure located above the first pixel group to redirect light.

[0243] (33) A light detection device comprising:

[0244] A plurality of pixels, the plurality of pixels comprising:

[0245] a first set of pixels that sense light in a first wavelength range;

[0246] a second pixel group that senses light in a second wavelength range different from the first wavelength range, the second pixel group being surrounded on all sides by pixels of the first pixel group; and

[0247] The first layer includes a first nanostructure located above the first pixel group to guide light to the photoelectric conversion region of the second pixel group.

[0248] Those skilled in the art should understand that various modifications, combinations, sub-combinations and alterations may be made according to design requirements and other factors as long as they are within the scope of protection of the appended claims or the equivalents thereof.

[0249] [reference numerals list]

[0250] 1 Camera device

[0251] 12 Photoelectric conversion unit

[0252] 30 Light scattering unit

[0253] 31 Structure

[0254] 40 Color Filters

Claims

1. A light detection device, include: A plurality of pixels, the plurality of pixels comprising: a first set of pixels that sense light in a first wavelength range; a second pixel group that senses light of a second wavelength range different from the first wavelength range, the second pixel group being arranged between pixels of the first pixel group; and A first layer includes a first nanostructure located above the first pixel group to redirect light.

2. The light detection device according to claim 1, wherein the plurality of pixels further include: A third pixel group senses light in a third wavelength range different from the first wavelength range and the second wavelength range, the third pixel group being arranged between pixels of the first pixel group. 3 . The light detection device according to claim 1 , wherein the number of pixels in the first pixel group is greater than the sum of the number of pixels in the second pixel group and the number of pixels in the third pixel group. 4 . The light detection device according to claim 1 , wherein the number of pixels in the first pixel group is three times the sum of the number of pixels in the second pixel group and the number of pixels in the third pixel group. The light detection device according to claim 1 , wherein the second pixel group is surrounded by pixels in the first pixel group. The light detection device according to claim 5 , wherein the second pixel group comprises four pixels in a 2×2 array. 7 . The light detection device according to claim 2 , wherein the third pixel group is surrounded by pixels in the first pixel group.

8. The light detection arrangement of claim 7, wherein the third pixel group comprises four pixels in a 2x2 array.

9. The light detection device according to claim 2, further comprising: include: a first color filter, which is used for pixels in the first pixel group and transmits light in the first wavelength range; and A second color filter is used for pixels in the second pixel group and transmits light in the second wavelength range.

10. The light detection device according to claim 9, further comprising: include: A third color filter is used for pixels in the third pixel group and transmits light in the third wavelength range.

11. The light detecting device of claim 9, wherein the first nanostructure redirects light of the second wavelength range to the second color filter. 12 . The light detection device of claim 11 , wherein pixels in the second pixel group include photodiodes that receive redirected light of the second wavelength range transmitted through the second color filter.

13. The light detecting device of claim 10, wherein the first nanostructure redirects light of the third wavelength range to the third color filter. 14 . The light detection device of claim 13 , wherein pixels in the third pixel group include photodiodes that receive redirected light of the third wavelength range transmitted through the third color filter.

15. The light detection device according to claim 2, wherein the first layer further comprises include: a second nanostructure located above the second pixel group; and A third nanostructure is located above the third pixel group. 16 . The light detecting device according to claim 1 , wherein the first nanostructure is arranged in a first material of the first layer, and wherein the first nanostructure has a higher refractive index than the first material.

17. The light detection device according to claim 1, further comprising: include: A first color filter, which is used for the first pixel group and transmits the first wavelength range; a second color filter, which is used for the second pixel group and transmits the second wavelength range; a first on-chip lens disposed on the first color filter; and A second on-chip lens is disposed on the second color filter. 18 . The light detection device according to claim 17 , wherein the second pixel group includes four pixels in a 2×2 array, and wherein the second on-chip lens covers the four pixels of the second pixel group.

19. An electronic device, include: Signal processor; and A light detection device comprising: A plurality of pixels, the plurality of pixels comprising: a first set of pixels that sense light in a first wavelength range; a second pixel group that senses light of a second wavelength range different from the first wavelength range, the second pixel group being arranged between pixels of the first pixel group; and A first layer includes a first nanostructure located above the first pixel group to redirect light.

20. A light detection device, include: A plurality of pixels, the plurality of pixels comprising: a first set of pixels that sense light in a first wavelength range; a second pixel group that senses light in a second wavelength range different from the first wavelength range, the second pixel group being surrounded on all sides by pixels of the first pixel group; and The first layer includes a first nanostructure located above the first pixel group to guide light to the photoelectric conversion region of the second pixel group.