Solid-state imaging device and electronic apparatus
The integration of an axicon lens in solid-state imaging devices addresses sensitivity variations by shaping light into a ring-shaped focused spot, enhancing light collection and quantum efficiency across photoelectric conversion units.
Patent Information
- Application Number
- PCT/JP2024/018430
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-06-20
- Filing Date
- 2024-05-20
- Publication Date
- 2024-12-26
Smart Images

Figure JP2024018430_26122024_PF_FP_ABST
Abstract
Description
Solid-state imaging device and electronic device
[0001] The technology according to the present disclosure (hereinafter also referred to as "the technology") relates to a solid-state imaging device and an electronic device.
[0002] 2. Description of the Related Art Conventionally, a solid-state imaging device is known in which light is incident on a photoelectric conversion unit via an on-chip lens (see, for example, Patent Document 1).
[0003] For example, in the solid-state imaging device described in Patent Document 1, the light-receiving surface of the photoelectric conversion section is formed in a convex shape, which can increase the light-collection efficiency.
[0004] JP 2011-222744 A
[0005] However, when conventional solid-state imaging devices adopt a configuration in which light is incident through an on-chip lens onto a photoelectric conversion unit group including multiple photoelectric conversion units, there is room for improvement in terms of reducing the sensitivity difference between the photoelectric conversion units regardless of the position of the focused spot formed on the photoelectric conversion unit group.
[0006] Therefore, the main object of the present technology is to provide a solid-state imaging device that can reduce the difference in sensitivity between photoelectric conversion units regardless of the position of the focused spot formed on the photoelectric conversion unit group corresponding to the on-chip lens.
[0007] The present technology provides a solid-state imaging device including: a photoelectric conversion unit group including a plurality of photoelectric conversion units; an on-chip lens corresponding to the photoelectric conversion unit group; and an axicon lens arranged between a light incident surface of the on-chip lens and the photoelectric conversion unit group. Light passing through the light incident surface and the axicon lens in this order may be incident across the plurality of photoelectric conversion units. The axicon lens may be arranged inside the on-chip lens. The axicon lens may be arranged between the on-chip lens and the photoelectric conversion unit group. The axicon lens may be convex toward the on-chip lens. The axicon lens may be convex toward the photoelectric conversion unit group. A plurality of the axicon lenses may be arranged along an optical axis of the on-chip lens. The plurality of axicon lenses may include an axicon lens convex toward the on-chip lens and an axicon lens convex toward the photoelectric conversion unit group. The plurality of photoelectric conversion units may be two-dimensionally arranged along a plane intersecting the optical axis of the on-chip lens. The two-dimensional array may be a matrix array. The matrix array may be an N×N matrix array (N is an integer of 2 or greater). The two-dimensional array may be a staggered array. The optical axis of the on-chip lens and the optical axis of the axicon lens may be parallel. The optical axis of the on-chip lens and the optical axis of the axicon lens may coincide. The axicon lens preferably has a ratio of the diameter of the base to the height of 2 or greater and 4 or less. The axicon lens may be provided with an anti-reflection film. A plurality of the photoelectric conversion unit groups may be two-dimensionally arranged in an in-plane direction of the semiconductor substrate inside the semiconductor substrate, and the on-chip lens and the axicon lens may be provided for each photoelectric conversion unit group. The solid-state imaging device may further include a color filter group including a plurality of color filters, arranged between the semiconductor substrate and an on-chip lens group including a plurality of the on-chip lenses. The color filters may individually correspond to the plurality of photoelectric conversion unit groups.The present technology also provides an electronic device equipped with a solid-state imaging device, the solid-state imaging device including: a photoelectric conversion unit group including a plurality of photoelectric conversion units; an on-chip lens corresponding to the photoelectric conversion unit group; and an axicon lens arranged between a light incident surface of the on-chip lens and the photoelectric conversion unit group.
[0008] 5A is a cross-sectional view of a portion of a solid-state imaging device according to Example 1 of an embodiment of the present technology. FIG. 5B is a cross-sectional view of another portion of a solid-state imaging device according to Example 1 of an embodiment of the present technology. FIG. 5B is a perspective view of a portion of a solid-state imaging device according to Example 1 of an embodiment of the present technology. FIG. 5A is a diagram for explaining an operation of a solid-state imaging device according to Comparative Example 1. FIG. 5B is a diagram (part 1) for explaining an operation of a solid-state imaging device according to Comparative Example 2. FIG. 7A is a diagram (part 1) for explaining an operation of a solid-state imaging device according to the present technology. FIG. 7B is a diagram (part 2 ... Example 2 of an embodiment of the present technology. FIG. 5B is a cross-sectional view of another portion of a solid-state imaging device according to Example 2 of an embodiment of the present technology. FIG. 5C is a perspective view of a portion of a solid-state imaging device according to Example 3 of an embodiment of the present technology. FIG. 5D is a cross-sectional view of another portion of a solid-state imaging device according to Example 3 of an embodiment of the present technology. FIG. 5E is a cross-sectional view of a portion of a solid-state imaging device according to Example 4 of an embodiment of the present technology. 23A is a cross-sectional view of another portion of a solid-state imaging device according to Example 4 of an embodiment of the present technology. FIG. 23B is a cross-sectional view of a portion of a solid-state imaging device according to Example 5 of an embodiment of the present technology. FIG. 23C is a cross-sectional view of another portion of a solid-state imaging device according to Example 5 of an embodiment of the present technology. FIG. 23D is a cross-sectional view of another portion of a solid-state imaging device according to Example 6 of an embodiment of the present technology. FIG. 23E is a cross-sectional view of another portion of a solid-state imaging device according to Example 6 of an embodiment of the present technology. FIG. 23F is a cross-sectional view of a portion of a solid-state imaging device according to Example 7 of an embodiment of the present technology. FIG. 23G is a cross-sectional view of a portion of a solid-state imaging device according to Example 8 of an embodiment of the present technology. FIG. 23H is a cross-sectional view of a portion of a solid-state imaging device according to Example 8 of an embodiment of the present technology.Fig. 1 is a functional block diagram of an example of an electronic device including a solid-state imaging device to which the present technology is applied; Fig. 2 is a block diagram showing an example of a schematic configuration of a vehicle control system; Fig. 3 is an explanatory diagram showing an example of installation positions of an outside-of-vehicle information detection unit and an imaging unit; Fig. 4 is a diagram showing an example of a schematic configuration of an endoscopic surgery system; Fig. 5 is a block diagram showing an example of the functional configuration of a camera head and a CCU;
[0009] Preferred embodiments of the present technology will be described in detail below with reference to the accompanying drawings. Note that in this specification and the drawings, components having substantially the same functional configurations are denoted by the same reference numerals, and redundant description will be omitted. The embodiments described below illustrate typical embodiments of the present technology, and the scope of the present technology should not be interpreted narrowly. Even when it is described in this specification that a solid-state imaging device and an electronic device according to the present technology achieve multiple effects, it is sufficient that the solid-state imaging device and the electronic device according to the present technology achieve at least one effect. The effects described in this specification are merely examples and are not limiting, and other effects may also be achieved.
[0010] The description will be made in the following order: 0. Introduction 1. Solid-state imaging device according to Example 1 of an embodiment of the present technology 2. Solid-state imaging device according to Example 2 of an embodiment of the present technology 3. Solid-state imaging device according to Example 3 of an embodiment of the present technology 4. Solid-state imaging device according to Example 4 of an embodiment of the present technology 5. Solid-state imaging device according to Example 5 of an embodiment of the present technology 6. Solid-state imaging device according to Example 6 of an embodiment of the present technology 7. Solid-state imaging device according to Example 7 of an embodiment of the present technology 8. Solid-state imaging device according to Example 8 of an embodiment of the present technology 9. Solid-state imaging device according to Example 9 of an embodiment of the present technology 10. Modifications of the present technology 11. Usage example of a solid-state imaging device to which the present technology is applied 12. Other usage examples of a solid-state imaging device to which the present technology is applied 13. Application example to a moving body 14. Application example to an endoscopic surgery system
[0011] <0. Introduction> One example of the structure of recent CIS (Contact Image Sensors) for mobile applications is the 2x2 OCL (On-Chip Lens) structure. This is a structure in which one OCL is arranged in a Quad Bayer array in which four photoelectric conversion units (PDs) corresponding to one color filter are arranged in two rows and two columns. The 2x2 OCL structure has the advantage of being able to acquire phase differences both vertically and horizontally.
[0012] On the other hand, in the 2 × 2 OCL structure (see FIG. 5B ), there is a concern that the difference in sensitivity between the same colors (the difference in sensitivity between the above-mentioned photoelectric conversion units) may become larger than in the 1 × 1 OCL structure (see FIG. 5A ), for example, due to a shift in the light-focus spot LS caused by a shift in the optical axis of the OCL, etc. In FIGS. 5A and 5B , CF-R indicates a red (R) color filter, CF-G indicates a green (G) color filter, and CF-B indicates a blue (B) color filter.
[0013] Therefore, after extensive research, the inventors have succeeded in reducing the difference in sensitivity between the same colors due to the shift in the focused spot by placing an axicon lens on the optical path of the light that passes through the light entrance surface of the OCL and shaping the cross-sectional shape of the light into a ring shape.
[0014] Then, the inventors invented a solid-state imaging device (solid-state imaging device according to the present technology) that can reduce the difference in sensitivity between photoelectric conversion units regardless of the position of the focused spot formed on the group of photoelectric conversion units corresponding to the on-chip lens, as a technical idea that conceptualizes this technology.
[0015] Hereinafter, an embodiment of the present technology will be described in detail with reference to several examples. In each of the following examples, for convenience, the upper side of each drawing will be referred to as "upper", the lower side as "lower", the left side as "left", and the right side as "right".
[0016] 1. Solid-state imaging device according to example 1 of an embodiment of the present technology Configuration of solid-state imaging device (Overall configuration) Fig. 1 is a cross-sectional view of a portion of a solid-state imaging device 1 according to example 1 of an embodiment of the present technology. Fig. 2 is a cross-sectional view of another portion of the solid-state imaging device 1 according to example 1 of an embodiment of the present technology. Fig. 3 is a perspective view of the solid-state imaging device 1 according to example 1 of an embodiment of the present technology. Fig. 4 is a plan view of the solid-state imaging device 1 according to example 1 of an embodiment of the present technology. Fig. 1 is a cross-sectional view taken along line 1-1 in Fig. 4. Fig. 2 is a cross-sectional view taken along line 2-2 in Fig. 4.
[0017] The solid-state imaging device 1 is, for example, a back-illuminated solid-state imaging device (image sensor). As shown in FIGS. 1 to 4 , the solid-state imaging device 1 includes a plurality of pixel groups PG (pixel blocks) each including a plurality of (for example, four) pixels P (for example, pixels P1, P2, P3, and P4). Here, the plurality of pixel groups PG are arranged in a matrix. Each pixel group PG has a Quad Bayer array. Each pixel P is a dual pixel that performs both imaging and phase difference detection.
[0018] As an example, each pixel P has a photoelectric conversion unit group 102 including four photoelectric conversion units 102 a, an on-chip lens 500 corresponding to the photoelectric conversion unit group 102, and an axicon lens 400A arranged between the light incident surface 500 a of the on-chip lens 500 and the photoelectric conversion unit group 102.
[0019] The photoelectric conversion unit group 102 of each pixel P is provided on a semiconductor substrate SS. The semiconductor substrate 50 may be, for example, a Si substrate, a Ge substrate, a GaAs substrate, or an InGaAs substrate. The on-chip lens 500 and axicon lens 400A of each pixel P are included in an optical substrate OB that is stacked on the semiconductor substrate SS. That is, the on-chip lens 500 and axicon lens 400A of each of the multiple pixels P are integrally provided.
[0020] As can be seen from the above description, a plurality of photoelectric conversion unit groups 102 are arranged two-dimensionally (e.g., in a matrix array) inside the semiconductor substrate SS in the in-plane direction of the semiconductor substrate SS, and an on-chip lens 500 and an axicon lens 400A are provided for each photoelectric conversion unit group 102.
[0021] (Photoelectric Conversion Unit Group, Photoelectric Conversion Unit) The four photoelectric conversion units 102a of each photoelectric conversion unit group 102 are two-dimensionally arranged in the in-plane direction inside the semiconductor substrate SS (along a plane intersecting the optical axis of the on-chip lens 500). The two-dimensional arrangement is a matrix arrangement. The matrix arrangement is an N×N (e.g., 2×2) matrix arrangement, where N is an integer equal to or greater than 2. Each photoelectric conversion unit 102a is, for example, a PD (photodiode). More specifically, each photoelectric conversion unit 102a is, for example, a PN photodiode, a PIN photodiode, a SPAD (Single Photon Avalanche Photodiode), an APD (Avalanche Photo Diode), or the like.
[0022] (Color Filter) Each pixel P has a color filter 300 provided on the semiconductor substrate SS via an insulating film 200. The insulating film 200 is made of, for example, SiO, SiO 2 The insulating film 200 is made of an insulating material such as SiN or SiON. The insulating film 200 is shared by a plurality of pixels P, for example.
[0023] The pixel P1 has a color filter 300A (see FIG. 1) between the on-chip lens 500 and the photoelectric conversion unit group 102. The color filter 300A transmits a blue wavelength band (for example, 450 to 485 nm).
[0024] The pixel P2 has a color filter 300B (see FIG. 1) between the on-chip lens 500 and the photoelectric conversion unit group 102. The color filter 300B transmits a green wavelength band (for example, 500 to 565 nm).
[0025] The pixel P3 has a color filter 300B (see FIG. 2) between the on-chip lens 500 and the photoelectric conversion unit group 102. The color filter 300B transmits a green wavelength band (for example, 500 to 565 nm).
[0026] The pixel P4 has a color filter 300C (see FIG. 2) between the on-chip lens 500 and the photoelectric conversion unit group 102. The color filter 300C has a transmission wavelength band in the red band (for example, 625 nm to 780 nm).
[0027] As can be seen from the above description, a color filter group including a plurality of color filters 300 is disposed between the on-chip lens group including a plurality of on-chip lenses 500 and the semiconductor substrate SS, and the plurality of color filters 300 individually correspond to the plurality of photoelectric conversion unit groups 102. (Intra-pixel Separation Wall) Each pixel P has an intra-pixel separation wall 104 provided between two adjacent photoelectric conversion units 102a. In each pixel P, the intra-pixel separation wall 104 electrically separates (insulates) the adjacent photoelectric conversion units 102a. Here, the intra-pixel separation wall 104 is provided over the entire thickness direction (vertical direction) of the semiconductor substrate SS, but may be provided over only a portion of the thickness direction. In plan view, the intra-pixel separation wall 104 is formed, for example, in a lattice shape along the boundary line between the adjacent photoelectric conversion units 102a. The intra-pixel separation wall 104 is made of, for example, SiO, SiO 2 The insulating material is made of an insulating material such as SiN or SiON.
[0028] (Inter-pixel separation wall) In each pixel group PG, an inter-pixel separation wall 103 is provided between two adjacent pixels P. The inter-pixel separation wall 103 electrically and optically separates the adjacent pixels. In more detail, the inter-pixel separation wall 103 is made of an insulator (e.g., SiO, SiO 2 The inter-pixel separation wall 103 has a first separation portion 103a made of a material such as silicon (SiN, SiON, etc.) and a second separation portion 103b made of a metal (for example, W, Al, Ni, etc.). The first separation portion 103a is provided, for example, across the entire thickness direction (vertical direction) of the semiconductor substrate SS, and electrically separates (insulates) adjacent pixels. The second separation portion 103b is provided on the end (upper end) of the first separation portion 103a on the insulating film 200 side, and functions as a light-shielding wall that optically separates adjacent pixels. The inter-pixel separation wall 103 is formed, for example, in a lattice shape along the boundary line between adjacent pixels in a plan view. The first separation portion 103a may be provided only in a portion of the thickness direction of the semiconductor substrate SS.
[0029] (Axicon Lens) In each pixel P, the axicon lens 400A is disposed inside the on-chip lens 500. More specifically, the axicon lens 400A is provided integrally with the on-chip lens 500 by being fitted into a conical recess formed on the light-emitting surface of the on-chip lens 500. An axicon lens is also called a "conical lens." A beam that passes through an axicon lens becomes a beam that is almost diffracted and is similar to a Bessel beam in the near field, and therefore, a decrease in light utilization efficiency can be suppressed.
[0030] In each pixel P, light (see FIG. 7A ) passes through the light-entering surface of the on-chip lens 500, the axicon lens 400A, and the color filter 300 in this order and is incident across the four photoelectric conversion units 102 a (see FIG. 7B ). At this time, in each pixel P, the light-focusing spot LS-R formed on the photoelectric conversion unit group 102 is ring-shaped, so it is possible to reduce the sensitivity difference (sensitivity difference between the same color) between the photoelectric conversion units 102 a regardless of the position of the light-focusing spot LS-R. Furthermore, optical simulation of the spectral characteristics (quantum efficiency / wavelength) has shown that the quantum efficiency is improved in each of the R, G, and B wavelength bands compared to a solid-state imaging device (see FIG. 5B ) in which a circular light-focusing spot is formed on the photoelectric conversion unit group.
[0031] For example, the axicon lens 400A is convex toward the on-chip lens 500 side.
[0032] It is preferable that the optical axis OA1 of the on-chip lens 500 and the optical axis OA2 of the axicon lens 400A are parallel to each other.
[0033] It is preferable that the optical axis OA1 of the on-chip lens 500 and the optical axis OA2 of the axicon lens 400A coincide with each other.
[0034] In the axicon lens 400A, the ratio D / H of the diameter D of the bottom surface to the height H is preferably 2 or more and 4 or less, more preferably 2.3 or more and 3.5 or less, and even more preferably 2.5 or more and 3 or less. Here, as an example, D / H=2.8. By making D / H 2 or more and 4 or less, an appropriate ring-shaped focused spot can be formed on the photoelectric conversion unit group 102.
[0035] It is preferable that an AR coating (anti-reflection coating) is provided on the light entrance surface and / or light exit surface of the axicon lens 400A, thereby preventing light reflection at the axicon lens 400A and suppressing a decrease in light utilization efficiency.
[0036] (Analog Circuit) On the semiconductor substrate SS, for example, a control circuit (analog circuit) that controls each pixel P and an A / D conversion circuit (analog circuit) are formed.
[0037] The control circuit has circuit elements such as transistors. More specifically, the control circuit includes, for example, a plurality of pixel transistors (so-called MOS transistors) and a signal processing unit. The plurality of pixel transistors may be configured with, for example, three transistors: a transfer transistor, a reset transistor, and an amplification transistor. Alternatively, a selection transistor may be added to configure the control circuit with four transistors. The signal processing unit detects a phase difference based on electrical signals from the two photoelectric conversion units 102a of each pixel P. The A / D conversion circuit converts the analog signal generated by each pixel P into a digital signal.
[0038] (Processing Substrate) As an example, a processing substrate (not shown) including, for example, a logic circuit and a memory circuit is disposed on the opposite side (lower side) of the semiconductor substrate 50 from the insulating film 200 side, via a wiring layer. The logic circuit processes the digital signal generated by the A / D conversion circuit. The memory circuit temporarily stores and holds the digital signal generated by the A / D conversion circuit and / or the digital signal processed by the logic circuit. The processing substrate has at least one layer of a stacked structure in which, for example, a semiconductor substrate and a wiring layer are stacked. In the processing substrate, the logic circuit and memory circuit may be juxtaposed or stacked.
[0039] <<Operation Example of Solid-State Imaging Device>> An operation example of the solid-state imaging device 1 will be described below. In the solid-state imaging device 1, as an example, a phase difference detection mode is executed before focus adjustment, and an imaging mode is executed after focus adjustment using image-plane phase difference AF. This cycle is repeated. Light from the subject (image light) passes through the on-chip lens 500, axicon lens 400A, and color filter 300 of each pixel P in this order, and is incident across the four photoelectric conversion units 102a, 102a, 102a, 102a of the pixel P.
[0040] In the phase difference detection mode, the electrical signals photoelectrically converted by the two vertically adjacent photoelectric conversion units 102 a, 102 a are individually transmitted to the signal processing unit. The signal processing unit detects the vertical phase difference (out-of-focus) based on the difference between these electrical signals (analog signals). In the phase difference detection mode, the electrical signals photoelectrically converted by the two horizontally adjacent photoelectric conversion units 102 a, 102 a are individually transmitted to the signal processing unit. The signal processing unit detects the horizontal phase difference (out-of-focus) based on the difference between these electrical signals (analog signals). Focus adjustment can be performed using image plane phase difference AF based on the detected vertical phase difference and horizontal phase difference.
[0041] In the imaging mode, the electrical signals (analog signals) obtained by photoelectric conversion and summing at the four photoelectric conversion units 102 a are transmitted to the A / D conversion circuit and converted into digital signals, which are then temporarily stored and held in the memory circuit and sequentially transmitted to the logic circuit. The logic circuit processes the transmitted digital signals. The digital signals can also be temporarily stored and held in the memory circuit during and / or after processing by the logic circuit.
[0042] <Effects of Solid-State Imaging Device> The solid-state imaging device 1 according to the present technology includes a photoelectric conversion unit group 102 including a plurality of (for example, four) photoelectric conversion units 102 a, an on-chip lens 500 corresponding to the photoelectric conversion unit group 102, and an axicon lens 400A arranged between the light incident surface of the on-chip lens 500 and the photoelectric conversion unit group 102.
[0043] According to the solid-state imaging device 1, it is possible to provide a solid-state imaging device that can reduce the sensitivity difference between the photoelectric conversion units 102a regardless of the position of the focused spot formed on the photoelectric conversion unit group 102 corresponding to the on-chip lens 500.
[0044] 2. Solid-state imaging device according to Example 2 of an embodiment of the present technology> Fig. 8 is a cross-sectional view of a part of a solid-state imaging device 2 according to Example 2 of an embodiment of the present technology. Fig. 9 is a cross-sectional view of another part of the solid-state imaging device 2 according to Example 2 of an embodiment of the present technology. Fig. 10 is a perspective view of the solid-state imaging device 2 according to Example 2 of an embodiment of the present technology. Fig. 8 is a cross-sectional view corresponding to Fig. 1. Fig. 9 is a cross-sectional view corresponding to Fig. 2.
[0045] As shown in Figures 8 to 10, the solid-state imaging device 2 has a configuration that is generally similar to that of the solid-state imaging device 1 of Example 1, except that in each pixel P, the axicon lens 400B is convex toward the photoelectric conversion unit group 102 side.
[0046] The axicon lens 400B is embedded inside the on-chip lens 500 so as to be convex on the photoelectric conversion unit group 102 side.
[0047] According to the solid-state imaging device 2, the same effects as those of the solid-state imaging device 1 according to the first embodiment can be obtained.
[0048] 3. Solid-state imaging device according to Example 3 of an embodiment of the present technology> Fig. 11 is a cross-sectional view of a part of a solid-state imaging device 3 according to Example 3 of an embodiment of the present technology. Fig. 12 is a cross-sectional view of another part of the solid-state imaging device 3 according to Example 3 of an embodiment of the present technology. Fig. 11 is a cross-sectional view corresponding to Fig. 1. Fig. 12 is a cross-sectional view corresponding to Fig. 2.
[0049] As shown in FIGS. 11 and 12 , the solid-state imaging device 3 has a configuration generally similar to that of the solid-state imaging device 1 according to the first embodiment, except that a plurality of (for example, two) axicon lenses are arranged along the optical axis of the on-chip lens 500 in each pixel P.
[0050] In the solid-state imaging device 3, as an example, the multiple (for example, two) axicon lenses include an axicon lens 400A that is convex toward the on-chip lens 500 side and an axicon lens 400B that is convex toward the photoelectric conversion unit group 102 side.
[0051] The two axicon lenses 400A and 400B are, for example, substantially identical axicon lenses, and their bottom surfaces are cemented together so that their optical axes coincide with each other.
[0052] According to the solid-state imaging device 3, the same effects as those of the solid-state imaging device 1 according to the first embodiment can be obtained, and the ring-shaped focused spot can be adjusted by combining the two axicon lenses 400A and 400B.
[0053] 4. Solid-state imaging device according to Example 4 of an embodiment of the present technology> Fig. 13 is a cross-sectional view of a part of a solid-state imaging device 4 according to Example 4 of an embodiment of the present technology. Fig. 14 is a cross-sectional view of another part of the solid-state imaging device 4 according to Example 4 of an embodiment of the present technology. Fig. 13 is a cross-sectional view corresponding to Fig. 1. Fig. 14 is a cross-sectional view corresponding to Fig. 2.
[0054] As shown in FIGS. 13 and 14 , the solid-state imaging device 4 has a configuration generally similar to that of the solid-state imaging device 3 according to the third embodiment, except that in each pixel P, a plurality of (for example, two) axicon lenses are spaced apart in the optical axis direction of the on-chip lens 500.
[0055] As an example, the two axicon lenses 400A and 400B are embedded in the on-chip lens 500 so that their optical axes coincide with each other and their bottom surfaces face each other.
[0056] According to the solid-state imaging device 4, the same effects as those of the solid-state imaging device 1 according to the first embodiment can be obtained, and the ring-shaped focused spot can be adjusted by combining the two axicon lenses 400A and 400B.
[0057] 5. Solid-state imaging device according to example 5 of embodiment of the present technology> Fig. 15 is a cross-sectional view of a part of a solid-state imaging device 5 according to example 5 of an embodiment of the present technology. Fig. 16 is a cross-sectional view of another part of the solid-state imaging device 5 according to example 5 of an embodiment of the present technology. Fig. 15 is a cross-sectional view corresponding to Fig. 1. Fig. 16 is a cross-sectional view corresponding to Fig. 2.
[0058] As shown in FIGS. 15 and 16 , the solid-state imaging device 5 has a configuration generally similar to that of the solid-state imaging device 1 according to the first embodiment, except that in each pixel P, the axicon lens 400A is disposed between the on-chip lens 500 (more specifically, the light-emitting surface of the on-chip lens 500) and the photoelectric conversion unit group 102.
[0059] In the solid-state imaging device 5, an on-chip lens group including a plurality of on-chip lenses 500 is provided on a transparent substrate 600. The transparent substrate 600 is disposed on a color filter group. An axicon lens 400A is fitted into a conical recess formed on the surface (lower surface) of the transparent substrate 600 facing the photoelectric conversion unit group 102. The refractive index of the transparent substrate 600 is preferably the same as the refractive index of the on-chip lens 500.
[0060] According to the solid-state imaging device 5, the same effects as those of the solid-state imaging device 1 according to the first embodiment can be obtained.
[0061] 6. Solid-state imaging device according to Example 6 of an embodiment of the present technology> Fig. 17 is a cross-sectional view of a part of a solid-state imaging device 6 according to Example 6 of an embodiment of the present technology. Fig. 18 is a cross-sectional view of another part of the solid-state imaging device 6 according to Example 6 of an embodiment of the present technology. Fig. 17 is a cross-sectional view corresponding to Fig. 1. Fig. 18 is a cross-sectional view corresponding to Fig. 2.
[0062] As shown in FIGS. 17 and 18 , the solid-state imaging device 6 has a configuration that is generally similar to that of the solid-state imaging device 1 according to Example 1, except that in each pixel P, the axicon lens 400B is disposed between the on-chip lens 500 (more specifically, the light-emitting surface of the on-chip lens 500) and the photoelectric conversion unit group 102.
[0063] In the solid-state imaging device 6, an on-chip lens group including a plurality of on-chip lenses 500 is provided on a transparent substrate 600. The transparent substrate 600 is disposed on a color filter group. An axicon lens 400B is embedded inside the transparent substrate 600. The refractive index of the transparent substrate 600 is preferably the same as the refractive index of the on-chip lens 500.
[0064] According to the solid-state imaging device 6, the same effects as those of the solid-state imaging device 1 according to the first embodiment can be obtained.
[0065] 7. Solid-state imaging device according to Example 7 of an embodiment of the present technology FIG. 19 is a cross-sectional view of a solid-state imaging device 7 according to Example 7 of an embodiment of the present technology.
[0066] As shown in FIG. 19, the solid-state imaging device 7 has a configuration that is generally similar to that of the solid-state imaging device 1 according to the first embodiment, except that it has a single pixel.
[0067] According to the solid-state imaging device 7, it is possible to realize a solid-state imaging device having a single color pixel, which can obtain the same effect as the solid-state imaging device 1 according to Example 1. Here, a blue (B) color filter 300A is provided, but instead, a green (G) color filter 300B or a red (R) color filter 300C may be provided. <8. Solid-state imaging device according to Example 8 of an embodiment of the present technology> FIG. 20 is a cross-sectional view of a part of the solid-state imaging device 8 according to Example 8 of an embodiment of the present technology. FIG. 21 is a cross-sectional view of another part of the solid-state imaging device 8 according to Example 8 of an embodiment of the present technology. FIG. 20 is a cross-sectional view corresponding to FIG. 1. FIG. 21 is a cross-sectional view corresponding to FIG. 2.
[0068] As shown in FIGS. 20 and 21, the solid-state imaging device 8 has a configuration that is generally similar to that of the solid-state imaging device 1 according to the first embodiment, except that it does not have a color filter group.
[0069] According to the solid-state imaging device 8, it is possible to realize a solid-state imaging device having a plurality of monochrome pixels, which can obtain the same effects as the solid-state imaging device 1 according to the first embodiment.
[0070] 9. Solid-state imaging device according to example 9 of embodiment of the present technology FIG. 22 is a cross-sectional view of a solid-state imaging device 9 according to example 9 of an embodiment of the present technology.
[0071] As shown in FIG. 22, the solid-state imaging device 9 has a configuration generally similar to that of the solid-state imaging device 8 according to the eighth embodiment, except that it has a single pixel.
[0072] According to the solid-state imaging device 9, it is possible to realize a solid-state imaging device having a single monochrome pixel, which can obtain the same effects as the solid-state imaging device 1 according to the first embodiment.
[0073] 10. Modifications of the Present Technology The configuration of the solid-state imaging device according to each of the above-described embodiments can be modified as appropriate.
[0074] In the above-described embodiments, one on-chip lens 500 is provided in common for four photoelectric conversion units 102a arranged in a 2×2 matrix, but this is not limiting. For example, as in the solid-state imaging device according to Modification 1 shown in FIG. 23A , one on-chip lens 500 may be provided in common for nine photoelectric conversion units 102a arranged in a 3×3 matrix. For example, as in the solid-state imaging device according to Modification 2 shown in FIG. 23B , one on-chip lens 500 may be provided in common for 16 photoelectric conversion units 102a arranged in a 4×4 matrix.
[0075] In the above-described embodiments, one on-chip lens 500 and one color filter 300 are provided in common for four photoelectric conversion units 102a arranged in a 2×2 matrix array, but this is not limiting. For example, as in a solid-state imaging device according to Modification 1 shown in FIG. 23A , one on-chip lens 500 and one color filter 300 may be provided in common for nine photoelectric conversion units 102a arranged in a 3×3 matrix array. For example, as in a solid-state imaging device according to Modification 2 shown in FIG. 23B , one on-chip lens 500 and one color filter 300 may be provided in common for 16 photoelectric conversion units 102a arranged in a 4×4 matrix array.
[0076] In each of the above embodiments, the multiple photoelectric conversion units 102a that make up the photoelectric conversion unit group 102 are arranged in an N x N matrix array (N is an integer greater than or equal to 2), but this may be extended so that the multiple photoelectric conversion units 102a that make up the photoelectric conversion unit group 102 are arranged in a K x I matrix array (at least one of K and I is an integer greater than or equal to 2).
[0077] In each of the above-described embodiments, the plurality of photoelectric conversion units 102a constituting the photoelectric conversion unit group 102 are arranged in a matrix, but this is not limiting. For example, as in the solid-state imaging device according to Modification 3 shown in Fig. 24, the plurality of photoelectric conversion units 102a constituting the photoelectric conversion unit group 102 may be arranged in a staggered pattern. In this case, it is preferable that each color filter 300 has a shape corresponding to the arrangement of the plurality of photoelectric conversion units 102a.
[0078] The pixel array of the solid-state imaging device according to the present technology is not limited to the Bayer array, and may be another array. For example, it may be a diagonal Bayer array. For example, it may be an RGBW array in which a portion (e.g., diagonal elements) of each RGB pixel P is replaced with W (white). For example, it may be an RGB+complementary color array in which a portion of the B pixels (blue pixels) is replaced with C (cyan), a portion of the R pixels (red pixels) is replaced with M (magenta), and a portion of the G pixels (green pixels) is replaced with Y (yellow).
[0079] For example, the configurations of the solid-state imaging devices of the above-described embodiments and modifications may be combined with each other within a range that does not cause technical contradictions.
[0080] The numerical values, materials, shapes, dimensions, etc. used in the description of the above embodiments and modifications are merely examples and are not intended to limit the scope of the invention.
[0081] 11. Usage Example of Solid-State Imaging Device to which the Present Technology is Applied> FIG. 25 is a diagram showing a usage example in which a solid-state imaging device according to the present technology (for example, a solid-state imaging device according to each embodiment and modification) constitutes a solid-state imaging device (image sensor).
[0082] The above-described embodiments and modifications can be used in various cases where light such as visible light, infrared light, ultraviolet light, and X-rays is sensed, for example, as follows: That is, as shown in Fig. 25, the embodiments and modifications can be used in devices used in the fields of appreciation for capturing images for viewing, transportation, home appliances, medicine and healthcare, security, beauty, sports, agriculture, etc.
[0083] Specifically, in the field of appreciation, the solid-state imaging device according to the present technology can be used in devices for capturing images for appreciation, such as digital cameras, smartphones, and mobile phones with camera functions.
[0084] In the field of transportation, for example, the solid-state imaging device according to the present technology can be used in devices used for transportation, such as in-vehicle sensors that capture images of the front, rear, surroundings, interior, etc. of a vehicle for safe driving such as automatic stopping, or for recognizing the driver's condition, surveillance cameras that monitor moving vehicles and roads, and distance measuring sensors that measure distances between vehicles, etc.
[0085] In the field of home appliances, for example, the solid-state imaging device according to the present technology can be used in devices provided in home appliances such as television sets, refrigerators, and air conditioners to capture user gestures and operate the appliances in accordance with the gestures.
[0086] In the medical and healthcare fields, the solid-state imaging device according to the present technology can be used in devices used for medical and healthcare purposes, such as endoscopes and devices that perform angiography by receiving infrared light.
[0087] In the field of security, for example, the solid-state imaging device according to the present technology can be used in devices used for security purposes, such as surveillance cameras for crime prevention purposes and cameras for person authentication purposes.
[0088] In the field of beauty, for example, the solid-state imaging device according to the present technology can be used in devices used for beauty, such as a skin measuring device that takes pictures of the skin and a microscope that takes pictures of the scalp.
[0089] In the field of sports, for example, the solid-state imaging device according to the present technology can be used in devices used for sports, such as action cameras and wearable cameras for sports applications.
[0090] In the field of agriculture, for example, the solid-state imaging device according to the present technology can be used in devices used for agriculture, such as cameras for monitoring the conditions of fields and crops.
[0091] Next, specific examples of use of the solid-state imaging device according to the present technology (e.g., solid-state imaging devices according to the embodiments and modifications) will be described. For example, the solid-state imaging devices according to the embodiments and modifications described above can be applied as a solid-state imaging device 501 to any type of electronic device equipped with an imaging function, such as a camera system such as a digital still camera or a video camera, or a mobile phone with an imaging function. FIG. 26 shows a schematic configuration of an electronic device 510 (camera) as an example. The electronic device 510 is, for example, a video camera capable of capturing still images or videos, and includes a solid-state imaging device 501, an optical system (optical lens) 502, a shutter device 503, a driver 504 that drives the solid-state imaging device 501 and the shutter device 503, and a signal processor 505.
[0092] The optical system 502 guides image light (incident light) from the subject to the pixel region of the solid-state imaging device 501. This optical system 502 may be composed of a plurality of optical lenses. The shutter device 503 controls the light irradiation period and light blocking period of the solid-state imaging device 501. The drive unit 504 controls the transfer operation of the solid-state imaging device 501 and the shutter operation of the shutter device 503. The signal processing unit 505 performs various signal processing on the signal output from the solid-state imaging device 501. The video signal Dout after signal processing is stored in a storage medium such as a memory, or is output to a monitor, etc.
[0093] 12. Other Use Examples of Solid-State Imaging Devices to which the Present Technology is Applied The solid-state imaging device according to the present technology (e.g., the solid-state imaging devices according to the embodiments and modifications) can also be applied to other electronic devices that detect light, such as a TOF (Time Of Flight) sensor. When applied to a TOF sensor, the device can be applied to, for example, a range image sensor using a direct TOF measurement method or a range image sensor using an indirect TOF measurement method. In a range image sensor using the direct TOF measurement method, the arrival timing of photons is directly determined in the time domain at each pixel, so a light pulse with a short pulse width is transmitted and an electrical pulse is generated by a receiver with high response speed. The present disclosure can be applied to the receiver in such a case. Furthermore, in the indirect TOF method, the time of flight of light is measured using a semiconductor element structure in which the detection and accumulation amount of carriers generated by light changes depending on the arrival timing of light. The present disclosure can also be applied to such a semiconductor structure. When applied to a TOF sensor, providing a color filter and an on-chip lens as shown in FIG. 1 etc. is optional, and at least one of them may not be provided.
[0094] 13. Application Examples to Mobile Bodies The technology according to the present disclosure (the present technology) can be applied to various products. For example, the technology according to the present disclosure may be realized as a device mounted on any type of mobile body, such as an automobile, an electric vehicle, a hybrid electric vehicle, a motorcycle, a bicycle, personal mobility, an airplane, a drone, a ship, or a robot.
[0095] FIG. 27 is a block diagram showing a schematic configuration example of a vehicle control system, which is an example of a mobile object control system to which the technology according to the present disclosure can be applied.
[0096] The vehicle control system 12000 includes a plurality of electronic control units connected via a communication network 12001. In the example shown in Fig. 27, the vehicle control system 12000 includes a drive system control unit 12010, a body system control unit 12020, an outside-vehicle information detection unit 12030, an inside-vehicle information detection unit 12040, and an integrated control unit 12050. Also shown as functional components of the integrated control unit 12050 are a microcomputer 12051, an audio / video output unit 12052, and an in-vehicle network I / F (interface) 12053.
[0097] The drivetrain control unit 12010 controls the operation of devices related to the drivetrain of the vehicle in accordance with various programs. For example, the drivetrain control unit 12010 functions as a control device for a drive force generating device for generating a drive force of the vehicle, such as an internal combustion engine or a drive motor, a drive force transmission mechanism for transmitting the drive force to the wheels, a steering mechanism for adjusting the steering angle of the vehicle, and a braking device for generating a braking force of the vehicle.
[0098] The body system control unit 12020 controls the operation of various devices equipped in the vehicle body according to various programs. For example, the body system control unit 12020 functions as a control device for a keyless entry system, a smart key system, a power window device, or various lamps such as headlamps, backup lamps, brake lamps, turn signals, and fog lamps. In this case, radio waves transmitted from a portable device that serves as a key or signals from various switches can be input to the body system control unit 12020. The body system control unit 12020 receives these radio waves or signals and controls the vehicle's door lock device, power window device, lamps, etc.
[0099] The outside-vehicle information detection unit 12030 detects information outside the vehicle equipped with the vehicle control system 12000. For example, an imaging unit 12031 is connected to the outside-vehicle information detection unit 12030. The outside-vehicle information detection unit 12030 causes the imaging unit 12031 to capture images outside the vehicle and receives the captured images. The outside-vehicle information detection unit 12030 may perform object detection processing or distance detection processing for people, cars, obstacles, signs, characters on the road surface, etc. based on the received images.
[0100] The imaging unit 12031 is an optical sensor that receives light and outputs an electrical signal corresponding to the amount of light received. The imaging unit 12031 can output the electrical signal as an image or as distance measurement information. The light received by the imaging unit 12031 may be visible light or invisible light such as infrared light.
[0101] The in-vehicle information detection unit 12040 detects information inside the vehicle. For example, a driver state detection unit 12041 that detects the state of the driver is connected to the in-vehicle information detection unit 12040. The driver state detection unit 12041 includes, for example, a camera that captures an image of the driver, and the in-vehicle information detection unit 12040 may calculate the degree of fatigue or concentration of the driver based on the detection information input from the driver state detection unit 12041, or may determine whether the driver is dozing off.
[0102] The microcomputer 12051 can calculate control target values for the driving force generating device, steering mechanism, or braking device based on the information inside and outside the vehicle acquired by the outside-vehicle information detection unit 12030 or the inside-vehicle information detection unit 12040, and output control commands to the drive system control unit 12010. For example, the microcomputer 12051 can perform cooperative control aimed at realizing the functions of an ADAS (Advanced Driver Assistance System), including vehicle collision avoidance or impact mitigation, following driving based on the inter-vehicle distance, vehicle speed maintenance driving, vehicle collision warning, vehicle lane departure warning, etc.
[0103] In addition, the microcomputer 12051 can perform cooperative control for the purpose of autonomous driving, which allows the vehicle to travel autonomously without relying on driver operation, by controlling the driving force generating device, steering mechanism, braking device, etc. based on information about the surroundings of the vehicle obtained by the outside vehicle information detection unit 12030 or the inside vehicle information detection unit 12040.
[0104] Furthermore, the microcomputer 12051 can output a control command to the body system control unit 12020 based on the information outside the vehicle acquired by the outside information detection unit 12030. For example, the microcomputer 12051 can control the headlamps according to the position of a preceding vehicle or an oncoming vehicle detected by the outside information detection unit 12030, and perform cooperative control aimed at preventing glare, such as switching from high beams to low beams.
[0105] The audio / video output unit 12052 transmits at least one of audio and video output signals to an output device capable of visually or audibly notifying information to vehicle occupants or the outside of the vehicle. In the example of Fig. 27, the output devices are exemplified by an audio speaker 12061, a display unit 12062, and an instrument panel 12063. The display unit 12062 may include, for example, at least one of an on-board display and a head-up display.
[0106] FIG. 28 is a diagram showing an example of the installation position of the imaging unit 12031.
[0107] In FIG. 28, a vehicle 12100 has imaging units 12101, 12102, 12103, 12104, and 12105 as the imaging unit 12031.
[0108] The imaging units 12101, 12102, 12103, 12104, and 12105 are provided, for example, at positions such as the front nose, side mirrors, rear bumper, back door, and the top of the windshield inside the vehicle cabin of the vehicle 12100. The imaging unit 12101 provided on the front nose and the imaging unit 12105 provided on the top of the windshield inside the vehicle cabin mainly acquire images of the front of the vehicle 12100. The imaging units 12102 and 12103 provided on the side mirrors mainly acquire images of the sides of the vehicle 12100. The imaging unit 12104 provided on the rear bumper or back door mainly acquires images of the rear of the vehicle 12100. The forward images acquired by the imaging units 12101 and 12105 are mainly used to detect preceding vehicles, pedestrians, obstacles, traffic lights, traffic signs, lanes, etc.
[0109] 28 shows an example of the imaging ranges of the imaging units 12101 to 12104. Imaging range 12111 indicates the imaging range of the imaging unit 12101 provided on the front nose, imaging ranges 12112 and 12113 indicate the imaging ranges of the imaging units 12102 and 12103 provided on the side mirrors, respectively, and imaging range 12114 indicates the imaging range of the imaging unit 12104 provided on the rear bumper or back door. For example, by overlaying the image data captured by the imaging units 12101 to 12104, an overhead image of the vehicle 12100 viewed from above can be obtained.
[0110] At least one of the image capturing units 12101 to 12104 may have a function of acquiring distance information. For example, at least one of the image capturing units 12101 to 12104 may be a stereo camera made up of multiple image capturing elements, or may be an image capturing element having pixels for phase difference detection.
[0111] For example, based on the distance information obtained from the imaging units 12101 to 12104, the microcomputer 12051 can calculate the distance to each three-dimensional object within the imaging ranges 12111 to 12114 and the change in this distance over time (relative speed with respect to the vehicle 12100), thereby extracting as a preceding vehicle, in particular, the three-dimensional object that is the closest three-dimensional object on the path of the vehicle 12100 and traveling in approximately the same direction as the vehicle 12100 at a predetermined speed (e.g., 0 km / h or higher). Furthermore, the microcomputer 12051 can set a vehicle-to-vehicle distance to be maintained in advance in front of the preceding vehicle, and perform automatic braking control (including follow-up stop control), automatic acceleration control (including follow-up start control), etc. In this way, cooperative control can be performed for the purpose of autonomous driving, which runs autonomously without relying on driver operation.
[0112] For example, the microcomputer 12051 classifies and extracts three-dimensional object data regarding three-dimensional objects into two-wheeled vehicles, ordinary vehicles, large vehicles, pedestrians, utility poles, and other three-dimensional objects based on distance information obtained from the imaging units 12101 to 12104, and can use the data for automatic obstacle avoidance. For example, the microcomputer 12051 distinguishes obstacles around the vehicle 12100 into obstacles that are visible to the driver of the vehicle 12100 and obstacles that are difficult to see. The microcomputer 12051 then determines a collision risk that indicates the risk of collision with each obstacle, and when the collision risk is equal to or greater than a set value and a collision is possible, the microcomputer 12051 can provide driving assistance for collision avoidance by outputting an alarm to the driver via the audio speaker 12061 or the display unit 12062, or by performing forced deceleration or avoidance steering via the drive system control unit 12010.
[0113] At least one of the image capturing units 12101 to 12104 may be an infrared camera that detects infrared rays. For example, the microcomputer 12051 can recognize a pedestrian by determining whether a pedestrian is present in the images captured by the image capturing units 12101 to 12104. Such pedestrian recognition is performed, for example, by extracting feature points from the images captured by the image capturing units 12101 to 12104 as infrared cameras and performing pattern matching on a series of feature points that indicate the outline of an object to determine whether the object is a pedestrian. When the microcomputer 12051 determines that a pedestrian is present in the images captured by the image capturing units 12101 to 12104 and recognizes the pedestrian, the audio / image output unit 12052 controls the display unit 12062 to superimpose a rectangular outline on the recognized pedestrian for emphasis. The audio / image output unit 12052 may also control the display unit 12062 to display an icon or the like indicating the pedestrian at a desired position.
[0114] An example of a vehicle control system to which the technology according to the present disclosure (the present technology) can be applied has been described above. The technology according to the present disclosure can be applied to, for example, the imaging unit 12031 among the above-described configurations. Specifically, the solid-state imaging device 111 according to the present disclosure can be applied to the imaging unit 12031. Applying the technology according to the present disclosure to the imaging unit 12031 can improve yield and reduce manufacturing costs.
[0115] 14. Application Example to Endoscopic Surgery System The present technology can be applied to various products. For example, the technology according to the present disclosure (the present technology) may be applied to an endoscopic surgery system.
[0116] FIG. 29 is a diagram showing an example of a schematic configuration of an endoscopic surgery system to which the technology according to the present disclosure (the present technology) can be applied.
[0117] 29 shows an operator (doctor) 11131 performing surgery on a patient 11132 on a patient bed 11133 using an endoscopic surgery system 11000. As shown in the figure, the endoscopic surgery system 11000 is composed of an endoscope 11100, other surgical tools 11110 such as an insufflation tube 11111 and an energy treatment tool 11112, a support arm device 11120 that supports the endoscope 11100, and a cart 11200 on which various devices for endoscopic surgery are mounted.
[0118] The endoscope 11100 is composed of a lens barrel 11101, a region of a predetermined length from the tip of which is inserted into a body cavity of a patient 11132, and a camera head 11102 connected to the base end of the lens barrel 11101. In the example shown, the endoscope 11100 is configured as a so-called rigid scope having a rigid lens barrel 11101, but the endoscope 11100 may also be configured as a so-called flexible scope having a flexible lens barrel.
[0119] An opening into which an objective lens is fitted is provided at the tip of the lens barrel 11101. A light source device 11203 is connected to the endoscope 11100, and light generated by the light source device 11203 is guided to the tip of the lens barrel by a light guide extending inside the lens barrel 11101, and is irradiated via the objective lens toward an object to be observed inside the body cavity of the patient 11132. The endoscope 11100 may be a direct-viewing endoscope, an oblique-viewing endoscope, or a side-viewing endoscope.
[0120] An optical system and an image sensor are provided inside the camera head 11102, and light reflected from the object of observation (observation light) is collected by the optical system onto the image sensor. The observation light is photoelectrically converted by the image sensor to generate an electrical signal corresponding to the observation light, i.e., an image signal corresponding to the observed image. The image signal is sent to a camera control unit (CCU) 11201 as RAW data.
[0121] The CCU 11201 is configured with a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), etc., and comprehensively controls the operations of the endoscope 11100 and the display device 11202. Furthermore, the CCU 11201 receives an image signal from the camera head 11102 and performs various types of image processing on the image signal, such as development processing (demosaic processing), to display an image based on the image signal.
[0122] Under the control of the CCU 11201, the display device 11202 displays an image based on an image signal that has been subjected to image processing by the CCU 11201.
[0123] The light source device 11203 is composed of a light source such as an LED (Light Emitting Diode), and supplies the endoscope 11100 with irradiation light when photographing the surgical site, etc.
[0124] The input device 11204 is an input interface for the endoscopic surgery system 11000. A user can input various information and instructions to the endoscopic surgery system 11000 via the input device 11204. For example, the user inputs an instruction to change the imaging conditions (type of irradiation light, magnification, focal length, etc.) of the endoscope 11100.
[0125] The treatment tool control device 11205 controls the driving of the energy treatment tool 11112 for cauterizing tissue, incising, sealing blood vessels, etc. The insufflation device 11206 inflates the body cavity of the patient 11132 through the insufflation tube 11111 in order to ensure a clear field of view for the endoscope 11100 and a working space for the surgeon. The recorder 11207 is a device capable of recording various types of information related to the surgery. The printer 11208 is a device capable of printing various types of information related to the surgery in various formats such as text, images, or graphs.
[0126] The light source device 11203, which supplies illumination light to the endoscope 11100 when photographing the surgical site, can be configured from a white light source, such as an LED, a laser light source, or a combination of these. When the white light source is configured from a combination of RGB laser light sources, the output intensity and output timing of each color (each wavelength) can be controlled with high precision, allowing the light source device 11203 to adjust the white balance of the captured image. In this case, it is also possible to time-share images corresponding to each RGB by irradiating the object of observation with laser light from each RGB laser light source and controlling the drive of the image sensor of the camera head 11102 in synchronization with the irradiation timing. According to this method, color images can be obtained without providing a color filter to the image sensor.
[0127] Furthermore, the light source device 11203 may be controlled to change the intensity of light it outputs at predetermined time intervals. By controlling the driving of the image sensor of the camera head 11102 in synchronization with the timing of the change in light intensity to acquire images in a time-division manner and combining the images, it is possible to generate an image with a high dynamic range that is free from so-called blocked-up shadows and blown-out highlights.
[0128] The light source device 11203 may also be configured to supply light in a predetermined wavelength band corresponding to special light observation. Special light observation, for example, utilizes the wavelength dependence of light absorption in body tissues to irradiate light in a narrower band than the light irradiated during normal observation (i.e., white light) to capture high-contrast images of specific tissues, such as blood vessels on the surface of mucous membranes, in what is known as narrow band imaging. Alternatively, special light observation may involve fluorescence observation, in which images are obtained using fluorescence generated by irradiating excitation light. Fluorescence observation may involve irradiating excitation light onto body tissues and observing the fluorescence from the tissues (autofluorescence observation), or may involve locally injecting a reagent such as indocyanine green (ICG) into the body tissue and irradiating the tissues with excitation light corresponding to the fluorescent wavelength of the reagent to obtain a fluorescent image. The light source device 11203 may be configured to supply narrow band light and / or excitation light corresponding to such special light observation.
[0129] FIG. 30 is a block diagram showing an example of the functional configuration of the camera head 11102 and the CCU 11201 shown in FIG.
[0130] The camera head 11102 has a lens unit 11401, an imaging unit 11402, a drive unit 11403, a communication unit 11404, and a camera head control unit 11405. The CCU 11201 has a communication unit 11411, an image processing unit 11412, and a control unit 11413. The camera head 11102 and the CCU 11201 are connected to each other via a transmission cable 11400 so that they can communicate with each other.
[0131] The lens unit 11401 is an optical system provided at the connection portion with the lens barrel 11101. Observation light taken in from the tip of the lens barrel 11101 is guided to the camera head 11102 and enters the lens unit 11401. The lens unit 11401 is composed of a combination of multiple lenses including a zoom lens and a focus lens.
[0132] The imaging unit 11402 is composed of an imaging element. The imaging element constituting the imaging unit 11402 may be a single (so-called single-chip type) or multiple (so-called multi-chip type). When the imaging unit 11402 is composed of a multi-chip type, for example, each imaging element may generate an image signal corresponding to each of RGB, and a color image may be obtained by combining these signals. Alternatively, the imaging unit 11402 may be configured to have a pair of imaging elements for acquiring image signals for the right eye and the left eye corresponding to 3D (dimensional) display. The 3D display allows the surgeon 11131 to more accurately grasp the depth of the biological tissue at the surgical site. Note that when the imaging unit 11402 is composed of a multi-chip type, multiple lens units 11401 may be provided corresponding to each imaging element.
[0133] Furthermore, the imaging unit 11402 does not necessarily have to be provided in the camera head 11102. For example, the imaging unit 11402 may be provided inside the lens barrel 11101, immediately after the objective lens.
[0134] The driving unit 11403 is configured by an actuator, and moves the zoom lens and focus lens of the lens unit 11401 by a predetermined distance along the optical axis under the control of the camera head control unit 11405. This allows the magnification and focus of the image captured by the imaging unit 11402 to be adjusted appropriately.
[0135] The communication unit 11404 is configured by a communication device for transmitting and receiving various types of information to and from the CCU 11201. The communication unit 11404 transmits the image signal obtained from the imaging unit 11402 to the CCU 11201 via the transmission cable 11400 as RAW data.
[0136] Furthermore, the communication unit 11404 receives a control signal for controlling the driving of the camera head 11102 from the CCU 11201 and supplies the control signal to the camera head control unit 11405. The control signal includes information on the imaging conditions, such as information specifying the frame rate of the captured image, information specifying the exposure value at the time of imaging, and / or information specifying the magnification and focus of the captured image.
[0137] The image capturing conditions such as the frame rate, exposure value, magnification, and focus may be appropriately specified by the user, or may be automatically set by the control unit 11413 of the CCU 11201 based on the acquired image signal. In the latter case, the endoscope 11100 is equipped with a so-called AE (Auto Exposure) function, AF (Auto Focus) function, and AWB (Auto White Balance) function.
[0138] The camera head control unit 11405 controls the driving of the camera head 11102 based on a control signal received from the CCU 11201 via the communication unit 11404 .
[0139] The communication unit 11411 is configured by a communication device for transmitting and receiving various information to and from the camera head 11102. The communication unit 11411 receives an image signal transmitted from the camera head 11102 via the transmission cable 11400.
[0140] Furthermore, the communication unit 11411 transmits to the camera head 11102 a control signal for controlling the driving of the camera head 11102. The image signal and the control signal can be transmitted by electrical communication, optical communication, or the like.
[0141] The image processing unit 11412 performs various image processing operations on the image signal, which is RAW data transmitted from the camera head 11102 .
[0142] The control unit 11413 performs various controls related to the imaging of the surgical site, etc. by the endoscope 11100 and the display of the captured image obtained by imaging the surgical site, etc. For example, the control unit 11413 generates a control signal for controlling the driving of the camera head 11102.
[0143] Furthermore, the control unit 11413 displays the captured image showing the surgical site, etc., on the display device 11202 based on the image signal subjected to image processing by the image processing unit 11412. At this time, the control unit 11413 may recognize various objects in the captured image using various image recognition technologies. For example, the control unit 11413 can recognize surgical tools such as forceps, specific biological parts, bleeding, mist generated when using the energy treatment tool 11112, etc., by detecting the shape and color of the edges of objects included in the captured image. When displaying the captured image on the display device 11202, the control unit 11413 may use the recognition results to superimpose various surgical support information on the image of the surgical site. By superimposing the surgical support information and presenting it to the surgeon 11131, the burden on the surgeon 11131 can be reduced and the surgeon 11131 can proceed with the surgery reliably.
[0144] The transmission cable 11400 connecting the camera head 11102 and the CCU 11201 is an electrical signal cable for electrical signal communication, an optical fiber for optical communication, or a composite cable of these.
[0145] In the illustrated example, communication is performed wired using a transmission cable 11400, but communication between the camera head 11102 and the CCU 11201 may also be performed wirelessly.
[0146] The above describes an example of an endoscopic surgery system to which the technology according to the present disclosure can be applied. The technology according to the present disclosure can be applied to the endoscope 11100, the camera head 11102 (the imaging unit 11402), and the like, among the above-described configurations. Specifically, the solid-state imaging device 111 according to the present disclosure can be applied to the imaging unit 10402. By applying the technology according to the present disclosure to the endoscope 11100, the camera head 11102 (the imaging unit 11402), and the like, it is possible to improve yield and reduce manufacturing costs.
[0147] Here, an endoscopic surgery system has been described as an example, but the technology according to the present disclosure may also be applied to other systems, such as a microsurgery system.
[0148] The present technology may also have the following configurations. (1) A solid-state imaging device comprising: a photoelectric conversion unit group including a plurality of photoelectric conversion units; an on-chip lens corresponding to the photoelectric conversion unit group; and an axicon lens arranged between a light incident surface of the on-chip lens and the photoelectric conversion unit group. (2) The solid-state imaging device according to (1), in which light passing through the light incident surface and the axicon lens in this order is incident across the plurality of photoelectric conversion units. (3) The solid-state imaging device according to (1) or (2), in which the axicon lens is arranged inside the on-chip lens. (4) The solid-state imaging device according to any one of (1) to (3), in which the axicon lens is arranged between the on-chip lens and the photoelectric conversion unit group. (5) The solid-state imaging device according to any one of (1) to (4), in which the axicon lens is convex toward the on-chip lens. (6) The solid-state imaging device according to any one of (1) to (4), wherein the axicon lens is convex toward the photoelectric conversion unit group. (7) The solid-state imaging device according to any one of (1) to (6), wherein a plurality of the axicon lenses are arranged along the optical axis of the on-chip lens. (8) The solid-state imaging device according to (7), wherein the plurality of axicon lenses include: an axicon lens convex toward the on-chip lens; and an axicon lens convex toward the photoelectric conversion unit group. (9) The solid-state imaging device according to any one of (1) to (8), wherein the plurality of photoelectric conversion units are two-dimensionally arranged along a plane intersecting the optical axis of the on-chip lens. (10) The solid-state imaging device according to (9), wherein the two-dimensional array is a matrix array. (11) The solid-state imaging device according to (10), wherein the matrix array is an N×N matrix array (N is an integer equal to or greater than 2). (12) The solid-state imaging device according to (9), wherein the two-dimensional array is a staggered array. (13) The solid-state imaging device according to any one of (1) to (12), wherein the optical axis of the on-chip lens and the optical axis of the axicon lens are parallel. (14) The solid-state imaging device according to any one of (1) to (13), wherein the optical axis of the on-chip lens and the optical axis of the axicon lens are aligned.(15) The solid-state imaging device according to any one of (1) to (14), wherein a ratio of the height to the diameter of the bottom surface of the axicon lens is equal to or greater than 2 and equal to or less than 4. (16) The solid-state imaging device according to any one of (1) to (15), wherein the axicon lens is provided with an antireflection film. (17) The solid-state imaging device according to any one of (1) to (16), wherein a plurality of the photoelectric conversion unit groups are two-dimensionally arranged inside a semiconductor substrate in an in-plane direction of the semiconductor substrate, and the on-chip lens and the axicon lens are provided for each of the photoelectric conversion unit groups. (18) The solid-state imaging device according to (17), further comprising: a color filter group including a plurality of color filters, disposed between the semiconductor substrate and an on-chip lens group including a plurality of the on-chip lenses. (19) The solid-state imaging device according to (18), wherein the plurality of color filters individually correspond to the plurality of photoelectric conversion unit groups. (20) An electronic device including a solid-state imaging device, the electronic device including: a photoelectric conversion unit group including a plurality of photoelectric conversion units; an on-chip lens corresponding to the photoelectric conversion unit group; and an axicon lens disposed between a light incident surface of the on-chip lens and the photoelectric conversion unit group.
[0149] 1, 2, 3, 4, 5, 6, 7, 8, 9: solid-state imaging device 102: photoelectric conversion unit group 102a: photoelectric conversion unit 300A: color filter 300B: color filter 300C: color filter 400A: axicon lens 400B: axicon lens 500: on-chip lens 500a: light incident surface SS: semiconductor substrate OA1: optical axis of on-chip lens OA2: optical axis of axicon lens
Claims
1. A solid-state imaging device comprising: a photoelectric conversion unit group including a plurality of photoelectric conversion units; an on-chip lens corresponding to the photoelectric conversion unit group; and an axicon lens disposed between a light entrance surface of the on-chip lens and the photoelectric conversion unit group.
2. A solid-state imaging device according to claim 1, wherein light passing through said light entrance surface and said axicon lens in this order is incident across said plurality of photoelectric conversion sections.
3. The solid-state imaging device according to claim 1, wherein the axicon lens is disposed inside the on-chip lens.
4. The solid-state imaging device according to claim 1, wherein the axicon lens is disposed between the on-chip lens and the group of photoelectric conversion units.
5. The solid-state imaging device according to claim 1, wherein the axicon lens is convex toward the on-chip lens.
6. The solid-state imaging device according to claim 1, wherein the axicon lens is convex toward the photoelectric conversion unit group side.
7. A solid-state imaging device according to claim 1, wherein a plurality of said axicon lenses are arranged along the optical axis of said on-chip lens.
8. The solid-state imaging device according to claim 7, wherein the plurality of axicon lenses include an axicon lens convex toward the on-chip lens side, and an axicon lens convex toward the photoelectric conversion unit group side.
9. The solid-state imaging device according to claim 1, wherein the plurality of photoelectric conversion units are arranged two-dimensionally along a plane intersecting the optical axis of the on-chip lens.
10. The solid-state imaging device according to claim 9, wherein the two-dimensional array is a matrix array.
11. The solid-state imaging device according to claim 10, wherein the matrix arrangement is an N×N matrix arrangement (N is an integer of 2 or more).
12. The solid-state imaging device according to claim 9, wherein the two-dimensional array is a staggered array.
13. The solid-state imaging device according to claim 1, wherein the optical axis of the on-chip lens and the optical axis of the axicon lens are parallel to each other.
14. The solid-state imaging device according to claim 1, wherein the optical axis of the on-chip lens and the optical axis of the axicon lens coincide with each other.
15. The solid-state imaging device according to claim 1, wherein the axicon lens has a ratio of the diameter of the base to the height of the axicon lens that is 2 or more and 4 or less.
16. The solid-state imaging device according to claim 1, wherein the axicon lens is provided with an anti-reflection coating.
17. A solid-state imaging device as described in claim 1, wherein a plurality of the photoelectric conversion unit groups are two-dimensionally arranged inside a semiconductor substrate in an in-plane direction of the semiconductor substrate, and the on-chip lens and the axicon lens are provided for each of the photoelectric conversion unit groups.
18. The solid-state imaging device according to claim 17, further comprising a color filter group including a plurality of color filters, disposed between an on-chip lens group including a plurality of said on-chip lenses and said semiconductor substrate.
19. The solid-state imaging device according to claim 18, wherein the plurality of color filters correspond to the plurality of photoelectric conversion unit groups, respectively.
20. An electronic device equipped with a solid-state imaging device, including: a photoelectric conversion unit group including a plurality of photoelectric conversion units; an on-chip lens corresponding to the photoelectric conversion unit group; and an axicon lens arranged between the light entrance surface of the on-chip lens and the photoelectric conversion unit group.
Citation Information
Patent Citations
Imaging apparatus
JP2012063710A
Photoelectric conversion device, imaging system, and mobile apparatus
JP2020141122A
Solid-state imaging device and electronic apparatus
WO2022091576A1
Cited By
Electronic apparatus and imaging control method
WO2026120930A1
