Camera devices and electronic equipment

Abstract

This disclosure provides an imaging device that reduces the effect of light-gathering shift even when there are deviations such as the position of the lens on the pixel. The imaging device disclosed herein has a plurality of pixels and a lens on the pixel. The pixels of the imaging device generate image signals by photoelectric conversion of incident light from the subject. The lens on the lens is commonly disposed among the plurality of pixels, having a non-focusing area in the center and focusing the incident light onto the plurality of pixels in the peripheral area.

Description

Technical Field

[0001] This disclosure relates to a camera device and an electronic machine. More specifically, it relates to a camera device and an electronic machine equipped with the camera device. Prior Technology

[0002] As an imaging device for photographing a subject, an imaging device is constructed by arranging pixels in a 2D matrix, each having a photoelectric conversion element that performs photoelectric conversion of incident light. To improve the sensitivity of this imaging device, a lens is disposed on each pixel. This lens is, for example, configured in a hemispherical shape to focus the incident light from the pixel onto the photoelectric conversion element. On the other hand, a photographic lens is disposed outside the imaging device to image the subject. Incident light passing through this photographic lens illuminates the imaging device. At this time, the light from the subject is incident obliquely onto the pixels disposed at the periphery of the imaging device. Therefore, in the peripheral pixels, the focusing position of the lens shifts from the photoelectric conversion element, and the sensitivity decreases. This phenomenon is called shading.

[0003] Therefore, a photographic device (solid-state photographic device) with a crystal-mounted lens having a lens surface that corrects the shadow is proposed (for example, see Patent Document 1). In this photographic device, shadows are reduced by arranging a crystal-mounted lens having a lens surface with an overlapping tilt component on a spherical surface. [Previous Technical Documents] [Patent Literature]

[0004] Patent Document 1: Japanese Patent Application Publication No. 2006-156515 Summary of the Invention

[0005] [The problem the invention aims to solve]

[0006] However, in the aforementioned prior art, there is a problem that correcting the focus position is difficult when deviations occur, such as in the position of the lens. This is particularly problematic in pixels that generate phase difference signals to detect the image plane phase difference of the subject for autofocus. These pixels are composed of pixels that divide the subject's pupil, with the lens commonly arranged across a plurality of pixels. Light from the subject is commonly irradiated onto the plurality of pixels through these common lens, divided by the pupil, and a phase difference signal is generated by comparing the signals between pixels. The focus position of the subject is detected using this phase difference signal. If a focus shift occurs in these phase difference pixels, the detected image plane phase difference contains errors, making it difficult to detect the focus position of the subject.

[0007] Therefore, in this disclosure, a camera device and electronic device are proposed that reduce the effect of focusing shift even when there are deviations such as the position of the crystal lens. [Technical means to solve the problem]

[0008] The imaging device disclosed herein has a plurality of pixels and a crystal lens. The pixels perform photoelectric conversion of incident light from the subject to generate an image signal. The crystal lens is commonly disposed on the plurality of pixels, having a non-focusing area in the center and focusing the incident light onto the plurality of pixels in the peripheral area. Simple Explanation of the Diagram

[0009] Figure 1 is a diagram showing an example of the configuration of a camera device according to an embodiment of the present disclosure. Figure 2 is a diagram showing an example of the pixel configuration of the first embodiment of this disclosure. Figure 3 is a cross-sectional view showing an example of the pixel configuration of the first embodiment of this disclosure. Figure 4A is a diagram showing an example of the focusing of incident light on a pixel in the first embodiment of this disclosure. Figure 4B is a diagram showing another example of the focusing of incident light on a pixel in the first embodiment of the present disclosure. Figure 5 is a top view showing an example of the focusing of incident light from a pixel in the first embodiment of this disclosure. Figure 6A is a diagram showing an example of the pixel block configuration of the first embodiment of this disclosure. Figure 6B is a diagram showing another configuration example of the pixel blocks of the first embodiment of this disclosure. Figure 7A is a diagram showing one example of a method for manufacturing a crystal-borne lens according to an embodiment of the present disclosure. Figure 7B is a diagram showing one example of a method for manufacturing a crystal-borne lens according to an embodiment of the present disclosure. Figure 7C is a diagram showing one example of a method for manufacturing a crystal-borne lens according to an embodiment of the present disclosure. Figure 7D is a diagram showing one example of a method for manufacturing a crystal-borne lens according to an embodiment of the present disclosure. Figure 8 is a diagram showing an example of the composition of the resist used in the formation of the crystal lens according to the embodiment of this disclosure. Figure 9 is a diagram showing an example of the pixel composition of the first variation of the first embodiment of this disclosure. Figure 10 is a diagram showing an example of the pixel composition of a second variation of the first embodiment of this disclosure. Figure 11 is a diagram showing an example of the pixel configuration of the second embodiment of this disclosure. Figure 12 is a diagram showing an example of the pixel configuration of the third embodiment of this disclosure. Figure 13 is a diagram showing another example of the pixel configuration of the third embodiment of this disclosure. Figure 14A is a diagram showing an example of the pixel configuration of the fourth embodiment of this disclosure. Figure 14B is a diagram showing an example of the configuration of a crystal-borne lens according to the fourth embodiment of this disclosure. Figure 14C shows an example of the configuration of a crystal-borne lens according to the fourth embodiment of this disclosure. Figure 14D is a diagram showing an example of the configuration of the crystal lens of the fourth embodiment of this disclosure. Figure 15 is a diagram showing an example of the pixel block configuration of the fourth embodiment of this disclosure. Figure 16 is a diagram showing another configuration example of the pixel blocks in the fourth embodiment of this disclosure. Figure 17 is a diagram showing another configuration example of pixel blocks in the fourth embodiment of this disclosure. Figure 18 is a diagram showing an example of the composition of pixel blocks in the fifth embodiment of this disclosure. Figure 19A is a diagram showing another example of the composition of a pixel block in the fifth embodiment of this disclosure. Figure 19B is a diagram showing an example of the configuration of the crystal lens of the fifth embodiment of this disclosure. Figure 19C is a diagram showing an example of the configuration of the crystal lens of the fifth embodiment of this disclosure. Figure 20 is a diagram showing an example of the pixel block configuration of the fifth embodiment of this disclosure. Figure 21 is a diagram showing another configuration example of the pixel blocks in the fifth embodiment of this disclosure. Figure 22 is a diagram showing an example of the composition of a pixel unit in the sixth embodiment of this disclosure. Figure 23 is a diagram showing another example of the configuration of a pixel unit in the sixth embodiment of this disclosure. Figure 24 is a diagram showing another example of the configuration of a pixel unit in the sixth embodiment of this disclosure. Figure 25 is a diagram showing another example of the configuration of a pixel unit in the sixth embodiment of this disclosure. Figure 26 is a diagram showing an example of the composition of pixel blocks in the seventh embodiment of this disclosure. Figure 27 is a diagram showing another example of the composition of a pixel block in the seventh embodiment of this disclosure. Figure 28 is a diagram showing an example of the composition of pixel blocks in the eighth embodiment of this disclosure. Figure 29 is a diagram showing an example of the pixel composition of the ninth embodiment of this disclosure. Figure 30A is a diagram showing an example of the pixel configuration of the ninth embodiment of this disclosure. Figure 30B is a diagram showing an example of the pixel configuration of the ninth embodiment of this disclosure. Figure 31 is a diagram showing an example of the composition of pixel blocks in the tenth embodiment of this disclosure. Figure 32A is a diagram showing an example of the configuration of the crystal lens of the tenth embodiment of this disclosure. Figure 32B is a diagram showing an example of the configuration of a crystal-borne lens according to the tenth embodiment of this disclosure. Figure 32C shows a configuration example of the crystal-borne lens of the tenth embodiment of this disclosure. Figure 33 is a diagram showing another example of the composition of a pixel block in the tenth embodiment of this disclosure. Figure 34 is a diagram showing another example of the composition of a pixel block in the tenth embodiment of this disclosure. Figure 35 is a diagram showing another example of the composition of a pixel block in the tenth embodiment of this disclosure. Figure 36A is a diagram showing an example of the configuration of the crystal lens of the tenth embodiment of this disclosure. Figure 36B is a diagram showing an example of the configuration of the crystal lens of the tenth embodiment of this disclosure. Figure 37 is a block diagram showing an example of the configuration of a camera device mounted on an electronic machine. Figure 38 is a block diagram showing a schematic configuration example of a mobile body control system to which the technology disclosed herein can be applied, namely a vehicle control system. Figure 39 is an example of the location of the camera unit. Figure 40 shows an example of a schematic configuration of an endoscopic surgical system to which the technology disclosed herein (the technology) can be applied. Figure 41 is a block diagram showing an example of the functional configuration of the camera head and CCU (Camera Control Unit) shown in Figure 40. Implementation

[0010] The following is a detailed description of the embodiments disclosed herein, based on the drawings. The description proceeds in the following order. Furthermore, in the following embodiments, repeated descriptions are omitted by using the same symbol to mark the same parts. 1. First Implementation Form 2. Second Implementation Form 3. Third Implementation Form 4. Fourth Implementation Form 5. Fifth Implementation Form 6. Sixth Implementation Form 7. Seventh Implementation Form 8. Eighth Implementation Form 9. Ninth Implementation Form 10. Tenth Implementation Form 11. 11th Implementation Form 12. Example of the configuration of a camera device 13. Examples of application to moving bodies 14. Examples of the application of endoscopic surgical systems

[0011] (1. First Implementation) [Composition of Camera Components] Figure 1 is a diagram showing an example of the configuration of an imaging device according to an embodiment of the present disclosure. As shown in Figure 1, the imaging device 1 of this example comprises a semiconductor substrate 11, for example, a pixel region (so-called imaging region) 3 containing a plurality of photoelectric conversion elements arranged regularly in two dimensions on a silicon substrate, and a peripheral circuit section. The pixel 100 is formed by having, for example, a photodiode that serves as a photoelectric conversion element, and a plurality of pixel transistors (so-called MOS (Metal Oxide Semiconductor) transistors). The plurality of pixel transistors may, for example, consist of three transistors: a transmission transistor, a reset transistor, and an amplification transistor. Alternatively, a selection transistor may be added, resulting in a configuration of four transistors. The pixel 100 may also be configured as a shared pixel structure. This shared pixel structure consists of a plurality of photodiodes, a plurality of transmission transistors, a shared floating diffusion region, and shared individual pixel transistors.

[0012] The peripheral circuit section is composed of a vertical drive circuit 4, a horizontal signal processing circuit 5, a horizontal drive circuit 6, an output circuit 7, and a control circuit 8.

[0013] The control circuit 8 receives data from commands such as the input clock and operating mode, and outputs data such as internal information of the imaging element. Specifically, the control circuit 8 generates clock signals or control signals based on the vertical synchronization signal, horizontal synchronization signal, and main clock, which serve as the reference for the operation of the vertical drive circuit 4, the horizontal signal processing circuit 5, and the horizontal drive circuit 6. These signals are then input to the vertical drive circuit 4, the horizontal signal processing circuit 5, and the horizontal drive circuit 6.

[0014] The vertical drive circuit 4, for example, is composed of a shift register, selects the pixel drive line 13, and supplies pulses to the selected pixel drive line to drive the pixel, driving the pixel in column units. That is, the vertical drive circuit 4 sequentially selects each pixel 100 of the scanning pixel region 3 in column units along the vertical direction, and supplies the row signal processing circuit 5 with a pixel signal based on the signal charge generated in the photoelectric conversion element, such as a photodiode, which becomes the photoelectric conversion element of each pixel 100 according to the amount of light received.

[0015] The horizontal signal processing circuit 5 is configured, for example, in each row of pixels 100, and performs signal processing such as noise removal on the signals output from pixels 100 in one column, row by row. That is, the horizontal signal processing circuit 5 performs signal processing such as CDS (Correlated Double Sampling) to remove fixed pattern noise specific to pixels 100, or signal amplification, AD (Analog to Digital) conversion, etc. A horizontal selection switch (not shown) is connected between the output segment of the horizontal signal processing circuit 5 and the horizontal signal line 10. Furthermore, the horizontal signal processing circuit 5 is one example of the processing circuit described in the claims.

[0016] The horizontal drive circuit 6 is, for example, composed of a shift register, and sequentially outputs horizontal scanning pulses, thereby sequentially selecting each of the line signal processing circuits 5, and causing the pixel signal to be output by each of the line signal processing circuits 5 to the horizontal signal line 10.

[0017] The output circuit 7 processes and outputs the signals sequentially supplied to each of the signal processing circuits 5 via the horizontal signal lines 10. For example, it may perform only buffering, or it may perform black level adjustment, line deviation correction, or various digital signal processing. The input / output terminals 12 are used for signal exchange with external devices.

[0018] [Composition of Camera Components] Figure 2 is a diagram showing an example of the pixel configuration of the first embodiment of this disclosure. The same figure is a top view showing an example of the configuration of pixel 100. As mentioned above, pixel 100 is arranged in pixel region 3. The same figure shows an example of pixel 100 arranged in a 2D matrix. Furthermore, the "R", "G" and "B" labels on pixel 100 in the same figure indicate the type of color filter 150 described later. The "R", "G" and "B" in the same figure respectively represent color filters 150 corresponding to red light, green light, and blue light.

[0019] Furthermore, a crystal lens 170 is disposed on pixel 100. This crystal lens 170 is used to focus incident light onto the photoelectric conversion element of pixel 100, and is commonly disposed on a plurality of pixels 100. The crystal lens 170 in the same figure is an example of four pixels 100 arranged in two columns and two rows (pixels 100a, 100b, 100c, and 100d in the same figure). Also, the crystal lens 170 in the same figure is commonly disposed on four pixels 100 with color filters 150 of the same color. The same figure shows an example of pixel blocks 20 corresponding to red, green, and blue light arranged in a Bayer arrangement.

[0020] The crystal lens 170 in the same figure is an example of a circular shape when viewed from above. Furthermore, the crystal lens 170 can be configured as a hemispherical cross-section with a non-focusing region 171 in the center. The non-focusing region 171 can be formed, for example, by a recessed portion on the surface. The crystal lens 170 focuses the incident light onto the photoelectric conversion element at its peripheral portion outside the non-focusing region 171. This crystal lens 170 and a plurality of pixels 100 commonly arranged with crystal lenses 170 constitute a pixel block 20.

[0021] [Cross-section composition of an imaging element] Figure 3 is a cross-sectional view showing an example of the pixel configuration of the first embodiment of this disclosure. The same figure is a cross-sectional view showing an example of the pixel configuration 100. Furthermore, the pixel 100 in the same figure is the pixel 100 included in the pixel block 20 of the common crystal lens 170. The pixel 100 includes a semiconductor substrate 120, an insulating film 130, a wiring area 140, a separation portion 135, a protective film 136, and a color filter 150.

[0022] Semiconductor substrate 120 is a semiconductor substrate on which the diffusion layer of the semiconductor element of pixel 100 is disposed. Semiconductor substrate 120 may be made of silicon (Si), for example. The semiconductor element is disposed in the well region of semiconductor substrate 120. For convenience, it is envisioned that the semiconductor substrate 120 in the same figure is formed in the p-type well region. The semiconductor element can be formed by disposing of the n-type or p-type semiconductor region in the p-type well region. In the semiconductor substrate 120 in the same figure, photoelectric conversion element 101 is described as an example. The photoelectric conversion element 101 is constituted by the n-type semiconductor region 121. Specifically, a photodiode with pn bonding at the interface of the n-type semiconductor region 121 and the surrounding p-type well region is equivalent to photoelectric conversion element 101.

[0023] The insulating film 130 is used to insulate the surface side of the semiconductor substrate 120. For example, a silicon oxide (SiO2) film can be used for the insulating film 130.

[0024] Wiring region 140 is disposed on the surface side of semiconductor substrate 120, forming a region for wiring of components. Wiring region 140 includes wiring 141, conductive plugs 142, and an insulating layer 143. Wiring 141 is a conductor that transmits signals to components such as those on semiconductor substrate 120. Wiring 141 can be made of metals such as copper (Cu) or tungsten (W). Conductive plugs 142 connect wiring 141 disposed on different layers. Conductive plugs 142 can be made of, for example, a pillar-shaped metal. Insulating layer 143 insulates the wiring 141, etc. Insulating layer 143 can be made of, for example, SiO2.

[0025] The separation portion 135 is disposed at the boundary of the pixel 100 in the semiconductor substrate 120 to separate the electrical and optical properties of the pixel 100. This separation portion 135 can be constructed by embedding an insulating material into the semiconductor substrate 120. For example, the separation portion 135 can be formed by distributing an insulating material such as SiO2 in a trench formed through the boundary of the pixel 100 in the semiconductor substrate 120. Alternatively, the separation portion 135 can be configured to extend from the back surface of the semiconductor substrate 120 to a depth not reaching the surface side.

[0026] The protective film 136 is a film that protects the back side of the semiconductor substrate 120. The protective film 136 can be formed using an insulating material such as SiO2. The protective film 136 and the separation portion 135 can be formed simultaneously. Alternatively, the protective film 136 and the separation portion 135 can be formed separately.

[0027] The color filter 150 is an optical filter that transmits incident light of a specific wavelength. For example, a color filter layer that transmits red, green, and blue light can be used for this color filter 150. In this case, one color filter 150 corresponding to any one of red, green, and blue light is disposed in pixel 100. Pixel 100 generates an image signal of incident light at the wavelength corresponding to the color filter 150. As described above, the same type of color filter 150 is disposed in a plurality of pixels 100 disposed in pixel block 20. Furthermore, the color filter 150 in the same figure is disposed on the back side of semiconductor substrate 120.

[0028] Additionally, in the same image, a light-shielding film 159 is disposed in the area of ​​the color filter 150 at the boundary of pixel block 20 of pixel 100. This light-shielding film 159 blocks incident light. By disposing of the light-shielding film 159, incident light obliquely incident from adjacent pixel 100 can be blocked. Because the incident light from different types of color filters 150 of pixel 100 in adjacent pixel block 20 that pass through the light-shielding film 159 is blocked, color mixing can be prevented, and image quality degradation can be prevented.

[0029] The carrier lens 170 is a lens commonly disposed in the plurality of pixels 100 constituting the pixel block 20, as described above. The carrier lens 170 in the same figure has a non-focusing region 171 formed by a recess in its central portion. A typical carrier lens, as described later in Figure 4B, is configured with a roughly hemispherical cross-section, focusing incident light onto the central portion when viewed from above the semiconductor substrate 120. In contrast, the carrier lens 170 in the same figure focuses incident light onto the central portion when viewed from above the semiconductor substrate 120 at the periphery of the non-focusing region 171. On the other hand, the non-focusing region 171 transmits incident light without focusing. Therefore, the incident light illuminates a wider area of ​​the semiconductor substrate 120. The carrier lens 170 can be constructed from organic materials such as acrylic resin or inorganic materials such as silicon nitride (SiN).

[0030] Pixel 100 of pixel block 20 can be used as a phase difference pixel. As described later in FIG. 35, light is incident on pixel block 20 through the photographic lens 702. The phase difference pixel is a pixel that generates a phase difference signal to detect the focal position of the photographic lens 702. The phase difference pixel is a pixel that divides the pupil of the subject as described above. Through the common crystal lens 170, two adjacent phase difference pixels are commonly illuminated by the light from the subject through the photographic lens 702 and divided by the pupil. The pixel 100 on the right side of the same figure is incident with light from the left side of the photographic lens 702, and the pixel 100 on the left side of the same figure is incident with light from the right side of the photographic lens 702. Using the phase difference signals of a plurality of pixels 100 of pixel block 20, the image of the subject is generated by using a plurality of phase difference signals based on the light from the left side of the photographic lens 702 and a plurality of phase difference signals based on the light from the right side of the photographic lens 702. The focal position of the subject can be detected based on the phase difference between the two images.

[0031] Alternatively, the phase difference pixels can be formed by pairs of pixels 100 from the four pixels 100 in Figure 2. In the case of pupil segmentation along the vertical direction of Figure 2, pixels 100a and 100c, as well as pixels 100b and 100d, are used as phase difference pixels, respectively. Furthermore, in the case of pupil segmentation along the horizontal direction of Figure 2, pixels 100a and 100b, as well as pixels 100c and 100d, are used as phase difference pixels, respectively.

[0032] [Focusing of Incident Light] Figure 4A is a diagram showing an example of the focusing of incident light in a pixel according to the first embodiment of this disclosure. The same figure is a simplified diagram of the pixel block 20 described in Figure 3. The arrows in the same figure indicate the arrival of the incident light. Because the crystalline lens 170 has a non-focusing region 171, the incident light is focused over a wider area of ​​the semiconductor substrate 120. The focusing range 310 in the same figure indicates the range of incident light focused by the crystalline lens 170. Furthermore, when the size of the pixel 100 is as small as the wavelength of the incident light, the wave nature of the light becomes dominant. Therefore, the shape of the region where the incident light is also distributed at the ends of the pixel 100 becomes apparent. In this case, the incident light is also focused over a wider area of ​​the semiconductor substrate 120 by means of the non-focusing region 171.

[0033] Figure 4B shows another example of the focusing of incident light from a pixel in the first embodiment of this disclosure. The same figure illustrates the focusing of incident light from a second crystalline lens 179, configured as a hemispherical cross-section, commonly disposed in a second pixel block 30 of a plurality of pixels 100. Because the second crystalline lens 179 does not have a non-focusing region 171, a narrower focusing range 320 is obtained in the second pixel block 30. Therefore, a phase difference signal can be generated in the second pixel block 30 at a higher separation ratio. Alternatively, the second pixel block 30 in the same figure can also be disposed in pixel region 3.

[0034] Figure 5 is a top view showing an example of the focusing of incident light from a pixel in the first embodiment of this disclosure. The same figure illustrates the focusing range of pixel block 20 and second pixel block 30. Furthermore, the same figure shows an example where the crystalline lens 170 and second crystalline lens 179 are offset to the lower right of the figure. The centers of the focusing range 310 of crystalline lens 170 and the focusing range 320 of second crystalline lens 179 are offset to the lower right of the figure. Therefore, the amount of incident light varies for pixels 100a, 100b, 100c, and 100d.

[0035] Because the light-gathering range 320 is narrower in the second pixel block 30 equipped with the second crystal lens 179, there are significant differences in the amount of incident light to pixels 100a, 100b, 100c, and 100d. Specifically, the amount of incident light to pixel 100a is approximately 0, and almost all the incident light is focused on pixel 100d.

[0036] In contrast, the pixel block 20 equipped with the crystal lens 170 has a wider light-gathering range 310. This reduces the difference in incident light amount between pixels 100a, 100b, 100c, and 100d. Furthermore, when pixels 100a, 100b, 100c, and 100d are used as phase difference pixels, the error contained in the detected phase difference can also be reduced.

[0037] [Pixel Block Configuration] Figure 6A is a diagram showing an example of the pixel block configuration of the first embodiment of the present disclosure. The same figure is a top view showing an example of the configuration of pixel block 20 and second pixel block 30 in pixel region 3. In pixel region 3 of the same figure, pixel block region 300 is configured in the central part. Second pixel block 30 is configured in pixel block 300. Pixel block 20 is configured in the area outside pixel block region 300. In the central part of pixel region 3, incident light is incident approximately vertically. Therefore, second pixel block 30 is configured in the central part of pixel region 3. Because it forms a narrower focusing range 320, the phase difference separation ratio can be improved, and the phase difference detection accuracy can be improved.

[0038] The effect of height deviation of the crystal lens 170 on the central pixel 100 is smaller. This is because the incident light is incident perpendicularly, resulting in a smaller horizontal offset. On the other hand, the effect of height deviation of the crystal lens 170 on the periphery of pixel region 3 is larger because the horizontal incident position offset is larger.

[0039] Positional shifts caused by the tilted incident light at the periphery of the high image height can be corrected by pupil correction. However, positional shifts caused by deviations (manufacturing deviations) in the height of the lens 170 cannot be corrected by pupil correction. Therefore, by expanding the light-gathering area, the influence of manufacturing deviations in the lens 170 can be reduced. This reduces the sensitivity difference between pixels 100 in pixel block 20.

[0040] [Another configuration for pixel blocks] Figure 6B shows another configuration example of the pixel blocks in the first embodiment of the present disclosure. The same figure is a top view, similar to Figure 6A, showing a configuration example of pixel blocks 20 and 30 in pixel region 3. In the same figure, the 30 pixel block is positioned at the center of pixel region 3, and pixel blocks 20 are positioned in other areas. The light-gathering range 310 of the lens 170 is adjusted according to the distance of the pixel blocks 20 from the center. Specifically, the light-gathering range 310 of the lens 170 in the pixel blocks 20 near the center of pixel region 3 is narrowed. Furthermore, the light-gathering range 310 of the lens 170 continuously expands as it moves away from the center of pixel region 3. This can be achieved by adjusting the opening of the recess forming the non-light-gathering region 171 according to the incident angle of the incident light.

[0041] Adjustment of the opening of the recess is equivalent to adjusting the size or position of the opening. The opening of the recess can be adjusted by adjusting at least one of the size and position of the opening.

[0042] The focusing range 310 can be adjusted, for example, by adjusting the range of the non-focusing region 171. Specifically, in the pixel block 20 near the center of the pixel region 3, the non-focusing range 171 of the crystal lens 170 is narrowed. On the other hand, in the pixel block 20 at the periphery of the pixel region 3, the non-focusing region 171 of the crystal lens 170 is expanded. In this way, the size of the non-focusing region 171 of the crystal lens 170 is adjusted according to the distance from the center of the pixel region 3. In this way, a crystal lens 170 with a focusing range 310 corresponding to the incident angle of the incident light can be arranged in the pixel block 20.

[0043] [Manufacturing Method of Crystal-borne Lenses] Figures 7A-7D illustrate one example of a method for manufacturing a crystal-borne lens according to an embodiment of the present disclosure. The same figures show the manufacturing steps of the crystal-borne lens 170. First, a material film 400 for the crystal-borne lens 170 is formed on the surface of a color filter 150 (not shown) deposited on a semiconductor substrate 120. Next, a resist 401 (Figure 7A) is disposed on the surface of the material film 400. These steps can be performed, for example, by a coating method.

[0044] Next, openings 402 and 403 are formed in the resist 401. Opening 402 is a groove-shaped opening disposed at the boundary of the pixel block 20. Opening 403 is an opening disposed at the center of the pixel block 20 (Fig. 7B). The openings 402 and 403 can be formed by exposing and developing the resist 401.

[0045] Next, the resist 401 is processed into the shape of a lens. This can be done by heating the resist 401 to soften it (Figure 7C).

[0046] Next, the shape of the resist 401 is transferred to the material film 400 (Figure 7D). This can be done, for example, by using the resist 401 as a mask and etching the material film 400. For this etching, dry etching can be applied.

[0047] Through the above steps, the crystal lens 170 can be formed. Next, the shape of the resist 401 in FIG7B will be explained.

[0048] Figure 8 is a diagram showing an example of the composition of the resist used in forming the crystal lens according to the embodiment of the present disclosure. The same figure shows an example of the composition of the resist 401. As shown in the figure, the opening 402 is a groove-shaped opening formed at the boundary of the pixel block 20. Also, the opening 403 is formed at the center of the pixel block 20. The opening 403 in the same figure shows an example of being configured as a rectangle. In addition, the same figure shows an example of the resist 401 when it is formed as a crystal lens 170 configured as a rectangle when viewed from above. By arranging the opening 402, the thickness of the central part of the resist 401 after heating can be reduced. By using the resist 401 of this shape, the material film 400 can be etched to form a crystal lens 170 having a non-focusing region 171 configured as a concave area.

[0049] Additionally, when forming the second crystal lens 179, a resist 401 without an opening 403 is used.

[0050] [Example of the first variation] Figure 9 shows a pixel configuration example of the first variation of the first embodiment of this disclosure. The same figure is a top view showing a configuration example of pixel block 20, similar to Figure 2. The difference between the lens 170 in the same figure and the lens 170 in Figure 2 is that it is offset from the center of pixel block 20. The same figure shows an example of the lens 170 being offset to the left. As mentioned above, pixel blocks 20 located in areas other than the center of pixel region 3 allow incident light to be incident at an angle. Therefore, the lens 170 is offset in the incident direction of the incident light. The pixel block 20 in the same figure shows an example of a pixel block 20 located to the right of pixel region 3. This process of offsetting the lens 170 in the incident direction of the incident light is called pupil correction. In pixel block 20 of the same figure, the lens 170 can be offset according to the incident angle of the incident light.

[0051] [Second Variation Example] Figure 10 is a diagram showing an example of pixel configuration in a second variation of the first embodiment of the present disclosure. The same figure is a cross-sectional view, similar to Figure 4A, showing an example of the configuration of pixel block 20. The difference between the crystal lens 170 in the same figure and the crystal lens 170 in Figure 4A is that it has a non-focusing region 172 configured as a flat area. By configuring the surface flat, incident light propagates in a straight line, thus expanding the focusing range 310 of the crystal lens 170.

[0052] The non-focusing region 171 in Figure 4A is formed by a concave curved surface, and the non-focusing region 172 in the same figure is formed by a plane (a surface with a curvature of 0). In addition to these, the non-focusing regions disclosed herein also include convex portions with a small curvature. For example, the non-focusing regions also include convex portions with a focal point located in the wiring region 140 of the lower layer of the semiconductor substrate 120, and whose curvature does not substantially contribute to the focusing of incident light.

[0053] Thus, the imaging device 1 of the first embodiment disclosed herein can expand the light-gathering range 310 by placing a crystal lens 170 having a non-focusing area 171, etc., in the pixel block 20. In this way, even in the case of positional deviation of the crystal lens 170, the effect of light-gathering shift can be reduced.

[0054] (2. Second Implementation) The imaging device 1 of the first embodiment described above uses a crystal lens 170 with a uniform thickness at its periphery. In contrast, the imaging device 1 of the second embodiment disclosed herein differs from the first embodiment in that it uses a crystal lens 170 with an adjusted thickness at its periphery.

[0055] [Pixel Composition] Figure 11 is a diagram showing an example of the pixel configuration of the second embodiment of this disclosure. The same figure is a cross-sectional view showing an example of the configuration of pixel block 20, similar to Figure 4A. The difference between pixel block 20 in the same figure and pixel block 20 in Figure 4A is that it has a crystal lens 173 for adjusting the thickness of the peripheral portion.

[0056] The crystal lens 173 in the same figure adjusts the thickness of a portion of the peripheral portion adjacent to the non-focusing area 171. Specifically, the thickness of the right peripheral portion is reduced relative to the left side of the same figure. This expands the focusing range of the incident light in the right peripheral portion. Therefore, when the incident light is incident at an angle from the left side of the figure, the focusing range can be expanded, and the effect of focusing offset can be reduced. The crystal lens 173 can be formed by offsetting the position of the opening 403 of the resist 401 as illustrated in Figure 8. This reduces the positional offset error relative to the height deviation of the crystal lens 170 by reducing the incident angle of oblique incidence.

[0057] Since the configuration of the other imaging device 1 is the same as that of the imaging device 1 in the first embodiment disclosed herein, the description is omitted.

[0058] Thus, the imaging device 1 of the second embodiment disclosed herein includes: a crystal lens 170, which has a peripheral portion whose thickness is adjusted according to the incident direction of the incident light. This further reduces the influence of light focusing deviation.

[0059] (3. Third Implementation) The imaging device 1 of the first embodiment described above has a color filter 150 disposed in the pixel block 20. In contrast, the pixel block 20 of the third embodiment disclosed herein differs from that of the first embodiment in that the type of color filter 150 disposed thereis is selected.

[0060] [Pixel Composition] Figure 12 shows an example of the pixel configuration of the third embodiment disclosed herein. The same figure is a top view showing an example of the pixel block 20 configuration, similar to Figure 2. The difference between the pixel block 20 in Figure 12 and the pixel block 20 in Figure 2 is that color filters 150 corresponding to red and blue light are disposed therein. Furthermore, a color filter 150 corresponding to green light is disposed in the second pixel block 30. A phase difference signal is generated in the second pixel block 30 of the same figure. Therefore, a second crystalline lens 179 is disposed to focus light at the center of the second pixel block 30. This improves the separation ratio.

[0061] On the other hand, a crystal lens 170 is disposed in the pixel block where color filters 150 corresponding to red and blue light are configured to expand the light-gathering range. As illustrated in FIG3, a separation portion 135 of pixel 100 is disposed in the center of pixel block 20. Since this separation portion 135 scatters incident light, it becomes a cause of color mixing. Therefore, in pixel block 20 of the same figure where no phase signal is generated, the crystal lens 170 expands the light-gathering range and reduces the scattered incident light. In this way, color mixing in pixel block 20 where color filters 150 corresponding to red and blue light are configured can be reduced.

[0062] [Another component of pixels] Figure 13 shows another example of the pixel configuration of the third embodiment of this disclosure. The same figure is a top view, similar to Figure 12, showing an example of the configuration of pixel block 20. The difference between pixel block 20 in Figure 13 and pixel block 20 in Figure 12 is that color filters 150 corresponding to green and blue light are arranged therein. The shorter wavelengths of green and blue light are focused near the back surface of the semiconductor substrate 120. Therefore, a crystal lens 170 is arranged in these pixel blocks to expand the focusing range.

[0063] On the other hand, longer wavelength red light is focused deep within the semiconductor substrate 120. Therefore, the pixel block equipped with the color filter 150 corresponding to red light is less susceptible to focusing shift. Therefore, a second crystalline lens 179 is disposed in the pixel block where the color filter 150 corresponding to red light is located. This narrows the focusing range of the second pixel block 30, improving the separation ratio.

[0064] Furthermore, by aligning the focusing state with the wavelength of each incident light, the phase difference between each wavelength becomes approximately equal, thus improving the accuracy of autofocus.

[0065] Since the configuration of the other imaging device 1 is the same as that of the imaging device 1 in the first embodiment disclosed herein, the description is omitted.

[0066] Thus, the imaging device 1 of the third embodiment disclosed herein selects a crystal lens 170 and a second crystal lens 179 according to the type of color filter 150 disposed in the pixel block. In this way, a focusing range corresponding to the wavelength of light selected by the color filter 150 can be configured.

[0067] (4. Fourth Implementation Form) The camera device 1 of the first embodiment described above has four pixels 100 arranged in the pixel block. In contrast, the camera device 1 of the fourth embodiment disclosed herein differs from the first embodiment in that it has two pixels 100 arranged in the pixel block.

[0068] [Pixel Composition] Figure 14 is a diagram showing an example of the pixel configuration of the fourth embodiment of this disclosure. The same figure is a top view showing an example of the configuration of pixel block 20, similar to Figure 2. The difference between pixel block 20 in the same figure and pixel block 20 in Figure 2 is that a crystal lens (crystal lens 174) is commonly arranged in both pixels 100.

[0069] The lens 174 in the same figure is elliptical in shape when viewed from above. A non-focusing region 175, formed by a groove-shaped recess, is disposed in the center of the lens 174. Pixels 100a and 100b in the same figure generate phase difference signals. These pixels 100a and 100b divide the pupil of the subject in adjacent directions. The non-focusing region 175 in the same figure is formed in a direction orthogonal to the direction in which the pupils of pixels 100a and 100b are divided.

[0070] [Composition of a Crystal-borne Lens] Figures 14B-14C show examples of the configuration of the lens carrier according to the fourth embodiment of this disclosure. Figure 14B is a cross-sectional view of the lens carrier 174 along line a-a' of Figure 14A. Figure 14C is a cross-sectional view of the lens carrier 174 along line b-b' of Figure 14A. By arranging the non-focusing region 175 of this shape, the focusing range in the direction of pupil division can be expanded.

[0071] Furthermore, Figure 14D is a cross-sectional view showing an example of the configuration of the lens 176 disposed in the second pixel block 30. The same figure, like Figure 14B, shows the shape of the cross-section along the long side of the lens 176. The shape of the cross-section along the short side of the lens 176 can be set to be the same as in Figure 14C. The lens 176 in the same figure has a relatively narrow focusing range.

[0072] [Pixel Block Configuration] Figure 15 is a diagram showing an example of the pixel block configuration according to the fourth embodiment of this disclosure. The same figure is a top view showing an example of the pixel block 20 configuration. The pixel block 20 can be configured with an offset of 1 pixel (pixel 100) per column of the pixel region 3. Furthermore, four or five adjacent pixel blocks 20 can be grouped together, and the pixel blocks 20 can be configured in a Bayer arrangement within the four groups.

[0073] [Another configuration for pixel blocks] Figure 16 shows another configuration example of the pixel blocks in the fourth embodiment of this disclosure. The same figure shows an example of four adjacent pixel blocks 20 arranged in a Bayer arrangement. The difference from the four groups constituting the Bayer arrangement in Figure 15 is that the number of pixel blocks 20 corresponding to green and the number of pixel blocks 20 corresponding to red and blue are the same (four each).

[0074] [Another configuration for pixel blocks] Figure 17 shows another configuration example of the pixel blocks according to the fourth embodiment of this disclosure. The same figure illustrates an example of pixel blocks 20 rotated 45 degrees, with four adjacent pixel blocks 20 grouped together, and these four groups arranged in a Bayer arrangement. The difference from the four groups constituting the Bayer arrangement in Figure 15 is that the number of pixel blocks 20 corresponding to green and those corresponding to red and blue is the same.

[0075] Since the configuration of the other imaging device 1 is the same as that of the imaging device 1 in the first embodiment disclosed herein, the description is omitted.

[0076] Thus, in the fourth embodiment of the imaging device 1 disclosed herein, a crystal lens 174 is commonly arranged in both pixels 100 to expand the light-gathering range. This reduces the impact of light-gathering shift in the pixel block 20 with its two pixels 100.

[0077] (5. Fifth Implementation) The imaging device 1 of the fourth embodiment described above uses square-shaped pixels 100. In contrast, the imaging device 1 of the fifth embodiment disclosed herein differs from the fourth embodiment in that it uses rectangular-shaped pixels 100.

[0078] [The Composition of Pixel Blocks] Figure 18 is a diagram showing an example of the configuration of a pixel block according to the fifth embodiment of this disclosure. The same figure is a top view showing an example of the configuration of pixel block 20. Pixel block 20 in the same figure includes pixels 100a and 100b, which are rectangular in shape when viewed from above. Therefore, pixel block 20 in the same figure is configured as a square shape when viewed from above. Furthermore, the lens 170 can be configured as a circle when viewed from above. Also, the lens 170 in the same figure shows an example where a non-focusing area 171 is arranged in the center.

[0079] [Another component of pixel blocks] Figure 19A shows another configuration example of the pixel block according to the fifth embodiment of the present disclosure. The same figure is a top view showing a configuration example of the pixel block 20. The pixel block 20 in the same figure is similar to the crystal lens 174 described in Figure 14A, and is equipped with a crystal lens 177 having a non-focusing area 178 formed by a groove-shaped recess.

[0080] Figures 19B and 18C are diagrams showing an example of the configuration of the lens carrier according to the fifth embodiment of this disclosure. Figure 19B is a cross-sectional view of the lens carrier 177 along line a-a' of Figure 19A. Figure 19C is a cross-sectional view of the lens carrier 177 along line b-b' of Figure 19A. By arranging the non-focusing region 178 of this shape, the focusing range in the direction of pupil division can be expanded.

[0081] [Pixel Block Configuration] Figure 20 is a diagram showing an example of the pixel block configuration of the fifth embodiment of this disclosure. The same figure is a top view showing an example of the pixel block 20 configuration. Pixel region 3 in the same figure represents an example of the pixel block 20 and the second pixel block 30 configured in the left-right pupil division of the same figure. Alternatively, the pixel block 20 shown in Figure 18 can be used for the pixel block 20 in the same figure. Furthermore, the second pixel block 30 in the same figure can be applied to the second pixel block 30 formed by the common configuration of the second crystal lens 179 in the two pixel blocks 100a and 100b shown in Figure 18.

[0082] A second pixel block 30 is positioned along the central line passing through pixel region 3. Pixel block 20 can be positioned outside of pixel region 3. The focusing range 310 of the crystal lens 170 is adjusted based on the distance of pixel block 20 from the central line passing through pixel region 3. Specifically, the focusing range 310 of the crystal lens 170 in pixel block 20 closer to the central line passing through pixel region 3 is narrowed. Furthermore, the focusing range 310 of the crystal lens 170 is expanded as it moves away from the central line passing through pixel region 3. Additionally, the pixel block 20 can undergo pupil correction of the crystal lens 170.

[0083] [Another configuration for pixel blocks] Figure 21 shows another configuration example of the pixel block according to the fifth embodiment of this disclosure. The same figure shows an example of the configuration of the crystal lens 173 described in Figure 11 in the pixel block 20. In the same figure, the pixel block 20 can also perform pupil correction of the crystal lens 173.

[0084] Since the configuration of the other imaging device 1 is the same as that of the imaging device 1 in the first embodiment disclosed herein, the description is omitted.

[0085] Thus, in the pixel block 20 having rectangular pixels 100a and 100b, the effect of light-gathering shift can be reduced in the fifth embodiment of the imaging device 1 disclosed herein. Furthermore, at the periphery of pixel region 3, incident light is incident at an angle relative to pixel 100. During this angled incident light, light-blocking film 159 causes light loss, resulting in a reduction in the separation ratio of phase difference pixels. However, by placing the non-focusing region 171 on the crystal lens 170, the angle of incident light can be suppressed (shallowed), and light loss can be suppressed. This improves the separation ratio.

[0086] (6. Sixth Implementation) The imaging device 1 of the first embodiment described above has a pixel region 3 consisting of a plurality of pixel blocks 20 arranged in a Bayer pattern. In contrast, the imaging device 1 of the sixth embodiment disclosed herein differs from the first embodiment in that it has a pixel unit composed of a plurality of pixel blocks 20.

[0087] [Components of a Pixel Unit] Figure 22 is a diagram showing an example of the configuration of a pixel unit according to the sixth embodiment of this disclosure. The same figure is a top view showing an example of the configuration of the pixel unit 50. The pixel unit 50 in the same figure is configured in two columns and two rows by arranging a plurality of pixel blocks 20 having color filters 150 corresponding to the same color. Furthermore, the same figure shows an example of four pixel units 50, including pixel blocks 20 having color filters 150 corresponding to red, green, and blue light, arranged in a Bayer arrangement. Thus, by having a pixel region 3 containing pixel units 50 having a plurality of pixel blocks 20 having color filters 150 of the same color, the resolution of the imaging device 1 can be easily changed. Specifically, the resolution of the imaging device 1 can be changed to three types: resolution based on pixels 100, resolution based on pixel blocks 20, and resolution based on pixel units 50.

[0088] In the same figure, pixel unit 50 represents an example where the non-focusing region 171 of the crystal lens 170 of each pixel block 20 is positioned offset along the direction outside the pixel unit 50. By offsetting the non-focusing region 171 of the crystal lens 170 in the direction outside the pixel unit 50, incident light can be focused onto the pixel 100 inside the pixel unit 50. Therefore, incident light towards the adjacent pixel unit 50 can be reduced, and color mixing can be reduced.

[0089] [Another component of a pixel unit] Figure 23 shows another configuration example of the pixel unit according to the sixth embodiment of this disclosure. The same figure is a top view showing a configuration example of the pixel unit 50, similar to Figure 22. The difference between the pixel unit 50 in the same figure and the pixel unit 50 in Figure 22 is that the non-focusing region 171 of the lens 170 of the pixel unit 50 corresponding to green light is positioned offset along the inner side of the pixel unit 50. Furthermore, the non-focusing region 171 of the lens 170 of the pixel block 20 corresponding to red and blue light in the same figure is positioned at the unoffset position.

[0090] By positioning the non-focusing region 171 of the lens 170 of the pixel unit 50 corresponding to green light at a position offset along the inner side of the pixel unit 50, the sensitivity of the pixels 100 at the periphery of the pixel unit 50 can be improved. This reduces the color mixing effect on the pixel unit 50 corresponding to green light from pixel units 50 corresponding to other colors. Furthermore, the configuration of positioning the non-focusing region 171 of the lens 170 at a position offset along the inner side of the pixel unit 50 can be applied to at least one of the pixel units 50 corresponding to red light, green light, and blue light.

[0091] Furthermore, the configurations of pixel units 50 in Figures 22 and 23 can also be combined. For example, the non-focusing region 171 of the lens 170 of the pixel unit 50 corresponding to red light in Figure 22 can be applied to the pixel unit 50 corresponding to red light in Figure 23. In this case, the non-focusing region 171 of the lens 170 of the pixel unit 50 corresponding to red light can be shifted outward, so that the incident light is focused on the inner pixel 100 of the pixel unit 50. This reduces color mixing of the pixel unit 50 corresponding to red light with the surrounding pixels 100. It can further reduce color mixing of long-wavelength incident light, which is prone to problems.

[0092] [Another component of a pixel unit] Figures 24 and 25 show another configuration example of the pixel unit according to the sixth embodiment of this disclosure. These figures are top views of a configuration example of the pixel unit 50, similar to Figure 22. The difference between the pixel unit 50 in these figures and the pixel unit 50 in Figure 22 is that it is constructed by pixel blocks 20 having pixels 100a and 100b shown in Figure 18. Figure 24, similar to Figure 22, shows an example where the non-focusing region 171 of the lens 170 of each pixel block 20 of the pixel unit 50 is positioned offset along the direction of the outer side of the pixel unit 50. Similarly, Figure 25, similar to Figure 23, shows an example where the non-focusing region 171 of the lens 170 of the pixel unit 50 corresponding to green light is positioned offset along the direction of the inner side of the pixel unit 50.

[0093] Since the configuration of the other imaging device 1 is the same as that of the imaging device 1 in the first embodiment disclosed herein, the description is omitted.

[0094] Thus, in the sixth embodiment of the imaging device 1 disclosed herein, the position of the non-focusing area 171 of the crystal lens 170 is adjusted for each pixel unit 50. This reduces color mixing.

[0095] (7. Seventh Implementation) The imaging device 1 of the fourth embodiment described above is configured with a plurality of pixel blocks 20 having two pixels 100, offset by one pixel. In contrast, the imaging device 1 of the seventh embodiment disclosed herein differs from the fourth embodiment in that the size of the non-focusing area 171 of the crystal lens 170 having a plurality of pixel blocks 20 having two pixels 100 is adjusted.

[0096] [Components of a Pixel Unit] Figure 26 is a diagram showing an example of the configuration of a pixel block according to the seventh embodiment of this disclosure. The same figure is a top view showing an example of the configuration of pixel block 20. Similar to Figure 15, the pixel blocks 20 in the same figure are adjacent in the column direction, and the pixel block 20 has two pixels 100 that transmit incident light of the same wavelength and a crystal lens 174 commonly arranged in the column direction. The pixel block 20 is arranged with each column offset by only one pixel 100.

[0097] Here, a pixel group 40 is defined as two adjacent pixel blocks 20 (pixel blocks 20a and 20b in the same figure) having color filters 150 that transmit incident light of the same wavelength in the column direction, and a pixel block 20 (pixel block 20c in the same figure) having color filters 150 that are adjacent to these pixel blocks 20 in the column direction and transmit incident light of different wavelengths. The pixel region 3 in the same figure can capture a plurality of pixel groups 40 arranged together. Furthermore, in the pixel group 40, the two pixel blocks 20a and 20b having color filters 150 corresponding to the same color are defined as a multi-pixel section 41, and the single pixel block 20c having a color filter 150 different from the pixel blocks 20 of the multi-pixel section 41 is defined as a single-pixel section 42.

[0098] The pixel group 40 in the same figure is an example where the multi-pixel portion 41 and the single-pixel portion 42 are configured with non-light-concentrating regions 171 of different sizes. Specifically, the single-pixel portion 42 in the same figure has a non-light-concentrating region 171 with a smaller size than the non-light-concentrating region 171 of the multi-pixel portion 41. In this way, the light-concentrating range of the pixel block 20 of the single-pixel portion 42 can be narrowed relative to the pixel block 20 of the multi-pixel portion 41.

[0099] Within pixel block 20 of the same image, color mixing becomes problematic. As shown in the figure, in the configuration of pixel block 20 arranged with offset columns, when there are image boundaries along the row direction (e.g., the direction of the white arrows in the same image), the color mixing of adjacent pixels 100 along the row direction varies in each column. Specifically, in the portion marked by the white arrows in the same image, even if the actual image is the same in the row direction, it alternates between color mixing with pixels 100 to the right or left in the column direction. Therefore, the output images of the white arrow portions in the same image are not identical, resulting in a reduction in image quality at the boundary areas of the actual image.

[0100] The image variation depends on the intensity of color mixing within pixel block 20. The narrower the focusing range of the lens 170, the greater the color mixing within pixel block 20. To mitigate this effect, the focusing range of pixel blocks 20 located at the boundaries of pixel blocks 20 of the same color is expanded, while the focusing range of pixel blocks 20 located in the center of pixel blocks 20 of the same color is narrowed. Specifically, the size of the non-focusing area 171 of the lens 170 of the pixel block 20 of the single-pixel section 42 is reduced, thus narrowing the focusing range. This increases the color mixing within pixel blocks 20 of the single-pixel section 42 and reduces the variation in color mixing in the column direction. Furthermore, the non-focusing area 171 of the lens 170 of the pixel block 20 of the multi-pixel section 41 can also be eliminated.

[0101] [Another component of a pixel unit] Figure 27 shows another configuration example of the pixel block of the seventh embodiment disclosed herein. The same figure is a top view showing a configuration example of the pixel block 20, similar to Figure 26. The pixel blocks 20a and 20b constituting the multi-pixel portion 41 in the same figure differ from the pixel block 20 in Figure 26 in that they are respectively configured with non-light-focusing regions 171 of different sizes.

[0102] Incident light is obliquely incident on pixel group 40 at the periphery of pixel region 3. For example, when the incident light is obliquely incident in the same column direction, the color mixing effect of pixel block 20b increases compared to pixel block 20a. This is because pixel blocks 20 corresponding to different colors are arranged to the right of pixel block 20b. Therefore, the size of the non-focusing area 171 of pixel block 20b is made larger than the non-focusing area 171 of pixel block 20a, thereby expanding the focusing range. This reduces the effect of color mixing.

[0103] Since the configuration of the other imaging device 1 is the same as that of the imaging device 1 in the fourth embodiment disclosed herein, the description is omitted.

[0104] Thus, the imaging device 1 of the seventh embodiment disclosed herein adjusts the size of the non-focusing area 171 of the pixel block 20 of each of the pixel group 40. This reduces the impact of color mixing.

[0105] (8. Eighth Implementation) The imaging device 1 of the first embodiment described above has a pixel block 20 in the pixel region 3, in which a common crystal lens 170 is disposed on a plurality of pixels 100. In contrast, the imaging device 1 of the eighth embodiment disclosed herein differs from the first embodiment in that it has a pixel region 3, which has pixels 100 in which a crystal lens is disposed on each of its own pixels 100.

[0106] [Components of a Pixel Unit] Figure 28 is a diagram showing an example of the pixel block configuration of the eighth embodiment of this disclosure. The same figure illustrates an example where pixel units 50, composed of a plurality of pixels 100 with circular lens 189s, are arranged in a Bayer arrangement. A pixel block 20, where a lens 174 is commonly arranged in two pixels 100, is located within one portion of the four pixel units 50 in this Bayer arrangement. This pixel block 20 generates a phase difference signal. Furthermore, color mixing is reduced because the lens 170 of this pixel block 20 also has a non-focusing area 175. This effect is particularly noticeable at the periphery of pixel region 3.

[0107] The configuration of the other imaging device 1 is the same as that of the imaging device 1 in the first embodiment disclosed herein, and therefore the description is omitted.

[0108] (9. Ninth Implementation Form) In the first embodiment described above, the camera device 1 has pixels 100 disposed in pixel region 3. In contrast, the camera device 1 of the ninth embodiment disclosed herein differs from the first embodiment in that a beam splitter is disposed in pixel 100.

[0109] [Pixel Composition] Figure 29 is a diagram showing an example of the pixel configuration of the ninth embodiment of this disclosure. The same figure is a cross-sectional view showing an example of the pixel 100 configuration, similar to Figure 3. The difference between the pixel 100 in the same figure and the pixel 100 in Figure 3 is that the beam splitter 160 is further disposed between the color filter 150 and the crystal lens 170.

[0110] The beam splitter 160 is a device that splits incident light within a specific wavelength range. Specifically, the beam splitter 160 splits the incident light along different directions according to the wavelength.

[0111] [The Composition of Pixel Blocks] Figures 30A and 30B are diagrams showing examples of pixel configuration in the ninth embodiment of this disclosure. Similar to Figure 2, these figures are top views showing examples of pixel 100 configuration. Also, these figures show examples of pixel block 20 configuration in the ninth embodiment of this disclosure. In these figures, the white arrows indicate the beam-splitting direction of the beam-splitting element 160. The beam-splitting element 160 splits long-wavelength incident light and short-wavelength incident light along different directions. Taking the pixel unit 50 corresponding to the green light in Figure 30A as an example, the beam-splitting element 160 splits long-wavelength incident light and short-wavelength incident light, which are approximately at the center of the wavelength band corresponding to the green light, along different directions (indicated by the up-down direction shown by the white arrows in the same figure). Therefore, by comparing the upper and lower pixels 100 of pixel unit 50 with ordinary pixels 100 that detect incident light in the band corresponding to green light, the narrow-band green light can be received, thereby improving the wavelength resolution of the incident light. This improves color reproduction.

[0112] The slotted non-focusing region 175 of the crystal lens 174 in the same figure can be formed approximately parallel to the beam-splitting direction of the beam-splitting element 160. This expands the focusing range of the beam-splitting direction of the beam-splitting element 160 and reduces focusing. That is, the incident light is focused into a narrower region in the direction of detecting the phase difference of the image plane (perpendicular to the arrow in the figure), ensuring the separation ratio of the phase difference pixels. This is envisioned for use in an autofocus camera device 1 that requires a high separation ratio. On the other hand, for beam-splitting directions that do not contribute to the separation ratio, the focusing range of the incident light can be expanded, reducing scattering caused by the separation section 135 and reducing color mixing. Furthermore, as for the beam-splitting element 160, for example, when using angle-dependent components such as metasurfaces or prisms, by reducing focusing, the incident angle becomes shallower, thereby improving the beam-splitting characteristics. Additionally, Figure 30A shows an example of pixel blocks 20 with equal beam-splitting directions of the beam-splitting element 160, while Figure 30B shows an example of pixel blocks 20 with different beam-splitting directions of the beam-splitting element 160.

[0113] Since the configuration of the other imaging device 1 is the same as that of the imaging device 1 in the first embodiment disclosed herein, the description is omitted.

[0114] Thus, in the imaging device 1 of the ninth embodiment disclosed herein, a beam-splitting element 160 is disposed in the pixel 100 and a crystal lens 174 having a groove-shaped non-focusing region 175 parallel to the beam-splitting direction of the beam-splitting element 160 is disposed therein. In this way, the beam splitting ratio of the beam-splitting element 160 can be improved.

[0115] (10. Tenth Implementation) In the imaging device 1 of the fifth embodiment described above, pixels 100a and 100b are separated by the separation portion 135. In contrast, the imaging device 1 of the tenth embodiment disclosed herein differs from the fifth embodiment in that pixels 100a and 100b are separated by a mechanism other than the separation portion 135.

[0116] [Pixel Composition] Figure 31 is a diagram showing an example of the composition of a pixel block according to the tenth embodiment of this disclosure. The same figure is a top view showing an example of the composition of pixel block 20, similar to Figure 18. The difference between pixel block 20 in the same figure and pixel block 20 in Figure 18 is that pixels 100a and 100b are separated by a separation portion 137.

[0117] The separation section 137 is a semiconductor region with a high impurity concentration. By using the separation section 137, pixels 100a and 100b can be separated, reducing color mixing of adjacent pixels 100 caused by scattering. This is because components that scatter incident light, such as the separation section 135, can be reduced. Furthermore, similar to FIG. 21, pupil correction is performed at the periphery of pixel region 3 to shift the position of the crystal lens 170 in the direction of the center of pixel region 3. Also, the non-focusing region 171 of the crystal lens 170 is formed as a circular concave portion when viewed from above. Furthermore, the non-focusing region 171 of the crystal lens 170 can be offset in the direction of the periphery of pixel region 3. At this time, the position of the non-focusing region 171 can be adjusted according to the color filter 150 of pixel block 20, and the focusing range can be adjusted.

[0118] [Composition of a Crystal-borne Lens] Figures 32A-32C show examples of the configuration of the crystal lens according to the tenth embodiment of this disclosure. The same figure is a cross-sectional view showing an example of the configuration of the crystal lens 170 of the pixel block 20 at the periphery of the pixel region 3. As described above, the crystal lens 170 is offset in the direction of the center of the pixel region 3 by means of pupil correction.

[0119] Figures 32A, 32B, and 32C are diagrams showing examples of the configuration of the crystal lens 170 for the pixel block 20 corresponding to red light, the pixel block 20 corresponding to green light, and the pixel block 20 corresponding to blue light, respectively.

[0120] As described above, the position of the non-focusing area 171 of the crystal lens 170 in pixel block 20 can be adjusted according to the corresponding wavelength of the color filter 150. Pixels 100a and 100b of pixel block 20 constitute phase difference pixels. In these phase difference pixels, when the ratio of sensitivity to the incident angle of incident light, i.e., the separation ratio, is different for each pixel (pixels 100a and 100b), an error in phase difference detection occurs. When the focusing position of the crystal lens 170 is offset from the boundary of pixels 100a and 100b, a difference in the separation ratio occurs for each. Therefore, pupil correction is performed on pixel block 20 located at the periphery of pixel region 3 to compensate for the offset of the focusing position.

[0121] However, the light absorption rate of semiconductors such as silicon (Si) constituting the photoelectric conversion element 101 varies according to wavelength. Specifically, short-wavelength light with higher absorption rate is absorbed in the shallower part of the photoelectric conversion element 101, while long-wavelength light with lower absorption rate is absorbed in the deeper part of the photoelectric conversion element 101. Therefore, the focusing position of the incident light incident at an angle shifts according to the wavelength of the incident light. Specifically, when the pupil correction of the crystal lens 170 is performed based on the incident green light, the focusing position of the red light reaching the deep part of the photoelectric conversion element 101 becomes a position shifted to the back side of the angled incident direction, and the absorption of the back side pixel 100 (pixel 100b in FIG. 32A, etc.) increases, resulting in a difference in the separation ratio. On the other hand, the spotting position of blue light becomes a position offset from the front side (the side of the center of pixel region 3) in the tilted incident direction, and the absorption of the front side pixel 100 (pixel 100a in FIG32A, etc.) increases, resulting in a difference in the separation ratio similar to that of red light.

[0122] Therefore, comparing the pixel block 20 corresponding to red light and the pixel block 20 corresponding to green light, the light is focused in the direction of the center of pixel region 3. That is, the pixel block 20 corresponding to red light focuses the light in the direction of the center of pixel region 3. Specifically, as shown in FIG32A, the non-focusing region 171 is offset in the direction of the periphery of pixel region 3, so that the incident light is refracted to a steeper angle. On the other hand, comparing the pixel block 20 corresponding to blue light and the pixel block 20 corresponding to green light, the light is focused in the direction of the periphery of pixel region 3. As shown in FIG32C, the non-focusing region 171 is offset in the direction of the center of pixel region 3, so that the incident angle of the incident light is shallower.

[0123] [Another component of pixels] Figure 33 shows another example of the pixel block configuration of the tenth embodiment of this disclosure. The same figure is a top view showing an example of the pixel block 20 configuration, similar to Figure 32. The difference between pixel block 20 in the same figure and pixel 100 in Figure 32 is that pixels 100a and 100b are separated by a separating portion 138 with an opening in the central portion. The opening of the separating portion 138 forms an overflow path between pixels 100a and 100b. Since the configuration of pixel block 20 other than that in Figure 32 is the same, its description is omitted.

[0124] Furthermore, the configuration of pixel block 20 in Figures 31 and 33 can be applied to pixel block 20 in Figure 2. For this example, Figures 34 and 35 will be used for illustration.

[0125] [Another component of pixels] Figure 34 is a diagram showing another example of the configuration of a pixel block according to the tenth embodiment of the present disclosure. The same figure shows an example of pixels 100a-100d constituting pixel block 20 being separated by the separating portion 137. The separating portion 137 in the same figure is formed into a cross shape when viewed from above, separating pixels 100a-100d.

[0126] Figure 35 is a diagram showing another example of the configuration of a pixel block according to the tenth embodiment of the present disclosure. The same figure shows an example of pixels 100a-100d constituting pixel block 20 being separated by two orthogonal separation portions 138.

[0127] The configuration of the crystal lens 170 and the non-focusing area 171 in pixel block 20 of Figures 34 and 35 can adopt the same configuration as that of the crystal lens 170 and the non-focusing area 171 in Figure 32.

[0128] (11. 11th Implementation) The changes to the crystal lens 170 are explained.

[0129] [Pixel Composition] Figures 36A and 36B are diagrams showing examples of the configuration of the lens carrier according to the 11th embodiment of this disclosure. Figure 36A shows an example of a lens carrier 180 having four protrusions 182 and a non-focusing area 181. Figure 36B shows an example of a lens carrier 183 configured as a circle with a cross-shaped non-focusing area 184 when viewed from above.

[0130] Furthermore, the configuration of the second variation of the first embodiment disclosed herein can be applied to other embodiments. Specifically, the non-focusing region 172 in FIG10 can be applied to the second to fifth embodiments disclosed herein.

[0131] The configuration of the second embodiment disclosed herein can be applied to other embodiments. Specifically, the crystal lens 173 in FIG11 can be applied to the third and fourth embodiments of this disclosure.

[0132] (12. Example of the structure of a camera device) The aforementioned camera device 1 can be applied to various electronic devices such as camera systems (e.g., digital still cameras or digital camcorders), mobile phones with camera functions, or other machines with camera functions.

[0133] Figure 37 is a block diagram showing an example of the configuration of a camera device mounted on an electronic machine. The same figure is a block diagram showing an example of the configuration of camera device 701.

[0134] As shown in Figure 37, the camera device 701 includes a camera lens 702, a camera element 703, a DSP (Digital Signal Processor) 704, and is connected to the DSP 704, a display device 705, an operating system 706, a memory 708, a recording device 709, and a power supply system 710 via a bus 707. It can capture still images and moving images.

[0135] The photographic lens 702 is composed of one or more lenses, which guides the image light (incident light) from the subject to the image sensor 703 and images it onto the light-receiving surface (sensor section) of the image sensor 703.

[0136] An imaging device 1 is an example of an imaging element 703 that incorporates any of the above-described configurations. Electrons accumulate in the imaging element 703 during a specific period based on the image formed on the light-receiving surface via the photographic lens 702. Furthermore, a signal corresponding to the electrons accumulated in the imaging element 703 is input to a DSP 704.

[0137] The DSP 704 performs various signal processing operations on the signals from the imaging element 703 to acquire an image, and temporarily stores the image data in the memory 708. The image data stored in the memory 708 is recorded in the recording device 709, or supplied to the display device 705 for display. Furthermore, the operating system 706 accepts various user operations, supplies operation signals to each block of the imaging device 701, and the power system 701 supplies the required power to drive each block of the imaging device 701.

[0138] (13. Examples of application to moving bodies) The technology disclosed herein (the Technology) can be applied to various products. For example, the Technology disclosed herein can also be implemented as a device mounted on any of the following mobile bodies: automobiles, electric vehicles, hybrid electric vehicles, motorcycles, bicycles, personal mobility vehicles, airplanes, drones, ships, robots, etc.

[0139] Figure 38 is a block diagram showing a schematic configuration example of a vehicle control system, which is an example of a mobile body control system to which the technology disclosed herein can be applied.

[0140] The vehicle control system 12000 includes a plurality of electronic control units connected via a communication network 12001. In the example shown in Figure 38, the vehicle control system 12000 includes a drive system control unit 12010, a body system control unit 12020, an external information detection unit 12030, an internal information detection unit 12040, and a comprehensive control unit 12050. Furthermore, the comprehensive control unit 12050 is functionally configured as follows: a microcomputer 12051, an audio / image output unit 12052, and an in-vehicle network I / F (Interface) 12053.

[0141] The drive system control unit 12010 controls the operation of devices associated with the vehicle's drive system according to various programs. For example, the drive system control unit 12010 functions as a drive force generating device such as an internal combustion engine or drive motor to generate the vehicle's driving force, a drive force transmission mechanism to transmit the driving force to the wheels, a steering mechanism to adjust the vehicle's steering angle, and a braking device to generate the vehicle's braking force.

[0142] The body system control unit 12020 controls the operation of various devices equipped on the vehicle body according to various programs. For example, the body system control unit 12020 functions as a control device for keyless entry systems, smart key systems, power windows, or various lights such as headlights, taillights, brake lights, turn signals, or fog lights. In this case, the body system control unit 12020 can input radio waves or signals from portable devices that replace keys. The body system control unit 12020 accepts such radio wave or signal inputs and controls the vehicle's door locking devices, power windows, lights, etc.

[0143] The exterior information detection unit 12030 detects external information of the vehicle equipped with the vehicle control system 12000. For example, a camera unit 12031 is connected to the exterior information detection unit 12030. The exterior information detection unit 12030 causes the camera unit 12031 to capture images of the exterior of the vehicle and receives the captured images. The exterior information detection unit 12030 can also perform object detection processing or distance detection processing based on the received images, such as people, vehicles, obstacles, signs, or text on the road surface.

[0144] The camera unit 12031 is a light sensor that receives light and outputs an electrical signal corresponding to the amount of light received. The camera unit 12031 can output the electrical signal as an image or as distance measurement information. Furthermore, the light received by the camera unit 12031 can be visible light or non-visible light such as infrared light.

[0145] The in-vehicle information detection unit 12040 detects information inside the vehicle. For example, a driver status detection unit 12041 that detects the driver's state is connected to the in-vehicle information detection unit 12040. The driver status detection unit 12041 includes, for example, a camera that captures images of the driver. Based on the detection information input from the driver status detection unit 12041, the in-vehicle information detection unit 12040 can calculate the driver's fatigue level or level of concentration, and can also determine whether the driver is dozing off.

[0146] The microcomputer 12051 can calculate the control target values ​​of the drive force generating device, steering mechanism, or braking device based on the information inside and outside the vehicle obtained by the external information detection unit 12030 or the internal information detection unit 12040, and output control commands to the drive system control unit 12010. For example, the microcomputer 12051 can perform coordinated control for the purpose of realizing ADAS (Advanced Driver Assistance System) functions, including avoiding vehicle collisions or mitigating impacts, following the vehicle based on distance, maintaining vehicle speed, vehicle collision warning, or vehicle lane departure warning.

[0147] Furthermore, the microcomputer 12051 can control the driving force generating device, steering mechanism, or braking device based on information about the vehicle's surroundings obtained by the external information detection unit 12030 or the internal information detection unit 12040, and perform coordinated control for purposes such as autonomous driving that is not subject to the driver's operation.

[0148] Furthermore, the microcomputer 12051 can output control commands to the vehicle system control unit 12020 based on the external information obtained by the external information detection unit 12030. For example, the microcomputer 12051 can control the headlights according to the position of the vehicle in front or oncoming vehicle detected by the external information detection unit 12030, and perform coordinated control for the purpose of switching high beams to low beams to reduce glare.

[0149] The audio-visual output unit 12052 transmits an output signal of at least one of the audio and visual signals to an output device that can provide visual or auditory notification information to the occupants of the vehicle or to the outside of the vehicle. In the example of Figure 38, examples of output devices include an audio speaker 12061, a display unit 12062, and an instrument panel 12063. The display unit 12062 may also include, for example, at least one of an in-vehicle display and a head-up display.

[0150] Figure 39 shows an example of the installation position of the camera unit 12031.

[0151] In Figure 39, the camera unit 12031 includes camera units 12101, 12102, 12103, 12104, and 12105.

[0152] Cameras 12101, 12102, 12103, 12104, and 12105 are installed, for example, on the front nose, side mirrors, rear bumper, rear door, and the upper part of the windshield inside the vehicle 12100. The camera 12101 on the front nose and the camera 12105 on the upper part of the windshield inside the vehicle primarily acquire images of the front of the vehicle 12100. The cameras 12102 and 12103 on the side mirrors primarily acquire images of the sides of the vehicle 12100. The camera 12104 on the rear bumper or rear door primarily acquires images of the rear of the vehicle 12100. The camera 12105 on the upper part of the windshield inside the vehicle is mainly used for detecting vehicles, pedestrians, obstacles, traffic lights, traffic signs, or lane markings ahead.

[0153] Figure 39 shows an example of the imaging range of camera units 12101 to 12104. Camera range 12111 shows the imaging range of camera unit 12101 located at the front nose; camera ranges 12112 and 12113 show the imaging ranges of camera units 12102 and 12103 located at the side mirrors, respectively; and camera range 12114 shows the imaging range of camera unit 12104 located at the rear bumper or rear door. For example, by overlaying the image data captured by camera units 12101 to 12104, a top-down view of vehicle 12100 can be obtained.

[0154] At least one of the camera units 12101 to 12104 may also have the function of acquiring distance information. For example, at least one of the camera units 12101 to 12104 may be a stereo camera containing a plurality of camera elements, or a camera element having pixels for phase difference detection.

[0155] For example, based on distance information obtained from cameras 12101 to 12104, microcomputer 12051 calculates the distance to each three-dimensional object within the camera range 12111 to 12114, and the time change of that distance (relative speed to vehicle 12100). This allows it to identify, in particular, the nearest three-dimensional object located on the path of vehicle 12100 and traveling in approximately the same direction as vehicle 12100 at a specific speed (e.g., 0 km / h or higher), as the vehicle ahead. Furthermore, microcomputer 12051 can set a pre-defined safe distance from the vehicle ahead and perform automatic braking control (including follow-and-stop control) or automatic acceleration control (including follow-and-start control), etc. This allows for coordinated control aimed at autonomous driving, where the driver's input is not required.

[0156] For example, based on distance information obtained from cameras 12101 to 12104, microcomputer 12051 classifies and captures three-dimensional object data related to three-dimensional objects into categories such as two-wheeled vehicles, ordinary vehicles, large vehicles, pedestrians, utility poles, and other three-dimensional objects for automatic obstacle avoidance. For instance, microcomputer 12051 can identify obstacles around vehicle 12100 as those visible to the driver and those difficult to see. Furthermore, microcomputer 12051 determines and displays the collision risk level of each obstacle. If the collision risk level is above a set value, indicating a possible collision, it outputs an alarm to the driver via audio speaker 12061 or display unit 12062, or performs forced deceleration or evasive steering via drive system control unit 12010, thereby providing driving assistance to avoid collisions.

[0157] At least one of the camera units 12101 to 12104 can also be an infrared camera that detects infrared light. For example, the microcomputer 12051 can identify a pedestrian by determining whether a pedestrian exists in the image captured by the camera units 12101 to 12104. The pedestrian identification is performed, for example, by capturing the sequence of feature points from the image captured by the camera units 12101 to 12104 (which are infrared cameras), and by performing pattern matching processing on a series of feature points of the displayed object outline to determine whether it is a pedestrian. If the microcomputer 12051 determines that a pedestrian exists in the image captured by the camera units 12101 to 12104 and identifies it as a pedestrian, the audio-visual output unit 12052 controls the display unit 12062 to overlay a square outline of the identified pedestrian for emphasis. Furthermore, the audio-visual output unit 12052 can also control the display unit 12062 to display pedestrian icons or the like at desired locations.

[0158] The above has described one example of a vehicle control system to which the technology disclosed herein can be applied. The technology disclosed herein, in the configuration described above, can be applied to the camera unit 12031. Specifically, the camera device 1 in FIG1 can be applied to the camera unit 12031.

[0159] (14. Examples of the application of endoscopic surgical systems) The technology disclosed herein (the Technology) can be applied to various products. For example, the Technology disclosed herein can also be applied to endoscopic surgical systems.

[0160] Figure 40 shows an example of a schematic configuration of an endoscopic surgical system to which the technology disclosed herein (the technology) can be applied.

[0161] Figure 40 illustrates a surgeon (physician) 11131 using an endoscopic surgical system 11000 to perform surgery on a patient 11132 on a patient bed 11133. As shown, the endoscopic surgical system 11000 consists of an endoscope 11100, other surgical instruments 11110 such as an insufflator 11111 or an energy treatment device 11112, a support arm device 11120 for supporting the endoscope 11100, and a cart 11200 that carries various devices for endoscopic surgery.

[0162] Endoscope 11100 comprises: a tube 11101, which is inserted into the body cavity of patient 11132 at a specific length from its tip; and a camera head 11102, which is connected to the base of tube 11101. In the illustrated example, the illustration shows an endoscope 11100 composed of a so-called rigid endoscope with a rigid tube 11101, but endoscope 11100 may also be composed of a so-called flexible endoscope with a flexible tube.

[0163] An opening for embedding an objective lens is provided at the front end of the endoscope tube 11101. A light source device 11203 is connected to the endoscope 11100. The light generated by the light source device 11203 is guided to the front end of the endoscope tube by a light guide extending inside the endoscope tube 11101, and then illuminates the object to be observed inside the body cavity of the patient 11132 through the objective lens. Alternatively, the endoscope 11100 can also be a direct viewing endoscope, an oblique viewing endoscope, or a side viewing endoscope.

[0164] An optical system and an imaging element are disposed inside the camera head 11102. Reflected light from the observed object (observation light) is focused onto the imaging element by the optical system. The imaging element photoelectrically converts the observation light to generate an electrical signal corresponding to the observation light, that is, an image signal corresponding to the observed image. This image signal is sent as RAW data to the camera control unit (CCU) 11201.

[0165] The CCU11201, composed of a CPU (Central Processing Unit) or GPU (Graphics Processing Unit), uniformly controls the operation of the endoscope 11100 and the display device 11202. Furthermore, the CCU11201 receives image signals from the camera head 11102 and performs various image processing operations on the image signals, such as developing (mosaicing), to display an image based on those signals.

[0166] The display device 11202 displays an image based on the image signal processed by the CCU 11201 under the control of the CCU 11201.

[0167] The light source device 11203 is composed of a light source such as an LED (Light Emitting Diode) and supplies the illumination light from the photographic section to the endoscope 11100.

[0168] Input device 11204 is the input interface for endoscopic surgery system 11000. Users can input various information or instructions to endoscopic surgery system 11000 through incident device 11204. For example, users can input instructions to change the imaging conditions of endoscope 11100 (type of illumination light, magnification, focal distance, etc.).

[0169] The treatment device control device 11205 controls the drive of the energy treatment device 11112 used for tissue cauterization, incision, or vascular sealing. The pneumoperitoneum device 11206, for the purpose of ensuring the field of vision of the endoscope 11100 and ensuring the surgeon's working space, inflates the patient's body cavity 11132 by introducing gas into the cavity through the pneumoperitoneum tube 11111. The recorder 11207 is a device that can record various surgical-related information. The printer 11208 is a device that can print various surgical-related information in various forms such as text, images, or charts.

[0170] Furthermore, the light source device 11203 that supplies the illumination light from the photographic section to the endoscope 11100 can be, for example, a white light source composed of LEDs, laser light sources, or a combination thereof. Since a white light source composed of a combination of RGB laser light sources can be used to precisely control the output intensity and timing of each color (wavelength), the white balance of the photographic image can be adjusted at the light source device 11203. In this case, by illuminating the object of observation with laser light from each of the RGB laser light sources in a time-division manner, and synchronously controlling the driving of the imaging element of the camera head 11102 with the illumination timing, images corresponding to each of the RGB elements can be captured in a time-division manner. According to this method, color images can be obtained even without a color filter on the imaging element.

[0171] Furthermore, the light source device 11203 can also be driven by changing the intensity of the output light at specific times. By synchronizing with the timing of the change in light intensity, the driving of the imaging element of the camera head 11102 can be controlled to acquire images in time segmentation, synthesize the images, and produce images with high dynamic range that are free from underexposure and overexposure.

[0172] Furthermore, the light source device 11203 can also be configured to supply light in a specific wavelength band corresponding to special light observation. In special light observation, for example, by utilizing the wavelength dependence of light absorption by body tissues, a narrow band of light is irradiated compared to the illumination light used in normal observation (i.e., white light), thereby performing so-called narrow band imaging of specific tissues such as blood vessels on the mucosal surface using high-contrast photography. Alternatively, in special light observation, fluorescence observation can also be performed, which uses fluorescence generated by irradiating excitation light to obtain an image. In fluorescence observation, excitation light can be irradiated onto body tissue to observe the fluorescence from that body tissue (autofluorescence observation), or a reagent such as indocyanine green (ICG) can be locally injected into body tissue and excitation light corresponding to the fluorescence wavelength of the reagent can be irradiated onto the body tissue to obtain a fluorescence image. The light source device 11203 can be configured to supply narrow band light and / or excitation light corresponding to this type of special light observation.

[0173] Figure 41 is a block diagram showing an example of the functional configuration of the camera head 11102 and CCU11201 shown in Figure 40.

[0174] Camera head 11102 includes a lens unit 11401, an image capturing unit 11402, a drive unit 11403, a communication unit 11404, and a camera head control unit 11405. CCU 11201 includes a communication unit 11411, an image processing unit 11412, and a control unit 11413. Camera head 11102 and CCU 11201 can be communicatively connected to each other via a transmission cable 11400.

[0175] Lens unit 11401 is an optical system disposed at the connection portion with lens barrel 11101. Observation light obtained from the front end of lens barrel 11101 is guided to camera head 11102 and incident on lens unit 11401. Lens unit 11401 is composed of a plurality of lenses including zoom lenses and focusing lenses.

[0176] The imaging element constituting the imaging unit 11402 can be a single unit (so-called single-plate type) or multiple units (so-called multi-plate type). When the imaging unit 11402 is configured as a multi-plate type, for example, each imaging element can generate image signals corresponding to RGB values, and these can be combined to obtain a color image. Alternatively, the imaging unit 11402 can be configured with a pair of imaging elements for separately acquiring image signals corresponding to the right and left eyes in 3D (dimensional space). By performing 3D display, the surgeon 11131 can more accurately grasp the depth of the biological tissue in the surgical area. Furthermore, when the imaging unit 11402 is configured as a multi-plate type, multiple lens units 11401 can also be provided corresponding to each imaging element.

[0177] Alternatively, the camera unit 11402 may not be located on the camera head 11102. For example, the camera unit 11402 may be located inside the lens barrel 11101, directly behind the objective lens.

[0178] The drive unit 11403 is constructed by an actuator, and under the control of the camera head control unit 11405, the zoom lens and focusing lens of the lens unit 11401 are moved only a specific distance along the optical axis. In this way, the magnification and focus of the image captured by the imaging unit 11402 can be adjusted appropriately.

[0179] The communication unit 11404 is configured by a communication device for sending and receiving various information with the CCU 11201. The communication unit 11404 transmits the image signal obtained from the camera unit 11402 as RAW data to the CCU 11201 via the transmission cable 11400.

[0180] Furthermore, the communication unit 11404 receives control signals from the CCU 11201 for controlling the drive of the camera head 11102 and supplies them to the camera head control unit 11405. These control signals may include, for example, information regarding shooting conditions such as specifying the frame rate of the captured image, specifying the exposure value during shooting, and / or specifying the magnification and focus of the captured image.

[0181] Furthermore, the aforementioned image capture conditions, such as frame rate, exposure value, magnification, and focus, can be appropriately specified by the user, or automatically set by the control unit 11413 of the CCU11201 based on the acquired image signal. In the latter case, the so-called AE (Auto Exposure), AF (Auto Focus), and AWB (Auto White Balance) functions are equipped on the endoscope 11100.

[0182] The camera head control unit 11405 controls the drive of the camera head 11102 based on the control signal received from the CCU 11201 via the communication unit 11404.

[0183] The communication unit 11411 is configured by a communication device for transmitting and receiving various information with the camera head 11102. The communication unit 11411 receives image signals transmitted from the camera head 11102 via the transmission cable 11400.

[0184] Furthermore, the communication unit 11411 sends control signals to the camera head 11102 to control the driving of the camera head 11102. The image signal or control signal can be transmitted via electrical communication or optical communication, etc.

[0185] The image processing unit 11412 performs various image processing operations on the RAW data, i.e., the image signal, sent by the camera head 11102.

[0186] The control unit 11413 performs various controls related to the imaging of surgical sites using the endoscope 11100 and the display of the video images obtained by the imaging of surgical sites. For example, the control unit 11413 generates control signals to control the drive of the camera head 11102.

[0187] Furthermore, the control unit 11413 displays the camera image of the surgical area, etc., on the display device 11202 based on the image signal processed by the image processing unit 11412. At this time, the control unit 11413 can also use various image recognition technologies to identify various objects in the camera image. For example, the control unit 11413 can identify surgical instruments such as forceps, specific biological parts, bleeding, fog during the use of the energy treatment device 11112, etc., by detecting the shape or color of the edges of objects contained in the camera image. When displaying the camera image on the display device 11202, the control unit 11413 can also use its recognition results to overlay various surgical support information onto the image of the surgical area. By overlaying surgical support information, prompts can be given to the surgeon 11131, which can reduce the burden on the surgeon 11131 or allow the surgeon 11131 to perform the surgery reliably.

[0188] The transmission cable 11400 connecting the camera head 11102 and CCU11201 is an electrical signal cable corresponding to electrical signal communication, an optical fiber corresponding to optical communication, or a composite cable of the like.

[0189] Here, in the example diagram, although wired communication is achieved using transmission cable 11400, communication between camera head 11102 and CCU 11201 can also be conducted wirelessly.

[0190] The above has described an example of an endoscopic surgical system to which the technology disclosed herein can be applied. The technology disclosed herein, in the configuration described above, can be applied to the imaging unit 11402 of the endoscope 11100 or the camera head 11102. Specifically, the imaging device 1 of FIG1 can be applied to the imaging unit 11402.

[0191] Furthermore, although this is described here as an example of an endoscopic surgical system, the techniques disclosed herein can also be applied to other systems such as microscopic surgical systems.

[0192] Furthermore, the effects described in this instruction manual are for illustrative purposes only and are not intended to limit the effects; other effects may also be described.

[0193] (Effect) The imaging device 1 includes a plurality of pixels 100 and a crystal lens 170. The pixels 100 perform photoelectric conversion of incident light from the subject to generate an image signal. The crystal lens 170 is commonly disposed on the plurality of pixels 100, having a non-focusing area 171 in the center and focusing the incident light onto the plurality of pixels 100 in the peripheral area. This expands the focusing range of the incident light.

[0194] Furthermore, the crystal lens 170 may also have a non-focusing area 171 formed by a recess.

[0195] Furthermore, the crystal lens 170 may also have a non-focusing area 171 formed by the area of ​​the surface curvature being less than that of the periphery.

[0196] Furthermore, the crystal lens 170 may also have a non-focusing area 172 formed by a flat surface area.

[0197] Furthermore, the crystal lens (crystal lens 173) may also have a peripheral portion whose thickness can be adjusted according to the incident direction of the incident light. In this way, the focusing range of the incident light can be adjusted.

[0198] Furthermore, the plurality of pixels 100 can also be configured as 4 pixels 100 in 2 columns and 2 rows.

[0199] Furthermore, multiple pixels 100 can also be two adjacent pixels 100.

[0200] Furthermore, in the plurality of pixels 100, two adjacent pixels 100 can also generate an image signal from a plurality of phase difference signals used for pupil segmentation of the subject and detection of image plane phase difference. In this way, the focal position of the subject can be detected.

[0201] Furthermore, the crystal lens (crystal lens 174) may also have a non-focusing area 175 formed by a groove-shaped recess formed in a direction orthogonal to the direction of pupil division.

[0202] Alternatively, it may also include: a pixel region 3, which has: a plurality of pixel blocks 20, each having a plurality of pixels 100 and a crystal lens 170 commonly disposed on the plurality of pixels 100; and the pixel blocks 20 are provided with color filters 150 that transmit incident light of the same wavelength on their own plurality of pixels 100.

[0203] Furthermore, pixel region 3 may also include a plurality of pixels 100 and a second crystalline lens 179 commonly disposed in the plurality of pixels 100 to focus the incident light, and further include a second pixel block 30 disposed in the plurality of pixels 100 to transmit incident light of the same wavelength. In this way, the focusing range of the incident light can be adjusted according to the type of color filter 150.

[0204] Furthermore, the second pixel block 30 can also generate an image signal from two adjacent pixels 100 of its plurality of pixels 100, which are used to segment the subject with the pupil and detect the phase difference of the image plane.

[0205] Furthermore, the second pixel block 30 may also be configured with a color filter 150 that transmits green light among its plurality of pixels 100. In this way, the focusing range of the incident light can be narrowed in the pixel that detects the phase difference signal.

[0206] Furthermore, the second pixel block 30 may also be configured with a color filter 150 that transmits long-wavelength light among its plurality of pixels 100. This simplifies the configuration of the second pixel block 30 with the color filter 150 that transmits long-wavelength light.

[0207] Furthermore, pixel region 3 can also have a second pixel block 30 in the center and a pixel block 20 in the periphery. In this way, the light-gathering range can be adjusted to correspond to the incident angle of the incident light.

[0208] Furthermore, in pixel region 3, a crystal lens 170 can be configured in each pixel block 20 according to the incident angle of the incident light. In this way, the light can be adjusted to a focusing position corresponding to the incident angle of the incident light.

[0209] The electronic device includes: a plurality of pixels 100, which perform photoelectric conversion of incident light from the subject and generate an image signal; a crystal lens 170, which is commonly disposed among the plurality of pixels 100, having a non-focusing area in the center and focusing the incident light onto the plurality of pixels 100 in the peripheral area; and a line signal processing circuit 5, which processes the generated image signal. This expands the focusing range of the incident light.

[0210] Furthermore, the effects described in this instruction manual are for illustrative purposes only and are not intended to limit the effects; other effects may also be described.

[0211] Alternatively, this technology can also be configured as follows. (1) A camera device, comprising: A plurality of pixels, which perform photoelectric conversion of incident light from the subject and generate an image signal; and A crystal-borne lens is commonly disposed on the plurality of pixels, having a non-focusing area in the center and focusing the incident light onto the plurality of pixels in the peripheral area. (2) As described in (1) above, the crystal lens has a non-focusing area formed by a recess. (3) As described in (2) above, the crystal lens has a recessed portion for adjusting the opening according to the incident angle of the incident light. (4) As described in the imaging device (3) above, the crystal lens has a recess that adjusts the size of the opening according to the incident angle of the incident light. (5) As described in the imaging device (3) above, the crystal lens has a recess that adjusts the position of the opening according to the incident angle of the incident light. (6) The imaging device of any of (1) to (5) above, wherein the crystal lens has a non-focusing area formed by the area of ​​the surface curvature being less than that of the peripheral portion. (7) The imaging device of any of (1) to (5) above, wherein the crystal lens has a non-focusing area formed by a region with a flat surface. (8) The imaging device of any of (1) to (7) above, wherein the crystal lens has a peripheral portion whose thickness is adjusted according to the incident direction of the incident light. (9) The imaging device is any of (1) to (8) above, wherein the plurality of pixels are configured as 4 pixels in 2 columns and 2 rows. (10) The imaging device is any of (1) to (8) above, wherein the plurality of pixels are two adjacent pixels. (11) In any of the above (1) to (10) imaging devices, two adjacent pixels among the plurality of pixels are used to divide the pupil of the subject and detect a plurality of phase difference signals of the image plane phase difference as the image signal. (12) As described in the imaging device (11) above, the crystal lens has a non-focusing area formed by a groove-shaped recess formed in a direction orthogonal to the direction of the pupil division. (13) The camera device, such as any one of (1) to (12) above, has the following features: A pixel region having: a plurality of pixel blocks, each having the plurality of pixels and the aforementioned crystal lens commonly disposed in the plurality of pixels; and The aforementioned pixel block has a color filter through which incident light of the same wavelength passes through its plurality of pixels. (14) As described in the imaging device (13) above, the pixel region further includes: a second pixel block having the plurality of pixels and a second crystal lens commonly disposed in the plurality of pixels to focus the incident light, and a color filter that transmits incident light of the same wavelength is disposed in the plurality of pixels. (15) As described in the camera device (14) above, the second pixel block is generated by using two adjacent pixels from its plurality of pixels to divide the pupil of the subject and detect the phase difference of the image plane as a plurality of phase difference signals, which are then used to generate the image signal. (16) As described in the camera device (15) above, the second pixel block has a color filter that transmits green light through its plurality of pixels. (17) As in the camera device described in (13) or (15) above, the second pixel block is configured with a color filter that transmits long wavelength light through its plurality of pixels. (18) The camera device, such as any one of (14) to (17) above, wherein the second pixel block is arranged in the central part of the pixel area and the pixel block is arranged in the peripheral part. (19) The imaging device, such as any of (13) to (18) above, wherein the aforementioned pixel region is configured with the aforementioned crystal lens in each of the aforementioned pixel blocks according to the incident angle of the incident light. (20) The camera device described in (13) above includes a pixel unit consisting of a plurality of pixel blocks having a color filter that transmits incident light of the same wavelength. (twenty one) As described in the imaging device (20) above, the pixel region includes: the pixel unit, which arranges the non-focusing area of ​​the crystal lens of each of the pixel blocks at a position offset in a direction along the outer side of its own pixel unit. (twenty two) As in the camera device described in (20) above, wherein The aforementioned pixel region comprises a plurality of the aforementioned pixel units, each configured with a color filter that transmits incident light of different wavelengths; At least one of the plurality of pixel units configured to transmit incident light of different wavelengths has a crystal lens having a non-focusing region disposed at a position offset in a direction along the inner side of the pixel unit itself. (twenty three) As described in the camera device (13) above, the pixel region is configured such that a plurality of the pixel blocks are arranged in the column direction and the pixel blocks are offset by the pixel amount in each column. The pixel block has: 2 of the pixels, each having the color filter that is adjacent in the column direction and transmits incident light of the same wavelength; and the crystal lens, which is commonly arranged in the pixel. (twenty four) As described in the imaging device (23) above, the pixel region is composed of a plurality of pixel groups arranged in the column direction. The pixel group is composed of two pixel blocks adjacent in the column direction that have color filters that transmit incident light of the same wavelength, namely a multi-pixel section, and a pixel block adjacent in the column direction that has color filters that transmit incident light of a different wavelength from the color filters of the multi-pixel section, namely a single-pixel section. (25) The camera device described above (24) includes: the single pixel unit, which includes: the crystal lens, which includes a non-focusing area of ​​a different size than the non-focusing area of ​​the crystal lens of each of the multi-pixel units. (26) The camera device described above (24) includes the following: the multi-pixel unit is composed of the pixel blocks respectively equipped with the crystal lens, and the crystal lens is configured as a non-focusing area of ​​different sizes. (27) The camera device described in (1) above further includes: The beam-splitting elements are commonly arranged in the aforementioned plurality of pixels, and split the incident light within a specific wavelength range; and The aforementioned crystal-borne lens has a groove-shaped recessed area that is substantially parallel to the direction of beam splitting, which is the aforementioned non-focusing region. (28) An electronic machine having: Multiple pixels perform photoelectric conversion of incident light from the subject and generate an image signal; A crystal-borne lens, which is commonly disposed on the plurality of pixels and has a non-focusing area in the center, and focuses the incident light onto the plurality of pixels in the peripheral area; and The processing circuit processes the image signal generated above.

[0212] 1: Camera device 3: Pixel area 4: Vertical drive circuit 5: Horizontal signal processing circuit 6: Horizontal drive circuit 7: Output Circuit 8: Control Circuit 9: Vertical signal line 10: Horizontal signal line 11:Substrate 12: Input / output terminals 13: Pixel driver wiring 20: pixel block 20a: Pixel Block 20b: pixel block 20c: pixel block 30: Pixel 2 block 40: pixel group 41: Multi-pixel section 42: Single pixel part 50: pixel unit 100 pixels 100a: pixels 100b: pixels 100c: pixels 100d: pixels 101: Photoelectric conversion element 120: Semiconductor substrate 121: Semiconductor Region 130: Insulating film 135: Separation section 136: Protective film 137: Separation section 138: Separation section 140: Wiring Area 141: Wiring 142: Plug 143: Insulation layer 150: Color Filter 159:Light-shielding film 160: Spectrometer 170: Crystal-borne lens 171: Non-focused area 172: Non-focused area 173: Crystal-borne lens 174: Crystal-borne lens 175: Non-focused area 176: Crystal-borne lens 177: Crystal-borne lens 178: Non-focused area 179: Second crystal carrier lens 180: Crystal-borne lens 181: Non-focused area 182:convex part 183: Crystal-borne lens 184: Non-focused area 189: Crystal-borne lens 300: Pixel block area 310: Focusing range 320: Focusing range 400: Material film 401: Inhibitor 402: Opening 403: Opening 701: Camera device 702: Photographic Lens 703: Camera Components 704:DSP 705: Display device 706: Operating System 707: Busbar 708: Memory 709: Memory Device 710: Power System 11000: Endoscopic Surgical System 11100: Endoscopy 11101: Lens tube 11102: Camera head 11110: Other surgical tools 11111: Pneumoperitoneum tube 11112: Energy Disposal Equipment 11120: Support arm device 11131: Surgeon 11132: Patient 11133: Patient bed 11200: Car 11201:CCU 11202: Display device 11203: Light source device 11204: Input device 11205: Handling Equipment Control Device 11206: Pneumoperitoneum device 11207: Recorder 11208: Printer 11400: Transmission cable 11401: Lens Unit 11402: Camera Department 11403: Drive Unit 11404: Ministry of Communications 11405: Camera head control unit 11411: Ministry of Communications 11412: Image Processing Department 11413: Control Department 12000: Vehicle Control System 12001: Communication Networks 12010: Drive system control unit 12020: Body System Control Unit 12030: Exterior Information Detection Unit 12031: Camera Department 12040: In-vehicle information detection unit 12041: Driver Status Monitoring Department 12050: Integrated Control Unit 12051: Microcomputer 12052: Audio and Image Output Unit 12053: In-vehicle network I / F 12061: Audio speaker 12062: Display Unit 12063: Dashboard 12100: Vehicles 12101~12105: Camera Department 12111~12114: Shooting range B: Blue G: Green R: Red

Claims

1. An imaging device comprising: a plurality of pixels, which perform photoelectric conversion of incident light from a subject to generate an image signal; and a crystal lens, which is commonly disposed in the plurality of pixels, having a non-focusing region in the center and focusing the incident light onto the plurality of pixels in the peripheral region; wherein two adjacent pixels in the plurality of pixels generate a plurality of phase difference signals that divide the pupil of the subject for detecting the phase difference of the image plane, and serve as the image signal; the crystal lens having the non-focusing region being formed by a groove-shaped recess formed in a direction orthogonal to the direction of pupil division.

2. The imaging device of claim 1, wherein the aforementioned crystal lens has the aforementioned non-focusing area formed by a recess.

3. The imaging device of claim 2, wherein the crystal lens has the recessed portion that adjusts the opening according to the incident angle of the incident light.

4. The imaging device of claim 3, wherein the crystal lens has a recess that adjusts the size of the opening according to the incident angle of the incident light.

5. The imaging device of claim 3, wherein the crystal lens has the recessed portion that adjusts the position of the opening according to the incident angle of the incident light.

6. The imaging device of claim 1, wherein the crystal lens has a non-focusing area consisting of a region whose surface curvature is less than that of the peripheral portion.

7. The imaging device of claim 1, wherein the aforementioned crystal lens has a non-focusing area consisting of a region with a flat surface.

8. The imaging device of claim 1, wherein the crystal lens has a peripheral portion whose thickness is adjusted according to the incident direction of the incident light.

9. The camera device of claim 1, wherein the plurality of pixels are configured as 4 pixels in 2 columns and 2 rows.

10. The camera device of claim 1, wherein the plurality of pixels are two adjacent pixels.

11. The imaging device of claim 1, comprising: a pixel region having a plurality of pixel blocks, the plurality of pixel blocks having the plurality of pixels and the aforementioned crystal lens commonly disposed on the plurality of pixels; and the pixel blocks having color filters that transmit incident light of the same wavelength disposed on their respective plurality of pixels.

12. The imaging device of claim 11, wherein the pixel region further comprises: a second pixel block having the plurality of pixels and a second crystal lens commonly disposed in the plurality of pixels and concentrating the incident light, and a color filter that transmits incident light of the same wavelength is disposed in the plurality of pixels.

13. The imaging device of claim 12, wherein the second pixel block is composed of two adjacent pixels among its plurality of pixels generating a plurality of phase difference signals that divide the pupil of the subject and are used to detect the phase difference of the image plane, as the image signal.

14. The camera device of claim 13, wherein the second pixel block transmits the color filter of green light through its plurality of pixels.

15. The camera device of claim 12, wherein the second pixel block is configured to transmit long-wavelength light through the color filter in the plurality of pixels thereof.

16. The camera device of claim 12, wherein the second pixel block is disposed in the central part of the pixel region and the pixel block is disposed in the peripheral part.

17. The imaging apparatus of claim 11, wherein the aforementioned pixel region is offset and configured with the crystal lens for each of the aforementioned pixel blocks according to the incident angle of the incident light.

18. The imaging apparatus of claim 11, wherein the pixel region has a pixel unit, the pixel unit being composed of a plurality of the aforementioned pixel blocks having a color filter that transmits incident light of the same wavelength.

19. The imaging device of claim 18, wherein the pixel region comprises: the pixel unit which positions the non-focusing region of the crystal lens of each of the pixel blocks at a position offset in a direction outward from the pixel unit itself.

20. The imaging apparatus of claim 18, wherein the pixel region comprises a plurality of pixel units for configuring color filters that transmit incident light of different wavelengths; at least one of the plurality of pixel units for configuring color filters that transmit incident light of different wavelengths comprises a crystal lens that positions the non-focusing region at a position offset in a direction along the inside of its own pixel unit.

21. The imaging apparatus of claim 11, wherein the pixel region is provided for a plurality of the pixel blocks arranged in the column direction, and the pixel blocks are arranged offset from the pixel amount in each column, the pixel block comprising: 2 of the pixels having the color filters that are adjacent in the column direction and transmit incident light of the same wavelength; and the crystal lens, which is commonly arranged in the pixel.

22. The imaging apparatus of claim 21, wherein the pixel region is provided for a plurality of pixel groups arranged in the column direction, the pixel group comprising: two pixel blocks adjacent in the column direction having the color filter that transmits incident light of the same wavelength, i.e., a multi-pixel portion, and a pixel block adjacent in the column direction having the color filter that transmits incident light of a different wavelength from the color filter of the multi-pixel portion, i.e., a single-pixel portion.

23. The imaging device of claim 22, wherein the pixel group comprises: the single pixel portion comprising: the crystal lens comprising a non-focusing area of ​​a different size from the non-focusing area of ​​the crystal lens of each of the multi-pixel portions.

24. The imaging apparatus of claim 22, wherein the pixel group includes the multi-pixel portion, the multi-pixel portion being composed of the pixel blocks each having the aforementioned crystal lens, the crystal lens having the aforementioned non-focusing area configured in different sizes.

25. The imaging device of claim 1 further comprises: a beam-splitting element, which is commonly disposed in the plurality of pixels and splits the incident light in a specific wavelength range; and the crystal lens having a non-focusing region with a groove-shaped recess that is substantially parallel to the direction of beam splitting.

26. An electronic device comprising: a plurality of pixels, which perform photoelectric conversion of incident light from a subject to generate an image signal; a lens commonly disposed on the plurality of pixels and having a non-focusing region in the center and focusing the incident light onto the plurality of pixels in the peripheral region; and a processing circuit that processes the generated image signal; wherein two adjacent pixels among the plurality of pixels generate a plurality of phase difference signals that divide the pupil of the subject for detecting the phase difference of the image plane, and these signals serve as the image signal; the lens comprising the non-focusing region, the non-focusing region being formed by a groove-shaped recess formed in a direction orthogonal to the direction of pupil division.

Images