Imaging apparatus

Abstract

To provide an imaging apparatus capable of achieving a suitable subpixel structure.SOLUTION: The imaging apparatus according to the present disclosure has a plurality of pixel units. Each of the plurality of pixel units has a plurality of first pixels and a plurality of second pixels. Each of the plurality of first pixels includes a color filter region having a first area, and each of the plurality of second pixels includes a color filter region having a second area smaller than the first area. At least one pixel unit among the plurality of pixel units has the plurality of first pixels including at least one clear pixel and the plurality of second pixels not including the clear pixel.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present disclosure relates to an imaging device. [Background technology]

[0002] In a solid-state imaging device having a sub-pixel structure, the pixel array is composed of a main pixel including a large-area color filter and a sub-pixel including a small-area color filter. In this case, the main pixel is used in the case of low illuminance, and the sub-pixel is used in the case of high illuminance, so that it is possible to capture suitable images under various illuminances. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2015-065270 A Summary of the Invention [Problem to be solved by the invention]

[0004] When capturing an image under low illumination, it is desirable to be able to detect light with high sensitivity. Therefore, when adopting a sub-pixel structure, it is desirable for the main pixel used under low illumination to be able to detect light with high sensitivity.

[0005] High-sensitivity light detection can be achieved by using clear pixels such as W pixels (white pixels), etc. However, when using clear pixels, there is a problem that color reproducibility is poorer than when using RGB pixels (red pixels, green pixels, blue pixels), etc.

[0006] In this way, when a sub-pixel structure is adopted, it is desirable to increase the sensitivity of the main pixel, and so the problem arises as to how to set the structure of the main pixel and the sub-pixel.

[0007] Therefore, the present disclosure provides an imaging device capable of realizing a suitable sub-pixel structure. [Means for solving the problem]

[0008] The imaging device according to a first aspect of the present disclosure is an imaging device including a plurality of pixel units, each of the plurality of pixel units including a plurality of first pixels and a plurality of second pixels, each of the plurality of first pixels including a color filter region having a first area, each of the plurality of second pixels including a color filter region having a second area smaller than the first area, and at least one pixel unit among the plurality of pixel units including the plurality of first pixels including at least one clear pixel and the plurality of second pixels including no clear pixel. This makes it possible to realize a suitable subpixel structure including a clear pixel by suppressing the disadvantage of the clear pixel from being extended to the second pixel while enjoying the advantages of the clear pixel in the first pixel. For example, it is possible to improve the color reproducibility of the second pixel while improving the sensitivity of the first pixel.

[0009] In addition, in this first aspect, the color filter region included in the clear pixel may be a region including a white color filter or a region including no color filter, and the color filter region included in the pixel other than the clear pixel may be a region including a color filter of a color other than white. This makes it possible to realize the clear pixel using a color filter or without using a color filter, for example.

[0010] In addition, in the first aspect, the color filter region having the first area may have an octagonal shape in a plan view, and the color filter region having the second area may have a rectangular shape in a plan view, which makes it possible to arrange, for example, a large-area color filter region and a small-area color filter region without any gaps in a plan view.

[0011] In addition, in the first aspect, the at least one pixel unit may include, as the plurality of first pixels, at least one clear pixel, a pixel of a first color different from white, a pixel of white and a second color different from the first color, and a pixel of white, the first color, and a pixel of a third color different from the second color. This makes it possible to arrange, for example, a clear pixel as the first pixel, while arranging pixels of three colors other than white (for example, RGB pixels).

[0012] In the first aspect, the at least one pixel unit may include, as the plurality of second pixels, a pixel of the first color, a pixel of the second color, and a pixel of the third color, which makes it possible to arrange, for example, pixels of three colors other than white (for example, RGB pixels) as the second pixels.

[0013] In addition, in the first aspect, the at least one pixel unit may include, as the plurality of first pixels, at least two clear pixels, a pixel of a first color different from white, and a pixel of a second color different from white and the first color, whereby, for example, the first color and the second color can be detected by pixels other than the clear pixels, and a third color can be detected based on the detection results of the clear pixels and the pixels other than the clear pixels.

[0014] In addition, in the first aspect, the at least one pixel unit may include, as the plurality of second pixels, a pixel of the first color, a pixel of the second color, and a pixel of a third color different from white, the first color, and the second color, thereby making it possible to arrange, for example, pixels of three colors other than white (for example, RGB pixels) as the second pixels.

[0015] In the first aspect, in the at least one pixel unit, each of the second pixels may include a polarizing filter or a neutral density filter, which makes it possible to detect flare using the second pixel including the polarizing filter or to reduce the sensitivity of the second pixel including the neutral density filter, for example.

[0016] In the first aspect, in the at least one pixel unit, each of the first pixels may not include a polarizing filter and a neutral density filter, which makes it possible, for example, to use the first pixel favorably for low illuminance, detect flare using a second pixel including a polarizing filter, or to make the sensitivity of the second pixel including a neutral density filter lower than that of the first pixel.

[0017] In addition, in the first aspect, the at least one pixel unit may include, as the plurality of second pixels, a pixel including a polarizing filter that transmits polarized light oscillating in a first direction, and a pixel including a polarizing filter that transmits polarized light oscillating in a second direction different from the first direction, thereby making it possible to determine the direction of a flare in two directions, for example.

[0018] In the first aspect, the second direction may differ from the first direction by 90 degrees, which makes it possible to determine the direction of a flare in a 0 degree direction and a 90 degree direction, for example.

[0019] In addition, in the first aspect, the at least one pixel unit may further include, as the plurality of second pixels, a pixel including a polarizing filter that transmits polarized light oscillating in a third direction different from the first and second directions, and a pixel including a polarizing filter that transmits polarized light oscillating in a fourth direction different from the first, second, and third directions, thereby making it possible to determine the direction of a flare in four directions, for example.

[0020] In the first aspect, each of the third and fourth directions may differ from each of the first and second directions by 45 degrees, making it possible to determine the direction of the flare at, for example, a 0 degree direction, a 45 degree direction, a 90 degree direction, and a 135 degree direction.

[0021] In addition, in this first aspect, the plurality of pixel units may include, as the plurality of second pixels, a pixel including a polarizing filter that transmits polarized light oscillating in a first direction, and a pixel including a polarizing filter that transmits polarized light oscillating in a second direction different from the first direction. This makes it possible to determine the direction of a flare in two directions, for example, by using two or more pixel units.

[0022] In addition, in this first aspect, the plurality of pixel units may further include, as the plurality of second pixels, a pixel including a polarizing filter that transmits polarized light vibrating in a third direction different from the first and second directions, and a pixel including a polarizing filter that transmits polarized light vibrating in a fourth direction different from the first, second, and third directions. This makes it possible to determine the direction of a flare in four directions, for example, using two or more pixel units.

[0023] In the first aspect, in the plurality of pixel units, each of the plurality of second pixels may include a polarizing filter that transmits polarized light vibrating in a first direction, thereby making it possible to reduce the influence of reflection from water, for example.

[0024] The imaging device according to the first aspect may further include a first calculation unit that calculates the luminance of light incident on each pixel unit for a plurality of colors based on the luminance detected by the plurality of first pixels of each pixel unit, and a second calculation unit that calculates the luminance of light incident on each pixel unit for a plurality of colors based on the luminance detected by the plurality of second pixels of each pixel unit, thereby making it possible to obtain the luminance of various colors by calculation, for example.

[0025] In addition, in this first aspect, the first calculation unit may calculate a luminance of a first color different from white, a luminance of a second color different from white and the first color, and a luminance of a third color different from white, the first color, and the second color, based on the luminance detected by the clear pixel. This makes it possible to calculate the luminance of three colors other than white (e.g., RGB) based on the detection result of the luminance by the clear pixel, for example.

[0026] An imaging device according to a second aspect of the present disclosure is an imaging device including a plurality of pixel units, each of the plurality of pixel units including a plurality of first pixels and a plurality of second pixels, each of the plurality of first pixels including a color filter region having a first area, each of the plurality of second pixels including a color filter region having a second area smaller than the first area, and in at least one pixel unit among the plurality of pixel units, each of the plurality of second pixels includes a polarizing filter or a neutral density filter, and each of the plurality of first pixels does not include a polarizing filter or a neutral density filter. This makes it possible to realize a suitable subpixel structure including a polarizing filter (neutral density filter) by, for example, enjoying the advantages of a polarizing filter (neutral density filter) in the second pixel and suppressing the disadvantages of the polarizing filter (neutral density filter) from affecting the first pixel. For example, it is possible to detect flare by the second pixel including a polarizing filter while using the first pixel appropriately for low illuminance, or to make the sensitivity of the second pixel including a neutral density filter lower than that of the first pixel.

[0027] In the second aspect, the at least one pixel unit may include the first pixels including at least one clear pixel, and the second pixels including no clear pixel, thereby making it possible to improve the color reproducibility of the second pixel while improving the sensitivity of the first pixel, for example.

[0028] In addition, in this second aspect, the color filter region included in the clear pixel may be a region including a white color filter or a region including no color filter, and the color filter region included in the pixel other than the clear pixel may be a region including a color filter of a color other than white. This makes it possible to realize the clear pixel using a color filter or without using a color filter, for example.

[0029] An imaging device according to a third aspect of the present disclosure is an imaging device including a plurality of pixel units, each of which includes a plurality of first pixels and a plurality of second pixels, each of which includes a color filter region having a first area, and in each of the plurality of pixel units, the number of the plurality of first pixels is greater than the number of the plurality of second pixels, and at least one pixel unit among the plurality of pixel units includes the plurality of first pixels including at least one clear pixel and the plurality of second pixels not including a clear pixel. This makes it possible to realize a suitable subpixel structure including a clear pixel by suppressing the disadvantage of the clear pixel from being extended to the second pixel while enjoying the advantages of the clear pixel in the first pixel. For example, it is possible to improve the sensitivity of the first pixel while improving the color reproducibility of the second pixel. In addition, according to the imaging device according to the third aspect, it is possible to realize the same effect as the imaging device according to the first aspect while making the area of ​​the first pixel the same as the area of ​​the second pixel.

[0030] In addition, in the third aspect, in each of the plurality of pixel units, the number of the plurality of first pixels may be N times the number of the plurality of second pixels (N is an integer equal to or greater than 2), and the at least one pixel unit may include the plurality of first pixels including at least N clear pixels, and the plurality of second pixels including no clear pixels. This makes it possible to treat the N first pixels and one second pixel as one first pixel including one color filter with a large area and one second pixel including one color filter with a small area, respectively.

[0031] In the third aspect, in the at least one pixel unit, each of the second pixels may include a polarizing filter or a neutral density filter, which makes it possible to detect flare using the second pixel including the polarizing filter or to reduce the sensitivity of the second pixel including the neutral density filter, for example.

[0032] In the third aspect, in the at least one pixel unit, each of the first pixels may not include a polarizing filter and a neutral density filter, which makes it possible, for example, to use the first pixel favorably for low illuminance, detect flare using a second pixel including a polarizing filter, or to make the sensitivity of the second pixel including a neutral density filter lower than that of the first pixel. [Brief description of the drawings]

[0033] [Figure 1] 1 is a block diagram showing a configuration of a solid-state imaging device according to a first embodiment. [Diagram 2] 1 is a cross-sectional view showing a structure of a solid-state imaging device according to a first embodiment. [Diagram 3] FIG. 1 is a plan view showing a structure of a solid-state imaging device according to a first embodiment. [Figure 4] 1 is a circuit diagram showing an example of a circuit configuration of a solid-state imaging device according to a first embodiment. [Diagram 5] 4 is a circuit diagram showing another example of the circuit configuration of the solid-state imaging device according to the first embodiment. FIG. [Figure 6] FIG. 1 is a plan view showing a structure of a solid-state imaging device according to a first embodiment. [Figure 7] FIG. 2 is a plan view for comparing the solid-state imaging device of the first embodiment with solid-state imaging devices of first and second comparative examples. [Figure 8] FIG. 2 is a plan view showing the structures of solid-state imaging devices according to first to fourth modified examples of the first embodiment. [Figure 9] 4 is a table for explaining advantages of the solid-state imaging device according to the first embodiment. [Figure 10]FIG. 13 is a plan view showing the structure of a solid-state imaging device according to a fifth modified example of the first embodiment. [Figure 11] FIG. 11 is a plan view showing the structure of a solid-state imaging device according to a second embodiment. [Figure 12] FIG. 11 is a cross-sectional view showing the structure of a solid-state imaging device according to a second embodiment. [Figure 13] FIG. 11 is a cross-sectional view showing the structure of a solid-state imaging device according to a first modified example of the second embodiment. [Figure 14] FIG. 11 is a cross-sectional view showing the structure of a solid-state imaging device according to a second modified example of the second embodiment. [Figure 15] FIG. 11 is a cross-sectional view showing the structure of a solid-state imaging device according to a third modified example of the second embodiment. [Figure 16] 13 is a table for explaining the operation of the solid-state imaging device according to the third embodiment. [Figure 17] 13 is another table for explaining the operation of the solid-state imaging device according to the third embodiment. [Figure 18] FIG. 1 is a block diagram showing an example of the configuration of an electronic device. [Figure 19] FIG. 1 is a block diagram showing a configuration example of a mobile object control system. [Figure 20] 20 is a plan view showing a specific example of the setting position of the imaging unit in FIG. 19. [Figure 21] 1 is a diagram illustrating an example of a schematic configuration of an endoscopic surgery system. [Figure 22] 2 is a block diagram showing an example of a functional configuration of a camera head and a CCU. FIG. [Figure 23] 13A to 13C are plan views showing three examples of the structure of a solid-state imaging device according to a fourth embodiment. [Figure 24] 13A to 13C are plan views showing three examples of the structure of a solid-state imaging device according to a fifth embodiment. [Diagram 25] FIG. 13 is a cross-sectional view showing the structure of a solid-state imaging device according to a fifth embodiment. [Figure 26] FIG. 13 is a plan view showing the structure of a solid-state imaging device according to a sixth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0034] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings.

[0035] (First embodiment) FIG. 1 is a block diagram showing the configuration of a solid-state imaging device according to the first embodiment.

[0036] The solid-state imaging device in Fig. 1 is a CMOS (Complementary Metal Oxide Semiconductor) type image sensor (CIS) and includes a pixel array 2 including a plurality of pixels 1, a control circuit 3, a vertical drive circuit 4, a plurality of column signal processing circuits 5, a horizontal drive circuit 6, an output circuit 7, a plurality of vertical signal lines (VSL) 8, and a horizontal signal line (HSL) 9. The solid-state imaging device in Fig. 1 is an example of an imaging device of the present disclosure.

[0037] Each pixel 1 includes a photodiode that functions as a photoelectric conversion unit and a MOS transistor that functions as a pixel transistor. The pixel transistor may be, for example, a transfer transistor, a reset transistor, an amplification transistor, a selection transistor, or the like. These pixel transistors may be shared by several pixels 1. Each pixel 1 may further include a floating diffusion unit, a pixel memory, or the like.

[0038] The pixel array 2 includes a plurality of pixels 1 arranged in a two-dimensional array. The pixel array 2 also includes an effective pixel region that receives light, performs photoelectric conversion, and outputs a signal charge generated by the photoelectric conversion, and a black reference pixel region that outputs optical black that serves as a reference for the black level. In general, the black reference pixel region is arranged on the periphery of the effective pixel region.

[0039] The control circuit 3 generates various signals that serve as references for the operation of the vertical drive circuit 4, the column signal processing circuit 5, the horizontal drive circuit 6, etc., based on a vertical synchronization signal, a horizontal synchronization signal, a master clock, etc. The signals generated by the control circuit 3 are, for example, clock signals and control signals, and are input to the vertical drive circuit 4, the column signal processing circuit 5, the horizontal drive circuit 6, etc.

[0040] The vertical drive circuit 4 includes, for example, a shift register, and vertically scans each pixel 1 in the pixel array 2 on a row-by-row basis. The vertical drive circuit 4 further supplies a pixel signal based on the signal charge generated by each pixel 1 to a column signal processing circuit 5 through a vertical signal line 8. The column signal processing circuit 5 is arranged, for example, for each column of pixels 1 in the pixel array 2, and performs signal processing for each column of signals output from one row of pixels 1 based on signals from the black reference pixel region. Examples of this signal processing include noise removal and signal amplification.

[0041] The horizontal drive circuit 6 includes, for example, a shift register, and supplies pixel signals from each column signal processing circuit 5 to a horizontal signal line 9 .

[0042] The output circuit 7 processes signals supplied from each column signal processing circuit 5 through a horizontal signal line 9, and outputs the processed signals.

[0043] FIG. 2 is a cross-sectional view showing the structure of the solid-state imaging device of the first embodiment.

[0044] Fig. 2 shows vertical cross sections of five pixels 1 in the pixel array 2 shown in Fig. 1. As shown in Fig. 2, the pixels 1 in the pixel array 2 of this embodiment include a plurality of main pixels 1a and a plurality of sub-pixels 1b. The main pixel 1a is an example of a first pixel of the present disclosure. The sub-pixel 1b is an example of a second pixel of the present disclosure. Details of the main pixel 1a and the sub-pixel 1b will be described later.

[0045] FIG. 2 shows X, Y, and Z axes that are perpendicular to each other. The X and Y directions correspond to the lateral (horizontal) direction, and the Z direction corresponds to the longitudinal (vertical) direction. The +Z direction corresponds to the upward direction, and the -Z direction corresponds to the downward direction. The -Z direction may or may not strictly coincide with the direction of gravity.

[0046] As shown in FIG. 2, the solid-state imaging device of this embodiment includes a substrate 11, an insulating film 12, a light-shielding layer 13, a color filter layer 14, a lens layer 15, a gate insulating film 21, a gate electrode 22, an interlayer insulating film 23, a wiring layer 24, a wiring layer 25, a wiring layer 26, and a substrate 27.

[0047] [Substrate 11] 2, the lower surface of the substrate 11 is the front surface of the substrate 11, and the upper surface of the substrate 11 is the back surface of the substrate 11. Since the solid-state imaging device of the present embodiment is a back-illuminated type, the back surface of the substrate 11 is the light incident surface (light receiving surface) of the substrate 11.

[0048] Each pixel 1 of this embodiment includes an n-type region 11a, a p-type region 11b, a p+-type region 11c, and a p+-type region 11d in a substrate 11. The p-type region 11b, the p+-type region 11c, and the p+-type region 11d are provided above, below, and to the side of the n-type region 11a, respectively. FIG. 2 shows a photodiode PD1 in each main pixel 1a and a photodiode PD2 in each sub-pixel 1b. In each main pixel 1a, the photodiode PD1 is formed by a pn junction between the n-type region 11a and the p-type region 11b, the p+-type region 11c, and the p+-type region 11d. This is also true for the photodiode PD2 in each sub-pixel 1b.

[0049] 2, the photodiode PD1 in each main pixel 1a and the photodiode PD2 in each sub-pixel 1b are formed to be the same size, but this is not limited thereto. For example, the photodiode PD1 in each main pixel 1a may be formed to be larger than the photodiode PD2 in each sub-pixel 1b.

[0050] [Insulating film 12 and light-shielding layer 13] The insulating film 12 and the light-shielding layer 13 are embedded in order in a trench T provided in the substrate 11. The trench T is formed on the back surface side of the substrate 11 and between adjacent pixels 1. The insulating film 12 and the light-shielding layer 13 function as a pixel separating portion that separates these pixels 1. The insulating film 12 is further formed on the back surface of the substrate 11 outside the trench T. The light-shielding layer 13 is further formed above the trench T outside the trench T.

[0051] The insulating film 12 is, for example, a silicon oxide film. At least a part of the insulating film 12 may be a fixed charge film having a negative fixed charge. The fixed charge film is, for example, an oxide film containing a metal element such as Hf (hafnium).

[0052] The light-shielding layer 13 is a layer that has a function of blocking light, and is, for example, a metal layer such as a W (tungsten) layer, an Al (aluminum) layer, or a Cu (copper) layer.

[0053] [Color filter layer 14] The color filter layer 14 is formed on the substrate 11 via an insulating film 12 and a light-shielding layer 13. The color filter layer 14 includes a color filter 14a in each main pixel 1a and a color filter 14b in each sub-pixel 1b. Each of the color filters 14a and 14b has a function of transmitting light of a predetermined wavelength. The region in which the color filter 14a is arranged is an example of a first color filter region of the present disclosure. The region in which the color filter 14b is arranged is an example of a second color filter region of the present disclosure.

[0054] For example, the red (R), green (G), and blue (B) main pixels 1a include red, green, and blue color filters 14a above the photodiode PD1, respectively. The main pixels 1a may include color filters 14a for other colors, such as yellow, magenta, or cyan color filters 14a. The same is true for the photodiode PD2 and color filter 14b in the subpixel 1b.

[0055] Moreover, the main pixel 1a of this embodiment includes a clear (C) pixel that corresponds to a white (W) pixel. The clear pixel includes a white color filter 14a above the photodiode PD1. On the other hand, the clear pixel does not need to include a color filter 14a above the photodiode PD1. This is because a pixel that detects white can be realized not only by a pixel that includes a white color filter 14a, but also by a pixel that does not include a color filter 14a. A region in the color filter layer 14 where the color filter 14a is not arranged is also an example of the first color filter region of the present disclosure.

[0056] In Fig. 2, the main pixel 1a includes a clear pixel, but the sub-pixel 1b does not include a clear pixel. Specifically, the three main pixels 1a shown in Fig. 2 include one G pixel and two C pixels, and the two sub-pixels 1b shown in Fig. 2 include two G pixels. Further details of the arrangement of the clear pixels will be described later with reference to Fig. 3.

[0057] In this embodiment, each color filter 14a has a large area in a plan view, and each color filter 14b has a small area in a plan view. The area of ​​each color filter 14a is an example of a first area in the present disclosure. The area of ​​each color filter 14b is an example of a second area in the present disclosure. Further details of the areas of these color filters 14a and 14b will also be described later with reference to FIG. 3.

[0058] In Fig. 2, the interface between each color filter 14b and the light-shielding layer 13 is a vertical surface, and the interface between each color filter 14a and the light-shielding layer 13 is an inclined surface. Therefore, the area of ​​the upper surface of each color filter 14b is the same as the area of ​​the lower surface of each color filter 14b, and the area of ​​the upper surface of each color filter 14a is larger than the area of ​​the lower surface of each color filter 14a. In Fig. 2, the area of ​​the color filters 14a, 14b in a plan view is determined by the area of ​​the upper surfaces of the color filters 14a, 14b.

[0059] [Lens layer 15] The lens layer 15 is formed on the color filter layer 14. The lens layer 15 includes a lens 15a in each main pixel 1a and a lens 15b in each sub-pixel 1b. The lenses 15a and 15b have, for example, a function of collecting incident light. In FIG. 2, the lens 15a is a convex lens, and the lens 15b is a flat lens. The lenses 15a and 15b are called on-chip lenses.

[0060] [Gate insulating film 21 and gate electrode 22] 2 shows a transfer transistor TG1 in each main pixel 1a and a transfer transistor TG2 in each sub-pixel 1b. The transfer transistor TG1 in each main pixel 1a includes a gate insulating film 21 and a gate electrode 22 formed in this order on the surface (lower surface) of the substrate 11. The gate insulating film 21 is, for example, a silicon oxide film. The gate electrode 22 is, for example, a polysilicon layer. The same applies to the transfer transistor TG2 in each sub-pixel 1b.

[0061] [Interlayer insulating film 23] The interlayer insulating film 23 is formed so as to cover the transfer transistors TG1 and TG2 on the surface of the substrate 11. The interlayer insulating film 23 includes a plurality of insulating films such as silicon oxide films.

[0062] [Wiring layer 24~26] The wiring layers 24-26 are provided in the interlayer insulating film 23 to form a multilayer wiring structure. The multilayer wiring structure of this embodiment includes three wiring layers 24-26, but may include four or more wiring layers. Each of the wiring layers 24-26 includes a plurality of wirings. Pixel transistors such as the transfer transistors TG1 and TG2 are driven using these wirings. The wiring layers 24-26 are, for example, metal layers such as a W layer, an Al layer, or a Cu layer.

[0063] [Substrate 27] Substrate 27 is provided on the surface of substrate 11 via interlayer insulating film 25. Substrate 27 in this embodiment is a support substrate provided to ensure the strength of substrate 11. Substrate 27 is, for example, a semiconductor substrate such as a silicon substrate.

[0064] In each main pixel 1a of this embodiment, light incident on the lens 15a passes through the color filter 14a, passes through an opening provided in the light-shielding layer 13, and is incident on the photodiode PD1. The photodiode PD1 converts the light into charges by photoelectric conversion to generate signal charges. The signal charges are output as pixel signals via the vertical signal lines 8 (FIG. 1) in the wiring layers 24-26. The same applies to each sub-pixel 1b of this embodiment.

[0065] FIG. 3 is a plan view showing the structure of the solid-state imaging device of the first embodiment.

[0066] FIG. 3A shows a cross section taken along line A-A' in FIG. 2. Meanwhile, FIG. 2 shows a vertical section taken along arrow A in FIG. 3A. FIG. 3A shows the shape of the upper surface of the color filter 14a in each main pixel 1a and the shape of the upper surface of the color filter 14b in each sub-pixel 1b. In this embodiment, the area of ​​the upper surface of each color filter 14a, i.e., the area of ​​the color filter 14a in a plan view, is large, and the area of ​​the upper surface of each color filter 14b, i.e., the area of ​​the color filter 14b in a plan view, is small. In this embodiment, the shape of the upper surface of each color filter 14a is octagonal, and the shape of the upper surface of each color filter 14b is rectangular.

[0067] Fig. 3A further illustrates the shapes of the main pixels 1a and the sub-pixels 1b with dashed lines. Here, the shape of each main pixel 1a corresponds to the shape of the area that each main pixel 1a occupies in the substrate 11. Similarly, the shape of each sub-pixel 1b corresponds to the shape of the area that each sub-pixel 1b occupies in the substrate 11. In Fig. 3A, the main pixels 1a and the sub-pixels 1b are rectangular with the same area.

[0068] 3A further shows the above-mentioned X-axis, Y-axis, and Z-axis, as well as X'-axis and Y'-axis. The X'-direction and Y'-direction correspond to the lateral direction (horizontal direction) like the X-direction and Y-direction. However, the X'-direction is inclined 45 degrees clockwise with respect to the X-direction, and the Y'-direction is inclined 45 degrees clockwise with respect to the Y-direction.

[0069] In the pixel array 2 of this embodiment, a plurality of pixels 1 are arranged in a two-dimensional array along the X and Y directions. Therefore, the pixels 1 closest to each pixel 1 are located in the ±X and ±Y directions of each pixel 1. Meanwhile, the main pixels 1a closest to each main pixel 1a are located in the ±X' and ±Y' directions of each main pixel 1a. Similarly, the sub-pixels 1b closest to each sub-pixel 1b are located in the ±X' and ±Y' directions of each sub-pixel 1b.

[0070] The pixel array 2 of this embodiment includes a plurality of pixel units U, each of which includes a plurality of main pixels 1a and a plurality of sub-pixels 1b. FIG. 3A shows one pixel unit U with a thick dashed line, and shows an area F occupied by the color filters 14a and 14b of the pixel 1 in this pixel unit U with a thick solid line. Each pixel unit U of this embodiment includes four main pixels 1a including one R pixel, one G pixel, one B pixel, and one C pixel, and four sub-pixels 1b including one R pixel, two G pixels, and one B pixel. Thus, each pixel unit U of this embodiment includes four main pixels 1a including a C pixel, and four sub-pixels 1b not including a C pixel. FIG. 3A shows the color filter 14a of the C pixel with dot hatching to make the position of the C pixel easier to understand. The R pixel, the G pixel, and the B pixel are examples of the first color, the second color, and the third color pixels in this disclosure. The pixel array 2 of the present embodiment includes a plurality of pixel units U arranged in a two-dimensional array, and these pixel units U are arranged periodically.

[0071] Fig. 3B shows a cross section taken along line B-B' in Fig. 2. Meanwhile, Fig. 2 shows a vertical section taken along arrow B in Fig. 3B. Fig. 3B shows the XY cross-sectional shape of the color filter 14a in each main pixel 1a and the XY cross-sectional shape of the color filter 14b in each sub-pixel 1b. In Fig. 3B, a light-shielding layer 13 is inserted between the color filters 14a and 14b.

[0072] 3C shows a cross section taken along line CC' in FIG. 2. Meanwhile, FIG. 2 shows a vertical section taken along arrow C in FIG. 3C. FIG. 3C shows the XY cross-sectional shapes of the photodiodes PD1, etc. in each main pixel 1a and the XY cross-sectional shapes of the photodiodes PD2, etc. in each sub-pixel 1b. As shown in FIG. 3C, the trench T of this embodiment has a mesh-like shape in plan view. An insulating film 12 and a light-shielding layer 13 are provided in order in the trench T.

[0073] 3A to 3C, each main pixel 1a is paired with a sub-pixel 1b adjacent to the main pixel 1a in the +X direction. Next, examples of the circuit configuration of each pair of the main pixel 1a and the sub-pixel 1b will be described with reference to FIGS. 4 and 5.

[0074] FIG. 4 is a circuit diagram showing an example of a circuit configuration of the solid-state imaging device according to the first embodiment.

[0075] Fig. 4A shows a circuit configuration of the main pixel 1a of this embodiment. The main pixel 1a in Fig. 4A includes a photodiode PD1, a floating diffusion region FD, a transfer transistor TG1, a reset transistor RST, an amplifier transistor AMP, and a selection transistor SEL.

[0076] The photodiode PD1 performs photoelectric conversion of incident light on the main pixel 1a. The anode of the photodiode PD1 is electrically connected to the ground voltage (GND), and the cathode of the photodiode PD1 is electrically connected to the transfer transistor TG1.

[0077] The transfer transistor TG1 transfers the charges generated by the photoelectric conversion to the floating diffusion FD. One of the source and drain of the transfer transistor TG1 is electrically connected to the photodiode PD1, and the other of the source and drain of the transfer transistor TG1 is electrically connected to the floating diffusion FD.

[0078] The floating diffusion portion FD accumulates the charge transferred by the transfer transistor TG1. The floating diffusion portion FD is electrically connected to the transfer transistor TG1, the reset transistor RST, and the amplification transistor AMP.

[0079] The reset transistor RST drains electric charges from the floating diffusion region FD and resets the potential of the floating diffusion region FD to a power supply voltage (VDD). One of the source and drain of the reset transistor RST is electrically connected to the floating diffusion region FD, and the other of the source and drain of the reset transistor RST is electrically connected to the power supply voltage.

[0080] The amplification transistor AMP receives the charge transferred to the floating diffusion FD at its gate and outputs the charge to the selection transistor SEL via a source follower. The gate of the amplification transistor AMP is electrically connected to the floating diffusion FD. One of the source and drain of the amplification transistor AMP is electrically connected to a power supply voltage, and the other of the source and drain of the amplification transistor AMP is electrically connected to the selection transistor SEL. The amplification transistor AMP converts the charge accumulated in the floating diffusion FD into a voltage signal and outputs it to the selection transistor SEL.

[0081] The selection transistor SEL can electrically connect the amplification transistor AMP and the vertical signal line (VSL) 8. When the selection transistor SEL is turned on, the amplification transistor AMP and the vertical signal line 8 are electrically connected. When the selection transistor SEL is turned off, the amplification transistor AMP and the vertical signal line 8 are electrically insulated from each other. One of the source and drain of the selection transistor SEL is electrically connected to the amplification transistor AMP, and the other of the source and drain of the selection transistor SEL is electrically connected to the vertical signal line 8.

[0082] Fig. 4B shows the circuit configuration of the sub-pixel 1b of this embodiment. The sub-pixel 1b of Fig. 4B is paired with the main pixel 1a of Fig. 4A. The sub-pixel 1b of Fig. 4B has a configuration in which the photodiode PD1 and the transfer transistor TG1 of the main pixel 1a of Fig. 4A are replaced with a photodiode PD2 and a transfer transistor TG2. The functions of the photodiode PD2 and the transfer transistor TG2 are similar to those of the photodiode PD1 and the transfer transistor TG1.

[0083] FIG. 5 is a circuit diagram showing another example of the circuit configuration of the solid-state imaging device according to the first embodiment.

[0084] Fig. 5 shows a circuit configuration of a pair of main pixel 1a and sub-pixel 1b in this embodiment. The main pixel 1a and sub-pixel 1b in Fig. 5 include a photodiode PD1, a photodiode PD2, floating diffusions FD1 and FD2, a pixel memory MEM, a transfer transistor TG1, a transfer transistor TG2, a transfer transistor TG3, a reset transistor RST, an amplification transistor AMP, and a selection transistor SEL. In this way, the main pixel 1a and sub-pixel 1b in Fig. 5 share the reset transistor RST, the amplification transistor AMP, the selection transistor SEL, etc. The circuit configuration in Fig. 5 will be described below.

[0085] The photodiode PD1 performs photoelectric conversion of light incident on the main pixel 1a. The anode of the photodiode PD1 is electrically connected to the ground voltage, and the cathode of the photodiode PD1 is electrically connected to the transfer transistor TG1.

[0086] The transfer transistor TG1 transfers the charges generated by the photoelectric conversion to the floating diffusion FD1. One of the source and drain of the transfer transistor TG1 is electrically connected to the photodiode PD1, and the other of the source and drain of the transfer transistor TG1 is electrically connected to the floating diffusion FD1.

[0087] The photodiode PD2 performs photoelectric conversion of light incident on the subpixel 1b. The anode of the photodiode PD2 is electrically connected to the ground voltage, and the cathode of the photodiode PD2 is electrically connected to the transfer transistor TG2.

[0088] The transfer transistor TG2 transfers the charges generated by the photoelectric conversion to the floating diffusion FD2 and the pixel memory MEM. One of the source and drain of the transfer transistor TG2 is electrically connected to the photodiode PD2, and the other of the source and drain of the transfer transistor TG2 is electrically connected to the floating diffusion FD2.

[0089] The floating diffusion FD2 accumulates the charges transferred by the transfer transistor TG2. The floating diffusion FD2 is electrically connected to the transfer transistor TG2, the transfer transistor TG3, and the pixel memory MEM.

[0090] The pixel memory MEM temporarily stores the charge transferred by the transfer transistor TG2. The pixel memory MEM is disposed between the floating diffusion portion FD2 and a power supply voltage. The pixel memory MEM may be a capacitor having a metal-insulator-metal (MIM) structure.

[0091] The transfer transistor TG3 transfers the charges stored in the floating diffusion FD2 and the pixel memory MEM to the floating diffusion FD1. One of the source and drain of the transfer transistor TG3 is electrically connected to the floating diffusion FD2, and the other of the source and drain of the transfer transistor TG3 is electrically connected to the floating diffusion FD1 and the reset transistor RST.

[0092] The floating diffusion portion FD1 accumulates the charges transferred by the transfer transistor TG1 and the charges transferred by the transfer transistor TG3. The floating diffusion portion FD1 is electrically connected to the transfer transistor TG1, the transfer transistor TG3, the reset transistor RST, and the amplification transistor AMP.

[0093] The functions and arrangement of the reset transistor RST, the amplification transistor AMP, and the selection transistor SEL are similar to those of the reset transistor RST, the amplification transistor AMP, and the selection transistor SEL shown in FIG. 4A or FIG. 4B.

[0094] FIG. 6 is a plan view showing the structure of the solid-state imaging device of the first embodiment.

[0095] Fig. 6 shows the shapes of the main pixel 1a, the sub-pixel 1b, the color filter 14a, and the color filter 14b in a plan view, similar to Fig. 3A. However, the pixel 1 shown in Fig. 6 is shown in a state where the pixel 1 shown in Fig. 3A is rotated 45 degrees counterclockwise. Fig. 6 further shows four pixel units U with thick dashed lines, and shows the areas F occupied by the color filters 14a and 14b of the pixel 1 in these pixel units U with thick solid lines. These pixel units U are periodically arranged in the X' direction and the Y' direction.

[0096] FIG. 7 is a plan view for comparing the solid-state imaging device of the first embodiment with solid-state imaging devices of first and second comparative examples.

[0097] 7A shows a solid-state imaging device of the first comparative example, specifically showing an area F occupied by color filters 14a and 14b in one pixel unit U. The pixel unit U of this comparative example includes one R pixel, two G pixels, and one B pixel as main pixels 1a, and one R pixel, two G pixels, and one B pixel as sub-pixels 1b. The pixel unit U of this comparative example is composed of four main pixels 1a that do not include a C pixel, and four sub-pixels 1b that do not include a C pixel.

[0098] Here, the problems of this comparative example will be described. In general, in a solid-state imaging device having a subpixel structure, a main pixel 1a is used in the case of low illumination, and a subpixel 1b is used in the case of high illumination, thereby making it possible to capture suitable images under various illuminations. When capturing an image under low illumination, it is desirable to be able to detect light with high sensitivity. Therefore, when adopting a subpixel structure as in this comparative example, it is desirable for the main pixel 1a used under low illumination to be able to detect light with high sensitivity. High-sensitivity light detection can be realized, for example, by using a C pixel. However, the pixel unit U of this comparative example does not include a C pixel as the main pixel 1a. Therefore, the pixel unit U of this comparative example cannot detect light with high sensitivity by the main pixel 1a.

[0099] 7B shows a solid-state imaging device of the second comparative example, specifically showing an area F occupied by color filters 14a and 14b in one pixel unit U. The pixel unit U of this comparative example includes one R pixel, one G pixel, one B pixel, and one C pixel as main pixels 1a, and one R pixel, one G pixel, one B pixel, and one C pixel as sub-pixels 1b. The pixel unit U of this comparative example is composed of four main pixels 1a including a C pixel, and four sub-pixels 1b including a C pixel.

[0100] Here, the problems of this comparative example will be described. The pixel unit U of this comparative example includes a C pixel as the main pixel 1a. Therefore, the pixel unit U of this comparative example can detect light with high sensitivity due to the C pixel of the main pixel 1a. On the other hand, the pixel unit U of this comparative example also includes a C pixel as the sub-pixel 1b used under high illuminance. In general, when a C pixel is used, color reproducibility is worse than when an RGB pixel or the like is used. The C pixel of the sub-pixel 1b of this comparative example does not contribute to the advantage of being able to detect light with high sensitivity under low illuminance, but brings about the disadvantage of worsening color reproducibility. Furthermore, the C pixel of the sub-pixel 1b of this comparative example is disadvantageous in terms of high luminance saturation.

[0101] 7C shows the solid-state imaging device of the first embodiment, specifically showing an area F occupied by color filters 14a and 14b in one pixel unit U. The pixel unit U of this embodiment includes one R pixel, one G pixel, one B pixel, and one C pixel as main pixels 1a, and one R pixel, two G pixels, and one B pixel as sub-pixels 1b. The pixel unit U of this embodiment is composed of four main pixels 1a including a C pixel, and four sub-pixels 1b not including a C pixel.

[0102] The pixel unit U of this embodiment includes a C pixel as the main pixel 1a. Therefore, the pixel unit U of this embodiment makes it possible to detect light with high sensitivity due to the C pixel of the main pixel 1a. Furthermore, the pixel unit U of this embodiment does not include a C pixel as the sub-pixel 1b. Therefore, the pixel unit U of this embodiment makes it possible to prevent the color reproducibility of the sub-pixel 1b from being deteriorated by the C pixel. In this way, according to this embodiment, it is possible to realize a suitable sub-pixel structure including a C pixel by preventing the disadvantages of the C pixel from affecting the sub-pixel 1b while enjoying the advantages of the C pixel in the main pixel 1a.

[0103] In general, the pixel unit U can detect various colors if it has one R pixel, one G pixel, and one B pixel. However, it is known that the human eye is more sensitive to green than to red and blue. Therefore, when the pixel unit U includes one R pixel, two G pixels, and one B pixel, the color reproducibility can be improved compared to when the pixel unit U includes only one R pixel, one G pixel, and one B pixel. Therefore, according to the pixel unit U of this embodiment, the sub-pixel 1b including one R pixel, two G pixels, and one B pixel can improve the color reproducibility of the sub-pixel 1b.

[0104] However, if the pixel unit U has one R pixel, one G pixel, and one B pixel, it is possible to ensure sufficient color reproducibility, although this is inferior to the case where the pixel unit U has one R pixel, two G pixels, and one B pixel. Therefore, according to the pixel unit U of this embodiment, the main pixel 1a including one R pixel, one G pixel, and one B pixel can ensure sufficient color reproducibility of the main pixel 1a.

[0105] The C pixel of this embodiment can be used, for example, when switching between a mode using the main pixel 1a and a mode using the sub-pixel 1b. For example, when the luminance detected by the C pixel is high, the illuminance is high, so the mode using the sub-pixel 1b is applied. On the other hand, when the luminance detected by the C pixel is low, the illuminance is low, so the mode using the main pixel 1a is applied. If the pixel unit U does not include the C pixel, such luminance must be calculated from the luminance detected by the R pixel, the luminance detected by the G pixel, and the luminance detected by the B pixel, which results in a calculation burden. According to this embodiment, such mode switching can be easily performed.

[0106] The solid-state imaging device of this embodiment is applicable to, for example, an in-vehicle camera that often captures bright and dark scenes. An example of a dark scene is a scene where a car enters a tunnel, and an example of a bright scene is a scene where a car exits a tunnel. In addition, for safety reasons, it is desirable for an in-vehicle camera to have good color reproducibility of traffic lights. Since traffic lights have high luminance, it is desirable to use the sub-pixel 1b for detecting traffic lights. According to this embodiment, in an in-vehicle camera or the like, it is possible to improve the sensitivity of the main pixel 1a while improving the color reproducibility of the sub-pixel 1b.

[0107] FIG. 8 is a plan view showing the structures of solid-state imaging devices according to first to fourth modified examples of the first embodiment.

[0108] 8A shows a solid-state imaging device of the first modification, specifically showing an area F occupied by color filters 14a and 14b in one pixel unit U. The pixel unit U of this modification includes one G pixel, one B pixel, and two C pixels as main pixels 1a, and one R pixel, two G pixels, and one B pixel as sub-pixels 1b. The pixel unit U of this modification is composed of four main pixels 1a including a C pixel, and four sub-pixels 1b not including a C pixel.

[0109] According to this modification, it is possible to realize a suitable sub-pixel structure including a C pixel by preventing the disadvantages of the C pixel from affecting the sub-pixel 1b while enjoying the advantages of the C pixel in the main pixel 1a, as in the first embodiment.

[0110] However, the main pixel 1a of the pixel unit U of this modification includes a G pixel and a B pixel, but does not include an R pixel. Therefore, when detecting the luminance of the R pixel using the main pixel 1a of this modification, the luminance of the R pixel is calculated from the luminance detected by the C pixel, the luminance detected by the G pixel, and the luminance detected by the B pixel. In this case, although the color reproducibility is worse than when the R pixel, the G pixel, and the B pixel are used, various colors can be detected as in the case of using the R pixel, the G pixel, and the B pixel. Therefore, the main pixel 1a of the pixel unit U may have the structure shown in FIG. 8A instead of the structure shown in FIG. 7C.

[0111] FIG. 8B shows a solid-state imaging device of the second modification, specifically showing an area F occupied by color filters 14a and 14b in one pixel unit U. The pixel unit U of this modification includes one R pixel, one B pixel, and two C pixels as main pixels 1a, and one R pixel, two G pixels, and one B pixel as sub-pixels 1b. The pixel unit U of this modification is composed of four main pixels 1a including a C pixel, and four sub-pixels 1b not including a C pixel. The main pixel 1a of the pixel unit U may have the structure shown in FIG. 8B instead of the structure shown in FIG. 7C.

[0112] FIG. 8C shows a solid-state imaging device of the third modification, specifically showing an area F occupied by color filters 14a and 14b in one pixel unit U. The pixel unit U of this modification includes one R pixel, one G pixel, and two C pixels as main pixels 1a, and one R pixel, two G pixels, and one B pixel as sub-pixels 1b. The pixel unit U of this modification is composed of four main pixels 1a including a C pixel, and four sub-pixels 1b not including a C pixel. The main pixel 1a of the pixel unit U may have the structure shown in FIG. 8C instead of the structure shown in FIG. 7C.

[0113] FIG. 8D shows a solid-state imaging device of the fourth modification, specifically showing an area F occupied by color filters 14a and 14b in one pixel unit U. The pixel unit U of this modification includes one R pixel, one G pixel, and two C pixels as the main pixel 1a, and one R pixel, two G pixels, and one B pixel as the sub-pixel 1b. However, the position of the G pixel of the main pixel 1a of this modification is different from the position of the G pixel of the main pixel 1a of the third modification. The pixel unit U of this modification is composed of four main pixels 1a including a C pixel, and four sub-pixels 1b not including a C pixel. The main pixel 1a of the pixel unit U may have the structure shown in FIG. 8D instead of the structure shown in FIG. 7C.

[0114] FIG. 9 is a table for explaining advantages of the solid-state imaging device according to the first embodiment.

[0115] FIG. 9 shows, for pixel units U having the structures of Examples 1 to 5, the quality of color reproducibility, low illuminance sensitivity, high luminance saturation, and mode switching judgment as “good” or “bad.”

[0116] The pixel unit U of Example 1 includes one R pixel, two G pixels, and one B pixel as the main pixel 1a, and one R pixel, two G pixels, and one B pixel as the sub-pixel 1b. This corresponds to the pixel unit U of the first comparative example. In this case, the color reproducibility and high brightness saturation are improved, but the low illuminance sensitivity and mode switching judgment are deteriorated. The reason why the low illuminance sensitivity is deteriorated is that the main pixel 1a does not include a C pixel, as described with reference to FIG. 7A (first comparative example). Also, the reason why the mode switching judgment is deteriorated is that if the pixel unit U does not include a C pixel, the mode switching cannot be performed with a simple structure, as described with reference to FIG. 7C (first embodiment).

[0117] The pixel unit U of Example 2 includes one R pixel, one G pixel, one B pixel, and one C pixel as the main pixel 1a, and one R pixel, one G pixel, one B pixel, and one C pixel as the sub-pixel 1b. This corresponds to the pixel unit U of the second comparative example. In this case, the color reproducibility, low illuminance sensitivity, and mode switching determination are improved, but the high luminance saturation is deteriorated. The reason why the high luminance saturation is deteriorated is because the sub-pixel 1b includes a C pixel, as described with reference to FIG. 7B (second comparative example).

[0118] The color reproducibility of Example 2 is rated as "good" rather than "bad" for the reasons explained for the main pixel 1a with reference to Fig. 7C (first embodiment). That is, if the pixel unit U has one R pixel, one G pixel, and one B pixel, it is possible to ensure sufficient color reproducibility, although it is inferior to the case where there is one R pixel, two G pixels, and one B pixel.

[0119] The pixel unit U of Example 3 includes one R pixel, one B pixel, and two C pixels as the main pixel 1a, and one R pixel, one B pixel, and two C pixels as the sub-pixel 1b. In this case, the low illuminance sensitivity and the mode switching determination are improved, but the color reproducibility and the high brightness saturation are deteriorated. The reason for the deterioration of the color reproducibility is that the main pixel 1a does not include a G pixel among the RGB pixels, as described with reference to FIG. 8A (first modified example).

[0120] The pixel unit U of Example 4 includes one R pixel, one G pixel, one B pixel, and one C pixel as the main pixel 1a, and one R pixel, two G pixels, and one B pixel as the sub-pixel 1b. This corresponds to the pixel unit U of the first embodiment. In this case, color reproducibility, low illuminance sensitivity, high luminance saturation, and mode switching judgment are all improved. Therefore, in this embodiment, it is desirable to adopt the structure of Example 4.

[0121] The pixel unit U of Example 5 includes one R pixel, one B pixel, and two C pixels as the main pixel 1a, and one R pixel, two G pixels, and one B pixel as the sub-pixel 1b. This corresponds to the pixel unit U of the second modified example. In this case, the low illuminance sensitivity, high luminance saturation, and mode switching determination are improved, but the color reproducibility is deteriorated. The reason for the deterioration of the color reproducibility is that the main pixel 1a does not include a G pixel among the RGB pixels, as described with reference to FIG. 8A (first modified example).

[0122] However, in the case of Example 5, although color reproducibility is worse than when R, G, and B pixels are used, various colors can be detected by calculation, similarly to when R, G, and B pixels are used (see the explanation of FIG. 8A). Therefore, the pixel unit U may have the structure of Example 5 instead of the structure of Example 4.

[0123] FIG. 10 is a plan view showing the structure of a solid-state imaging device according to the fifth modified example of the first embodiment.

[0124] Fig. 10 shows the shapes of the main pixel 1a, the sub-pixel 1b, the color filter 14a, and the color filter 14b in a plan view, similar to Fig. 6. However, while each pixel unit U shown in Fig. 6 includes four main pixels 1a and four sub-pixels 1b, each pixel unit U shown in Fig. 10 includes 16 main pixels 1a and 16 sub-pixels 1b. In this way, the number of main pixels 1a in each pixel unit U and the number of sub-pixels 1b in each pixel unit U may be any number. Also, the main pixel 1a in each pixel unit U may include any number of C pixels.

[0125] As described above, each pixel unit U of this embodiment includes a plurality of main pixels 1a including a C pixel, and a plurality of sub-pixels 1b not including a C pixel. For example, each pixel unit U of this embodiment includes an R pixel, a G pixel, a B pixel, and a C pixel as the main pixel 1a, and an R pixel, a G pixel, and a B pixel as the sub-pixel 1b. Therefore, according to this embodiment, it is possible to realize a suitable sub-pixel structure including a C pixel by preventing the disadvantages of the C pixel from affecting the sub-pixel 1b while enjoying the advantages of the C pixel in the main pixel 1a.

[0126] Second embodiment FIG. 11 is a plan view showing the structure of the solid-state imaging device according to the second embodiment.

[0127] Fig. 11 shows the shapes of the main pixel 1a, sub-pixel 1b, color filter 14a, and color filter 14b in a plan view, similar to Fig. 6. Each pixel unit U of this embodiment includes a plurality of polarizing filters PF in addition to the components of each pixel unit U of the first embodiment. In each pixel unit U of this embodiment, each sub-pixel 1b includes a polarizing filter PF, but each main pixel 1a does not include a polarizing filter PF.

[0128] Fig. 11 shows four pixel units U1-U4 and areas F1-F4 occupied by color filters 14a and 14b of pixel 1 in pixel units U1-U4. The polarizing filter PF of each sub-pixel 1b can transmit polarized light that vibrates in a predetermined direction. In Fig. 11, the direction in which the lines shown in each sub-pixel 1b (each color filter 14b) extend indicates the vibration direction of the polarized light that passes through each polarizing filter PF.

[0129] For example, each polarizing filter PF in pixel unit U1 can transmit polarized light vibrating in the X direction, and each polarizing filter PF in pixel unit U2 can transmit polarized light vibrating in the Y' direction. Furthermore, each polarizing filter PF in pixel unit U3 can transmit polarized light vibrating in the X' direction, and each polarizing filter PF in pixel unit U4 can transmit polarized light vibrating in the Y direction. These directions will be referred to as the "45 degree direction", "90 degree direction", "0 degree direction", and "135 degree direction", respectively. These directions are examples of the first to fourth directions of this disclosure.

[0130] According to this embodiment, it is possible to detect flare using light transmitted through the color filter 14b and the polarizing filter PF of the sub-pixel 1b. This is because flare generally has high brightness and strong directionality. For example, it is possible to determine the direction of the flare by checking which pixel unit among the pixel units U1 to U4 detects the flare. Such determination is performed by, for example, the control circuit 3 (FIG. 1). According to this embodiment, it is possible to support high brightness at low cost by only the sub-pixel 1b among the main pixel 1a and the sub-pixel 1b including the polarizing filter PF.

[0131] The polarization filters PF in the 0 degree, 45 degree, 90 degree, and 135 degree directions may be arranged in any layout. For example, each pixel unit U may have the polarization filters PF in the 0 degree, 45 degree, 90 degree, and 135 degree directions. In FIG. 11, 16 sub-pixels 1b include all 12 combinations of three types of color filters 14b (R filter, G filter, and B filter) and four types of polarization filters PF (0 degree, 45 degree, 90 degree, and 135 degree directions). This makes it possible to estimate colors that are affected by flare and colors that are not affected by flare.

[0132] FIG. 12 is a cross-sectional view showing the structure of the solid-state imaging device according to the second embodiment.

[0133] The solid-state imaging device of this embodiment includes a polarizing filter layer 16 in addition to the components of the solid-state imaging device of the first embodiment. The polarizing filter layer 16 is disposed between the color filter layer 14 and the lens layer 15 in Fig. 12, but may be disposed in another location. Fig. 12 shows only the light-shielding layer 13, the color filter layer 14, the lens layer 15, and the polarizing filter layer 16 among the components of the solid-state imaging device of this embodiment.

[0134] The polarizing filter layer 16 includes a portion 16a in each main pixel 1a and a portion 16b in each sub-pixel 1b. In this embodiment, the portion 16b in each sub-pixel 1b functions as a polarizing filter PF, but the portion 16a in each main pixel 1a does not function as a polarizing filter PF.

[0135] FIG. 13 is a cross-sectional view showing the structure of a solid-state imaging device according to a first modified example of the second embodiment.

[0136] Each pixel unit U of this modified example includes 16 main pixels 1a and 16 sub-pixels 1b. The pixel unit U1 (area F1) shown in Fig. 13 includes 16 polarizing filters PF corresponding to the 16 sub-pixels 1b. These polarizing filters PF include four polarizing filters PF oriented in the 0 degree direction, four polarizing filters PF oriented in the 45 degree direction, four polarizing filters PF oriented in the 90 degree direction, and four polarizing filters PF oriented in the 135 degree direction.

[0137] FIG. 14 is a cross-sectional view showing the structure of a solid-state imaging device according to a second modified example of the second embodiment.

[0138] FIG. 14, like FIG. 11, shows four pixel units U1 to U4 and areas F1 to F4 occupied by color filters 14a and 14b of pixel 1 in pixel units U1 to U4. However, the polarizing filter PF of this modification includes only a polarizing filter PF in the 0 degree direction and a polarizing filter PF in the 90 degree direction. Therefore, the accuracy of judging the flare direction of this modification is lower than that of the second embodiment. However, according to this modification, it is possible to form the polarizing filter PF in a simpler process than the second embodiment.

[0139] FIG. 15 is a cross-sectional view showing the structure of a solid-state imaging device according to a third modified example of the second embodiment.

[0140] Each pixel unit U of this modified example includes 16 main pixels 1a and 16 sub-pixels 1b. The pixel unit U1 (area F1) shown in Fig. 15 includes 16 polarizing filters PF corresponding to the 16 sub-pixels 1b. These polarizing filters PF include eight polarizing filters PF oriented in the 0 degree direction and eight polarizing filters PF oriented in the 90 degree direction.

[0141] As described above, each pixel unit U of the present embodiment includes a plurality of main pixels 1a including a C pixel and a plurality of sub-pixels 1b not including a C pixel, similar to each pixel unit U of the first embodiment. Therefore, according to the present embodiment, it is possible to realize a suitable sub-pixel structure including a C pixel by preventing the disadvantages of the C pixel from affecting the sub-pixels 1b while enjoying the advantages of the C pixel in the main pixel 1a.

[0142] Furthermore, each pixel unit U of this embodiment includes a polarizing filter PF in each sub-pixel 1b. Therefore, according to this embodiment, it is possible to detect flare using the sub-pixel 1b. Note that the polarizing filter PF of this embodiment may be applied to the first comparative example, the second comparative example, the first modified example, the second modified example, the third modified example, the fourth modified example, or the fifth modified example of the first embodiment, instead of being applied to each pixel unit U of the first embodiment.

[0143] Third embodiment FIG. 16 is a table for explaining the operation of the solid-state imaging device according to the third embodiment.

[0144] Like the solid-state imaging device of the first embodiment, the solid-state imaging device of this embodiment has the configuration shown in Fig. 1 to Fig. 6 etc. The solid-state imaging device of this embodiment further operates according to the rules shown in the table of Fig. 16.

[0145] FIG. 16A shows the rules when the solid-state imaging device operates in monochrome low light mode. In this case, the solid-state imaging device measures the luminance of white light (C luminance) by the C pixel among the main pixels 1a in each pixel unit U. The solid-state imaging device also calculates the luminance of red light (R luminance), green light (G luminance), and blue light (B luminance) using the measured value of C luminance. Specifically, the calculated value of R luminance is 1 / 3 times the measured value of C luminance, the calculated value of G luminance is 1 / 3 times the measured value of C luminance, and the calculated value of B luminance is 1 / 3 times the measured value of C luminance. This mode is adopted, for example, when the illuminance is low.

[0146] FIG. 16B shows the rules when the solid-state imaging device operates in color low light mode. In this case, the solid-state imaging device measures R luminance, G luminance, and B luminance by the R pixel, G pixel, and B pixel of the main pixels 1a in each pixel unit U. The solid-state imaging device also uses the measured values ​​of R luminance, G luminance, and B luminance as they are as calculated values ​​of R luminance, G luminance, and B luminance. Specifically, the calculated value of R luminance is set to 1 times the measured value of R luminance, the calculated value of G luminance is set to 1 times the measured value of G luminance, and the calculated value of B luminance is set to 1 times the measured value of B luminance. This mode is adopted, for example, when the illuminance is medium.

[0147] FIG. 16C shows the rule when the solid-state imaging device operates in the highlight mode. In this case, the solid-state imaging device measures the R luminance, the first G luminance (G1 luminance), the second G luminance (G2 luminance), and the B luminance by the R pixel, the first G pixel (G1 pixel), the second G pixel (G2 pixel), and the B pixel of the sub-pixel 1b in each pixel unit U. In addition, the solid-state imaging device calculates the R luminance, the G luminance, and the B luminance using the measured values ​​of the R luminance, the G luminance, and the B luminance. Specifically, the calculated value of the R luminance is set to one time the measured value of the R luminance, the calculated value of the G luminance is set to the average of the measured values ​​of the G1 luminance and the G2 luminance, and the calculated value of the B luminance is set to one time the measured value of the B luminance. This mode is adopted, for example, when the illuminance is high.

[0148] FIG. 17 is another table for explaining the operation of the solid-state imaging device according to the third embodiment.

[0149] The solid-state imaging device of this embodiment may operate according to the rules shown in the table of Fig. 17. Fig. 17 shows the rules when the solid-state imaging device operates in the first to fifth modes.

[0150] The first, third, and fifth modes correspond to monochrome low light mode (ML mode), color low light mode (CL mode), and highlight mode (H mode), respectively. Meanwhile, the second mode corresponds to a mode that combines the ML and CL modes. And the fourth mode corresponds to a mode that combines the CL and H modes.

[0151] Specifically, the calculated values of the R luminance, G luminance, and B luminance in the second mode are the sum of (1 - x) times the calculated values of the R luminance, G luminance, and B luminance in the ML mode and x times the calculated values of the R luminance, G luminance, and B luminance in the CL mode (x is a real number satisfying 0 < x < 1). Also, the calculated values of the R luminance, G luminance, and B luminance in the fourth mode are the sum of (1 - y) times the calculated values of the R luminance, G luminance, and B luminance in the CL mode and y times the calculated values of the R luminance, G luminance, and B luminance in the H mode (y is a real number satisfying 0 < y < 1). According to the rule shown in FIG. 17, it is possible to perform a more refined luminance calculation than the luminance calculation according to the rules shown in FIGS. 16A to 16C.

[0152] The control described with reference to FIGS. 16A to 16C and the control described with reference to FIG. 17 are performed by, for example, the control circuit 3 (FIG. 1). The control circuit 3 in this case is an example of the first and second calculation units of the present disclosure. The mode switching is performed by the control circuit 3 based on, for example, a predetermined parameter or a predetermined threshold value.

[0153] (Fourth Embodiment) FIG. 23 is a plan view showing three examples of the structure of the solid-state imaging device according to the fourth embodiment.

[0154] FIG. 23A shows a first example of the solid-state imaging device of the present embodiment. Specifically, it shows the region F1 occupied by the color filters 14a and 14b in one pixel unit U1. The region F1 in FIG. 23A includes 12 color filters 14a for 12 main pixels 1a and 4 color filters 14b for 4 sub-pixels 1b. In FIG. 23A, these main pixels 1a include 3 R pixels, 3 G pixels, 3 B pixels, and 3 C pixels, and these sub-pixels 1b include 1 R pixel, 2 G pixels, and 1 B pixel. FIG. 23A shows the position of the color filter 14b by a broken line in order to distinguish the color filter 14a from the color filter 14b.

[0155] In the first embodiment and the like, the shape of the upper surface of each color filter 14a is an octagon, and the shape of the upper surface of each color filter 14b is a rectangle. On the other hand, in FIG. 23A, the shape of the upper surface of each color filter 14a is a rectangle, and the shape of the upper surface of each color filter 14b is also a rectangle. In FIG. 23A, the area of ​​each color filter 14a in a plan view is the same as the area of ​​each color filter 14b in a plan view. These areas are examples of the first area of ​​the present disclosure. In FIG. 23A, unlike the first embodiment and the like, the shape and area of ​​the region F1 in a plan view are the same as the shape and area of ​​the pixel unit U1 in a plan view.

[0156] In the first embodiment and the like, the number of main pixels 1a and the number of sub-pixels 1b in each pixel unit U are the same. For example, in each pixel unit U in FIG. 6, the number of main pixels 1a is four, and the number of sub-pixels 1b is also four. On the other hand, in the pixel unit U1 in FIG. 23A, the number of main pixels 1a is twelve, and the number of sub-pixels 1b is also four, so that the number of main pixels 1a is greater than the number of sub-pixels 1b. When the number of main pixels 1a in each pixel unit is N times the number of sub-pixels 1b, the value of N in FIG. 6 is 1, and the value of N in FIG. 23A is 2 or more (specifically, 3).

[0157] In FIG. 23A, three color filters 14a for R pixels (main pixels 1a) are adjacent to each other to form an L-shaped region, and one color filter 14b for R pixels (sub-pixels 1b) is adjacent to these color filters 14a. If the former three R pixels are treated as one R pixel, the pixel unit U1 in FIG. 23A can be considered to have a configuration similar to that of the pixel unit U in the first embodiment and the like. Specifically, the former three R pixels (main pixels 1a) can be treated as one R pixel (main pixel 1a) including one color filter 14a having a large area, and the latter one R pixel (sub-pixel 1b) can be treated as one R pixel (sub-pixel 1b) including one color filter 14b having a small area. The above also applies to the G pixel, B pixel, and C pixel. As a result, when the imaging device in FIG. 23A is used, it is possible to capture suitable images under various illuminances, as in the case of the imaging device in the first embodiment and the like.

[0158] 23A is also composed of a plurality of main pixels 1a including a C pixel and a plurality of sub-pixels 1b not including a C pixel, like the pixel unit U of the first embodiment etc. This makes it possible to prevent the disadvantages of the C pixel from affecting the sub-pixels 1b while enjoying the advantages of the C pixel in the main pixel 1a, and thus makes it possible to realize a suitable sub-pixel structure including a C pixel.

[0159] Fig. 23B shows a second example of the solid-state imaging device of this embodiment, specifically showing an area F1 occupied by color filters 14a and 14b in one pixel unit U1. The area F1 in Fig. 23B also includes 12 color filters 14a for 12 main pixels 1a and 4 color filters 14b for 4 sub-pixels 1b. In Fig. 23B, the main pixels 1a include three R pixels, three B pixels, and six C pixels, and the sub-pixels 1b include one R pixel, two G pixels, and one B pixel.

[0160] Fig. 23C shows a third example of the solid-state imaging device of this embodiment, specifically showing an area F1 occupied by color filters 14a and 14b in one pixel unit U1. The area F1 in Fig. 23C also includes 12 color filters 14a for 12 main pixels 1a and 4 color filters 14b for 4 sub-pixels 1b. In Fig. 23C, the main pixels 1a include three R pixels, three G pixels, and six C pixels, and the sub-pixels 1b include one R pixel, two G pixels, and one B pixel.

[0161] Using the symbol "N" above, the pixel unit U1 in FIG. 23A includes N C pixels. Meanwhile, the pixel unit U1 in FIG. 23B includes more than N C pixels, specifically 2×N C pixels. Similarly, the pixel unit U1 in FIG. 23C includes more than N C pixels, specifically 2×N C pixels. The pixel units U1 in FIG. 23A, FIG. 23B, and FIG. 23C correspond to the pixel units U in FIG. 7C, FIG. 8B, and FIG. 8D, respectively.

[0162] According to this embodiment, it is possible to achieve the same effects as those of the first embodiment and the like by using color filters 14a and 14b having the same area.

[0163] The solid-state imaging device of this embodiment may further include the configuration of the solid-state imaging device of the second or third embodiment. For example, each pixel unit U1 of this embodiment may include a plurality of polarizing filters PF described in the second embodiment.

[0164] Fifth embodiment FIG. 24 is a plan view showing three examples of the structure of the solid-state imaging device according to the fifth embodiment.

[0165] FIG. 24A shows a first example of the solid-state imaging device of the present embodiment, specifically, a region F1 occupied by color filters 14a and 14b in one pixel unit U1. The region F1 in FIG. 24A includes four color filters 14a for four main pixels 1a and four color filters 14b for four sub-pixels 1b. In FIG. 24A, the main pixels 1a include one R pixel, one G pixel, one B pixel, and one C pixel, and the sub-pixels 1b include one R pixel, two G pixels, and one B pixel. The pixel units U1 in FIG. 24A correspond to the pixel units U in FIG. 7C.

[0166] In the second embodiment, each pixel unit U includes a plurality of polarizing filters PF, specifically, each sub-pixel 1b includes a polarizing filter PF, and each main pixel 1a does not include a polarizing filter PF (see FIG. 11, etc.). On the other hand, in FIG. 24A, the pixel unit U1 includes a plurality of neutral density filters RF, specifically, each sub-pixel 1b includes a neutral density filter RF, and each main pixel 1a does not include a neutral density filter RF. The neutral density filter RF of each sub-pixel 1b can reduce the amount of light incident on the corresponding photodiode PD2 compared to the case where there is no neutral density filter RF. This makes it possible to make the sensitivity of the sub-pixel 1b lower than that of the main pixel 1a, or to increase the sensitivity difference between the sub-pixel 1b and the main pixel 1a.

[0167] FIG. 24B shows a second example of the solid-state imaging device of the present embodiment, specifically showing an area F1 occupied by color filters 14a and 14b in one pixel unit U1. The area F1 in FIG. 24B includes four color filters 14a for four main pixels 1a and four color filters 14b for four sub-pixels 1b. In FIG. 24B, the main pixels 1a include one R pixel, one B pixel, and two C pixels, and the sub-pixels 1b include one R pixel, two G pixels, and one B pixel. The pixel units U1 in FIG. 24B correspond to the pixel units U in FIG. 8B. In FIG. 24B, each sub-pixel 1b also includes a neutral density filter RF, and each main pixel 1a does not include a neutral density filter RF.

[0168] FIG. 24C shows a third example of the solid-state imaging device of the present embodiment, specifically showing an area F1 occupied by color filters 14a and 14b in one pixel unit U1. The area F1 in FIG. 24C includes four color filters 14a for four main pixels 1a and four color filters 14b for four sub-pixels 1b. In FIG. 24C, the main pixels 1a include one R pixel, one G pixel, and two C pixels, and the sub-pixels 1b include one R pixel, two G pixels, and one B pixel. The pixel units U1 in FIG. 24C correspond to the pixel units U in FIG. 8D. In FIG. 24C, each sub-pixel 1b also includes a neutral density filter RF, and each main pixel 1a does not include a neutral density filter RF.

[0169] FIG. 25 is a cross-sectional view showing the structure of a solid-state imaging device according to the fifth embodiment.

[0170] A solid-state imaging device of this embodiment (for example, a solid-state imaging device shown in any one of FIGS. 24A to 24C) includes a neutral density filter layer 17 in addition to the components of the solid-state imaging device of the first embodiment. Although the neutral density filter layer 17 is disposed between the color filter layer 14 and the lens layer 15 in FIG. 25, it may be disposed in another location. FIG. 25 shows only the light-shielding layer 13, the color filter layer 14, the lens layer 15, and the neutral density filter layer 17 among the components of the solid-state imaging device of this embodiment.

[0171] The neutral density filter layer 17 includes a portion 17a in each main pixel 1a and a portion 17b in each sub-pixel 1b. In this embodiment, the portion 17b in each sub-pixel 1b functions as a neutral density filter RF, but the portion 17a in each main pixel 1a does not function as a neutral density filter RF. This makes it possible to realize a structure like any of the solid-state imaging devices in Figures 24A to 24C.

[0172] 25, the portion 17a in each main pixel 1a may function as a weaker neutral density filter RF than the portion 17b in each sub-pixel 1b. That is, the portion 17b in each sub-pixel 1b may function as a strong neutral density filter RF, and the portion 17a in each main pixel 1a may function as a weak neutral density filter RF.

[0173] According to this embodiment, the neutral density filter RF can make the sensitivity of the sub-pixel 1b lower than the sensitivity of the main pixel 1a, or can increase the difference in sensitivity between the sub-pixel 1b and the main pixel 1a.

[0174] The solid-state imaging device of this embodiment may further include the configuration of any one of the solid-state imaging devices of the second to fourth embodiments. For example, each pixel unit U1 of this embodiment may include color filters 14a and 14b having the same area, as in the fourth embodiment.

[0175] Sixth embodiment FIG. 26 is a plan view showing the structure of a solid-state imaging device according to the sixth embodiment.

[0176] The solid-state imaging device of this embodiment shown in Fig. 26 has a structure similar to that of the solid-state imaging device of the second embodiment shown in Fig. 11. Like Fig. 11, Fig. 26 shows regions F1 to F4 occupied by color filters 14a and 14b in pixel units U1 to U4. Each of the regions F1 to F4 in Fig. 26 includes four color filters 14a for four main pixels 1a and four color filters 14b for four sub-pixels 1b. Each of the pixel units U1 to U4 in Fig. 26 is composed of a plurality of main pixels 1a including a C pixel and a plurality of sub-pixels 1b not including a C pixel.

[0177] Here, FIG. 11 (second embodiment) and FIG. 26 (present embodiment) are compared. In FIG. 11, each sub-pixel 1b in pixel unit U1 includes a polarizing filter PF in a 45-degree direction, each sub-pixel 1b in pixel unit U2 includes a polarizing filter PF in a 90-degree direction, each sub-pixel 1b in pixel unit U3 includes a polarizing filter PF in a 0-degree direction, and each sub-pixel 1b in pixel unit U4 includes a polarizing filter PF in a 135-degree direction. On the other hand, in FIG. 26, each sub-pixel 1b in pixel units U1 to U4 includes a polarizing filter PF in a 90-degree direction. The 90-degree direction in FIG. 26 is an example of the first direction in the present disclosure.

[0178] The solid-state imaging device of this embodiment includes a polarizing filter PF in the 90-degree direction, but does not include polarizing filters PF in other directions. Therefore, the structure of the solid-state imaging device of this embodiment is not suitable for detecting flare. However, according to this embodiment, by using the sub-pixel 1b including such a polarizing filter PF, it is possible to reduce the influence of reflection from water on an image, for example.

[0179] The solid-state imaging device of this embodiment may further include the configuration of the solid-state imaging device of the third or fourth embodiment. For example, the pixel units U1 to U4 of this embodiment may include color filters 14a and 14b having the same area, as in the fourth embodiment.

[0180] (Application example) 18 is a block diagram showing an example of the configuration of an electronic device. The electronic device shown in FIG.

[0181] Camera 100 includes optical section 101 including a lens group and the like, imaging device 102 which is a solid-state imaging device according to any one of the first to sixth embodiments, DSP (Digital Signal Processor) circuit 103 which is a camera signal processing circuit, frame memory 104, display section 105, recording section 106, operation section 107, and power supply section 108. DSP circuit 103, frame memory 104, display section 105, recording section 106, operation section 107, and power supply section 108 are connected to each other via bus line 109.

[0182] The optical unit 101 takes in incident light (image light) from a subject and forms an image on an imaging surface of the imaging device 102. The imaging device 102 converts the amount of incident light imaged on the imaging surface by the optical unit 101 into an electrical signal on a pixel-by-pixel basis and outputs the electrical signal.

[0183] The DSP circuit 103 performs signal processing on the pixel signals output by the imaging device 102. The frame memory 104 is a memory for storing one screen of a moving image or a still image captured by the imaging device 102.

[0184] The display unit 105 includes a panel-type display device such as a liquid crystal panel or an organic EL panel, and displays moving images or still images captured by the imaging device 102. The recording unit 106 records the moving images or still images captured by the imaging device 102 in a recording medium such as a hard disk or a semiconductor memory.

[0185] An operation unit 107, under the operation of a user, issues operation commands for various functions of the camera 100. A power supply unit 108 appropriately supplies various types of power to the DSP circuit 103, frame memory 104, display unit 105, recording unit 106, and operation unit 107 as operating power sources to these devices.

[0186] By using the solid-state imaging device according to any one of the first to sixth embodiments as the imaging device 102, it is possible to expect acquisition of a good image.

[0187] The solid-state imaging device can be applied to various other products. For example, the solid-state imaging device may be mounted on various moving objects such as automobiles, electric vehicles, hybrid electric vehicles, motorcycles, bicycles, personal mobility vehicles, airplanes, drones, ships, and robots.

[0188] 19 is a block diagram showing a configuration example of a moving object control system, which is a vehicle control system 200.

[0189] The vehicle control system 200 includes a plurality of electronic control units connected via a communication network 201. In the example shown in Fig. 19, the vehicle control system 200 includes a drive system control unit 210, a body system control unit 220, an outside-vehicle information detection unit 230, an inside-vehicle information detection unit 240, and an integrated control unit 250. Fig. 19 further illustrates, as components of the integrated control unit 250, a microcomputer 251, an audio / video output unit 252, and an in-vehicle network I / F (Interface) 253.

[0190] The drivetrain control unit 210 controls the operation of devices related to the drivetrain of the vehicle according to various programs. For example, the drivetrain control unit 210 functions as a control device for a drive force generating device for generating a drive force of the vehicle, such as an internal combustion engine or a drive motor, a drive force transmission mechanism for transmitting the drive force to the wheels, a steering mechanism for adjusting the steering angle of the vehicle, a braking device for generating a braking force of the vehicle, etc.

[0191] The body system control unit 220 controls the operation of various devices equipped on the vehicle body according to various programs. For example, the body system control unit 220 functions as a control device for a smart key system, a keyless entry system, a power window device, various lamps (e.g., head lamps, back lamps, brake lamps, blinkers, fog lamps), etc. In this case, radio waves transmitted from a portable device that substitutes for a key or signals from various switches may be input to the body system control unit 220. The body system control unit 220 receives input of such radio waves or signals and controls the door lock device, power window device, lamps, etc. of the vehicle.

[0192] The outside-vehicle information detection unit 230 detects information outside the vehicle equipped with the vehicle control system 200. For example, an imaging unit 231 is connected to the outside-vehicle information detection unit 230. The outside-vehicle information detection unit 230 causes the imaging unit 231 to capture an image outside the vehicle, and receives the captured image from the imaging unit 231. The outside-vehicle information detection unit 230 may perform object detection processing or distance detection processing for people, cars, obstacles, signs, characters on the road surface, etc., based on the received image.

[0193] The imaging unit 231 is an optical sensor that receives light and outputs an electrical signal according to the amount of the received light. The imaging unit 231 can output the electrical signal as an image, and can also output it as distance measurement information. The light received by the imaging unit 231 may be visible light, or may be invisible light such as infrared light. The imaging unit 231 includes a solid-state imaging device according to any one of the first to sixth embodiments.

[0194] The in-vehicle information detection unit 240 detects information about the inside of the vehicle equipped with the vehicle control system 200. For example, a driver state detection unit 241 that detects the state of the driver is connected to the in-vehicle information detection unit 240. For example, the driver state detection unit 241 includes a camera that captures an image of the driver, and the in-vehicle information detection unit 240 may calculate the degree of fatigue or concentration of the driver based on the detection information input from the driver state detection unit 241, or may determine whether the driver is dozing. This camera may include any of the solid-state imaging devices of the first to sixth embodiments, and may be, for example, the camera 100 shown in FIG. 18.

[0195] The microcomputer 251 can calculate control target values ​​for the driving force generating device, steering mechanism, or braking device based on the information inside and outside the vehicle acquired by the outside-of-vehicle information detection unit 230 or the inside-vehicle information detection unit 240, and output a control command to the drive system control unit 210. For example, the microcomputer 251 can perform cooperative control aimed at realizing functions of an ADAS (Advanced Driver Assistance System), such as vehicle collision avoidance, impact mitigation, following driving based on the inter-vehicle distance, vehicle speed maintenance driving, collision warning, lane departure warning, etc.

[0196] In addition, the microcomputer 251 can perform cooperative control for the purpose of automatic driving, in which the vehicle travels autonomously without being operated by the driver, by controlling the driving force generating device, the steering mechanism, or the braking device based on information about the surroundings of the vehicle acquired by the outside vehicle information detection unit 230 or the inside vehicle information detection unit 240.

[0197] Furthermore, the microcomputer 251 can output a control command to the body system control unit 220 based on the information outside the vehicle acquired by the vehicle exterior information detection unit 230. For example, the microcomputer 251 can control the headlamps according to the position of a preceding vehicle or an oncoming vehicle detected by the vehicle exterior information detection unit 230, and perform cooperative control for the purpose of preventing glare, such as switching from high beams to low beams.

[0198] The audio / image output unit 252 transmits at least one of audio and image output signals to an output device capable of visually or audibly notifying the passengers of the vehicle or the outside of the vehicle of information. In the example of Fig. 19, an audio speaker 261, a display unit 262, and an instrument panel 263 are shown as such output devices. The display unit 262 may include, for example, an on-board display or a head-up display.

[0199] FIG. 20 is a plan view showing a specific example of the setting position of the imaging unit 231 in FIG.

[0200] 20 includes imaging units 301, 302, 303, 304, and 305 as the imaging unit 231. The imaging units 301, 302, 303, 304, and 305 are provided at positions such as the front nose, side mirrors, rear bumper, back door, and the top of the windshield inside the vehicle cabin of the vehicle 300.

[0201] The imaging unit 301 provided on the front nose mainly acquires images of the front of the vehicle 300. The imaging unit 302 provided on the left side mirror and the imaging unit 303 provided on the right side mirror mainly acquire images of the sides of the vehicle 300. The imaging unit 304 provided on the rear bumper or the back door mainly acquires images of the rear of the vehicle 300. The imaging unit 305 provided on the upper part of the windshield inside the vehicle cabin mainly acquires images of the front of the vehicle 300. The imaging unit 305 is used to detect, for example, a leading vehicle, a pedestrian, an obstacle, a traffic light, a traffic sign, a lane, and the like.

[0202] FIG. 20 shows an example of the imaging ranges of the imaging units 301, 302, 303, and 304 (hereinafter referred to as "imaging units 301 to 304"). Imaging range 311 indicates the imaging range of the imaging unit 301 provided on the front nose. Imaging range 312 indicates the imaging range of the imaging unit 302 provided on the left side mirror. Imaging range 313 indicates the imaging range of the imaging unit 303 provided on the right side mirror. Imaging range 314 indicates the imaging range of the imaging unit 304 provided on the rear bumper or the back door. For example, the image data captured by the imaging units 301 to 304 are superimposed to obtain an overhead image of the vehicle 300 viewed from above. Hereinafter, the imaging ranges 311, 312, 313, and 314 are referred to as "imaging ranges 311 to 314".

[0203] At least one of the imaging units 301 to 304 may have a function of acquiring distance information. For example, at least one of the imaging units 301 to 304 may be a stereo camera including a plurality of imaging devices, or may be an imaging device having pixels for detecting a phase difference.

[0204] For example, the microcomputer 251 (FIG. 19) calculates the distance to each solid object in the imaging range 311-314 and the change in this distance over time (relative speed with respect to the vehicle 300) based on the distance information obtained from the imaging units 301-304. Based on these calculation results, the microcomputer 251 can extract, as a preceding vehicle, a solid object that is the closest solid object on the traveling path of the vehicle 300 and travels in approximately the same direction as the vehicle 300 at a predetermined speed (for example, 0 km / h or more). Furthermore, the microcomputer 251 can set a vehicle distance to be secured in advance in front of the preceding vehicle, and perform automatic brake control (including follow-up stop control) and automatic acceleration control (including follow-up start control). In this way, according to this example, cooperative control can be performed for the purpose of automatic driving that travels autonomously without the driver's operation.

[0205] For example, the microcomputer 251 classifies and extracts three-dimensional object data on three-dimensional objects into two-wheeled vehicles, ordinary vehicles, large vehicles, pedestrians, utility poles, and other three-dimensional objects based on the distance information obtained from the imaging units 301 to 304, and can use the data for automatic obstacle avoidance. For example, the microcomputer 251 distinguishes obstacles around the vehicle 300 into obstacles that are visible to the driver of the vehicle 300 and obstacles that are difficult to see. Then, the microcomputer 251 determines a collision risk indicating the risk of collision with each obstacle, and when the collision risk is equal to or greater than a set value and there is a possibility of a collision, the microcomputer 251 can provide driving assistance for collision avoidance by outputting an alarm to the driver via the audio speaker 261 or the display unit 262, or by performing forced deceleration or avoidance steering via the drive system control unit 210.

[0206] At least one of the imaging units 301 to 304 may be an infrared camera that detects infrared rays. For example, the microcomputer 251 can recognize a pedestrian by determining whether or not a pedestrian is present in the captured images of the imaging units 301 to 304. The recognition of such a pedestrian is performed, for example, by a procedure of extracting feature points in the captured images of the imaging units 301 to 304 as infrared cameras and a procedure of performing a pattern matching process on a series of feature points that indicate the contour of an object to determine whether or not the object is a pedestrian. When the microcomputer 251 determines that a pedestrian is present in the captured images of the imaging units 301 to 304 and recognizes the pedestrian, the audio / image output unit 252 controls the display unit 262 to superimpose a rectangular contour line for emphasis on the recognized pedestrian. The audio / image output unit 252 may also control the display unit 262 to display an icon or the like indicating a pedestrian at a desired position.

[0207] FIG. 21 is a diagram showing an example of a schematic configuration of an endoscopic surgery system to which the technology according to the present disclosure (the present technology) can be applied.

[0208] 21 shows a state in which an operator (doctor) 531 is performing surgery on a patient 532 on a patient bed 533 using an endoscopic surgery system 400. As shown in the figure, the endoscopic surgery system 400 is composed of an endoscope 500, other surgical tools 510 such as an insufflation tube 511 and an energy treatment tool 512, a support arm device 520 that supports the endoscope 500, and a cart 600 on which various devices for endoscopic surgery are mounted.

[0209] The endoscope 500 is composed of a lens barrel 501, a region of a predetermined length from the tip of which is inserted into a body cavity of a patient 532, and a camera head 502 connected to the base end of the lens barrel 501. In the illustrated example, the endoscope 500 is configured as a so-called rigid lens barrel having a rigid lens barrel 501, but the endoscope 500 may be configured as a so-called flexible lens barrel having a flexible lens barrel.

[0210] An opening into which an objective lens is fitted is provided at the tip of the lens barrel 501. A light source device 603 is connected to the endoscope 500, and light generated by the light source device 603 is guided to the tip of the lens barrel by a light guide extending inside the lens barrel 501, and is irradiated via the objective lens toward an observation target in a body cavity of a patient 532. The endoscope 500 may be a direct-viewing endoscope, an oblique-viewing endoscope, or a side-viewing endoscope.

[0211] An optical system and an image sensor are provided inside the camera head 502, and reflected light (observation light) from an observation target is collected on the image sensor by the optical system. The observation light is photoelectrically converted by the image sensor to generate an electrical signal corresponding to the observation light, i.e., an image signal corresponding to an observation image. The image signal is transmitted to a camera control unit (CCU) 601 as RAW data.

[0212] The CCU 601 is configured with a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), etc., and comprehensively controls the operations of the endoscope 500 and the display device 602. Furthermore, the CCU 601 receives an image signal from the camera head 502, and performs various types of image processing on the image signal, such as development processing (demosaic processing), for displaying an image based on the image signal.

[0213] Under the control of the CCU 601 , the display device 602 displays an image based on an image signal that has been subjected to image processing by the CCU 601 .

[0214] The light source device 603 is composed of a light source such as an LED (Light Emitting Diode), and supplies the endoscope 500 with irradiation light when photographing an operation site or the like.

[0215] The input device 604 is an input interface for the endoscopic surgery system 11000. A user can input various information and instructions to the endoscopic surgery system 400 via the input device 604. For example, the user inputs an instruction to change the imaging conditions (type of irradiated light, magnification, focal length, etc.) of the endoscope 500.

[0216] The treatment tool control device 605 controls the driving of the energy treatment tool 512 for cauterizing tissue, incising, sealing blood vessels, etc. The insufflation device 606 feeds gas into the body cavity of the patient 532 via the insufflation tube 511 in order to secure the field of view of the endoscope 500 and the working space of the surgeon. The recorder 607 is a device capable of recording various information related to the surgery. The printer 608 is a device capable of printing various information related to the surgery in various formats such as text, image, or graph.

[0217] The light source device 603 that supplies irradiation light to the endoscope 500 when photographing the surgical site can be composed of a white light source composed of, for example, an LED, a laser light source, or a combination of these. When the white light source is composed of a combination of RGB laser light sources, the output intensity and output timing of each color (each wavelength) can be controlled with high precision, so that the white balance of the captured image can be adjusted in the light source device 603. In this case, it is also possible to capture images corresponding to each of the RGB colors in a time-division manner by irradiating the observation target with laser light from each of the RGB laser light sources in a time-division manner and controlling the driving of the image sensor of the camera head 502 in synchronization with the irradiation timing. According to this method, a color image can be obtained without providing a color filter to the image sensor.

[0218] Furthermore, the light source device 603 may be controlled to change the intensity of the light it outputs at predetermined time intervals. By controlling the driving of the image sensor of the camera head 502 in synchronization with the timing of the change in the light intensity to obtain images in a time-division manner and synthesizing the images, it is possible to generate an image with a high dynamic range that is free of so-called blocked-up shadows and blown-out highlights.

[0219] The light source device 603 may be configured to supply light of a predetermined wavelength band corresponding to the special light observation. In the special light observation, for example, by utilizing the wavelength dependency of light absorption in body tissue, a narrow band light is irradiated compared to the irradiated light (i.e., white light) during normal observation, and a predetermined tissue such as blood vessels on the mucous membrane surface is photographed with high contrast, so-called narrow band imaging is performed. Alternatively, the special light observation may be a fluorescent observation in which an image is obtained by fluorescence generated by irradiating excitation light. In the fluorescent observation, excitation light is irradiated to the body tissue and the fluorescence from the body tissue is observed (autofluorescence observation), or a reagent such as indocyanine green (ICG) is locally injected into the body tissue and excitation light corresponding to the fluorescent wavelength of the reagent is irradiated to the body tissue to obtain a fluorescent image. The light source device 603 may be configured to supply narrow band light and / or excitation light corresponding to such special light observation.

[0220] FIG. 22 is a block diagram showing an example of a functional configuration of the camera head 502 and the CCU 601 shown in FIG.

[0221] The camera head 502 has a lens unit 701, an imaging section 702, a drive section 703, a communication section 704, and a camera head control section 705. The CCU 601 has a communication section 711, an image processing section 712, and a control section 713. The camera head 502 and the CCU 601 are connected to each other by a transmission cable 700 so as to be able to communicate with each other.

[0222] Lens unit 701 is an optical system provided at a connection portion with lens barrel 501. Observation light taken in from the tip of lens barrel 501 is guided to camera head 502 and enters lens unit 701. Lens unit 701 is configured by combining multiple lenses including a zoom lens and a focus lens.

[0223] The imaging unit 702 is composed of an imaging element. The imaging element constituting the imaging unit 702 may be one (so-called single-plate type) or multiple (so-called multi-plate type). When the imaging unit 702 is composed of a multi-plate type, for example, each imaging element may generate an image signal corresponding to each of RGB, and a color image may be obtained by combining the image signals. Alternatively, the imaging unit 702 may be configured to have a pair of imaging elements for acquiring image signals for the right eye and the left eye corresponding to 3D (Dimensional) display. By performing 3D display, the surgeon 531 can more accurately grasp the depth of the biological tissue in the surgical site. Note that when the imaging unit 702 is composed of a multi-plate type, the lens unit 701 may also be provided in multiple systems corresponding to each imaging element. The imaging unit 702 is, for example, a solid-state imaging device according to any one of the first to sixth embodiments.

[0224] Furthermore, the imaging section 702 does not necessarily have to be provided in the camera head 502. For example, the imaging section 702 may be provided inside the lens barrel 501, immediately behind the objective lens.

[0225] The driving section 703 is configured by an actuator, and moves the zoom lens and focus lens of the lens unit 701 by a predetermined distance along the optical axis under the control of the camera head control section 705. This allows the magnification and focus of the image captured by the imaging section 702 to be appropriately adjusted.

[0226] The communication unit 704 is configured by a communication device for transmitting and receiving various information to and from the CCU 601. The communication unit 704 transmits the image signal obtained from the imaging unit 702 to the CCU 601 via the transmission cable 700 as RAW data.

[0227] Furthermore, the communication unit 704 receives a control signal for controlling the driving of the camera head 502 from the CCU 601, and supplies the control signal to the camera head control unit 705. The control signal includes information on the imaging conditions, such as information specifying the frame rate of the captured image, information specifying the exposure value at the time of capturing the image, and / or information specifying the magnification and focus of the captured image.

[0228] The image capturing conditions such as the frame rate, exposure value, magnification, and focus may be appropriately specified by a user, or may be automatically set by the control unit 713 of the CCU 601 based on an acquired image signal. In the latter case, the endoscope 500 is equipped with a so-called AE (Auto Exposure) function, AF (Auto Focus) function, and AWB (Auto White Balance) function.

[0229] The camera head control unit 705 controls the driving of the camera head 502 based on a control signal received from the CCU 601 via the communication unit 704 .

[0230] The communication unit 711 is configured with a communication device for transmitting and receiving various information to and from the camera head 502. The communication unit 711 receives an image signal transmitted from the camera head 502 via the transmission cable 700.

[0231] Furthermore, the communication unit 711 transmits, to the camera head 502, a control signal for controlling the driving of the camera head 502. The image signal and the control signal can be transmitted by electrical communication, optical communication, or the like.

[0232] The image processing unit 712 performs various types of image processing on the image signal, which is RAW data sent from the camera head 502 .

[0233] The control unit 713 performs various controls related to the imaging of the operation site etc. by the endoscope 500 and the display of the captured image obtained by imaging the operation site etc. For example, the control unit 713 generates a control signal for controlling the driving of the camera head 502.

[0234] Further, the control unit 713 causes the display device 602 to display the captured image showing the surgical site, etc., based on the image signal that has been image-processed by the image processing unit 712. At this time, the control unit 713 may recognize various objects in the captured image using various image recognition techniques. For example, the control unit 713 can recognize surgical tools such as forceps, specific living body parts, bleeding, mist generated when the energy treatment tool 512 is used, etc., by detecting the shape and color of the edge of an object included in the captured image. When the control unit 713 causes the display device 602 to display the captured image, it may use the recognition result to superimpose various types of surgery support information on the image of the surgical site. By superimposing and presenting the surgery support information to the surgeon 531, the burden on the surgeon 531 can be reduced and the surgeon 531 can proceed with the surgery reliably.

[0235] The transmission cable 700 connecting the camera head 502 and the CCU 601 is an electrical signal cable corresponding to communication of electrical signals, an optical fiber corresponding to optical communication, or a composite cable of these.

[0236] Here, in the illustrated example, the communication is performed in a wired manner using the transmission cable 700, but the communication between the camera head 502 and the CCU 601 may be performed wirelessly.

[0237] Although the embodiments of the present disclosure have been described above, these embodiments may be implemented with various modifications within the scope of the gist of the present disclosure. For example, two or more embodiments may be implemented in combination.

[0238] The present disclosure may also be configured as follows.

[0239] (1) An imaging device including a plurality of pixel units, Each of the pixel units includes a plurality of first pixels and a plurality of second pixels; Each of the plurality of first pixels includes a color filter region having a first area; Each of the plurality of second pixels includes a color filter region having a second area smaller than the first area; An imaging device, wherein at least one pixel unit of the plurality of pixel units comprises the plurality of first pixels including at least one clear pixel and the plurality of second pixels including no clear pixel.

[0240] (2) the color filter region included in the clear pixel is a region including a white color filter or a region including no color filter; The color filter region included in the pixel other than the clear pixel is a region including a color filter of a color other than white. The imaging device described in (1).

[0241] (3) the color filter region having the first area has an octagonal shape in a plan view, The color filter region having the second area has a rectangular shape in a plan view. The imaging device described in (1).

[0242] (4) The imaging device described in (1), wherein the at least one pixel unit has, as the plurality of first pixels, at least one clear pixel, a pixel of a first color different from white, a pixel of a second color different from white and the first color, and a pixel of a third color different from white, the first color, and the second color.

[0243] (5) The imaging device according to (4), wherein the at least one pixel unit includes a pixel of the first color, a pixel of the second color, and a pixel of the third color as the plurality of second pixels.

[0244] (6) The imaging device described in (1), wherein the at least one pixel unit has, as the plurality of first pixels, at least two clear pixels, a pixel of a first color different from white, and a pixel of a second color different from white and the first color.

[0245] (7) The imaging device described in (6), wherein the at least one pixel unit has, as the plurality of second pixels, a pixel of the first color, a pixel of the second color, and a pixel of a third color different from white, the first color, and the second color.

[0246] (8) The imaging device described in (1), wherein in the at least one pixel unit, each of the multiple second pixels includes a polarizing filter or a neutral density filter.

[0247] (9) The imaging device according to (8), wherein in the at least one pixel unit, each of the plurality of first pixels does not include a polarizing filter and a neutral density filter.

[0248] (10) The imaging device described in (8), wherein the at least one pixel unit includes, as the plurality of second pixels, a pixel including a polarizing filter that transmits polarized light vibrating in a first direction, and a pixel including a polarizing filter that transmits polarized light vibrating in a second direction different from the first direction.

[0249] (11) The imaging device according to (10), wherein the second direction is different from the first direction by 90 degrees.

[0250] (12) The imaging device described in (10), wherein the at least one pixel unit further includes, as the plurality of second pixels, a pixel including a polarizing filter that transmits polarized light vibrating in a third direction different from the first and second directions, and a pixel including a polarizing filter that transmits polarized light vibrating in a fourth direction different from the first, second, and third directions.

[0251] (13) The imaging device according to (12), wherein each of the third and fourth directions differs by 45 degrees from each of the first and second directions.

[0252] (14) The imaging device described in (8), wherein the plurality of pixel units include, as the plurality of second pixels, a pixel including a polarizing filter that transmits polarized light vibrating in a first direction, and a pixel including a polarizing filter that transmits polarized light vibrating in a second direction different from the first direction.

[0253] (15) The imaging device described in (14), wherein the plurality of pixel units further include, as the plurality of second pixels, a pixel including a polarizing filter that transmits polarized light vibrating in a third direction different from the first and second directions, and a pixel including a polarizing filter that transmits polarized light vibrating in a fourth direction different from the first, second, and third directions.

[0254] (16) The imaging device according to (8), wherein in the plurality of pixel units, each of the plurality of second pixels includes a polarizing filter that transmits polarized light vibrating in a first direction.

[0255] (17) a first calculation unit that calculates the luminance of light incident on each pixel unit for a plurality of colors based on the luminance detected by the plurality of first pixels of each pixel unit; a second calculation unit that calculates the luminance of light incident on each pixel unit for a plurality of colors based on the luminance detected by the plurality of second pixels of each pixel unit; The imaging device according to (1) further comprising:

[0256] (18) The imaging device described in (17), wherein the first calculation unit calculates the luminance of a first color different from white, the luminance of a second color different from white and the first color, and the luminance of a third color different from white, the first color, and the second color based on the luminance detected by the clear pixels.

[0257] (19) An imaging device including a plurality of pixel units, Each of the pixel units includes a plurality of first pixels and a plurality of second pixels; Each of the plurality of first pixels includes a color filter region having a first area; Each of the plurality of second pixels includes a color filter region having a second area smaller than the first area; An imaging device, wherein in at least one pixel unit among the plurality of pixel units, each of the plurality of second pixels includes a polarizing filter or a neutral density filter, and each of the plurality of first pixels does not include a polarizing filter or a neutral density filter.

[0258] (20) The imaging device according to (19), wherein the at least one pixel unit comprises the plurality of first pixels including at least one clear pixel, and the plurality of second pixels including no clear pixel.

[0259] (twenty one) the color filter region included in the clear pixel is a region including a white color filter or a region including no color filter; The color filter region included in the pixel other than the clear pixel is a region including a color filter of a color other than white. The imaging device according to (20).

[0260] (twenty two) An imaging device including a plurality of pixel units, Each of the pixel units includes a plurality of first pixels and a plurality of second pixels; each of the first pixels and the second pixels includes a color filter region having a first area; In each of the pixel units, the number of the first pixels is greater than the number of the second pixels; An imaging device, wherein at least one pixel unit of the plurality of pixel units comprises the plurality of first pixels including at least one clear pixel and the plurality of second pixels including no clear pixel.

[0261] (twenty three) In each of the pixel units, the number of the first pixels is N times the number of the second pixels (N is an integer equal to or greater than 2); The imaging device according to (22), wherein the at least one pixel unit comprises the plurality of first pixels including at least N clear pixels, and the plurality of second pixels including no clear pixels.

[0262] (twenty four) The imaging device according to (22), wherein in the at least one pixel unit, each of the plurality of second pixels includes a polarizing filter or a neutral density filter.

[0263] (twenty five) The imaging device according to (24), wherein in the at least one pixel unit, each of the plurality of first pixels does not include a polarizing filter and a neutral density filter. [Explanation of symbols]

[0264] 1: pixel, 1a: main pixel, 1b: sub-pixel, 2: pixel array, 3: control circuit, 4: vertical drive circuit, 5: column signal processing circuit, 6: horizontal drive circuit; 7: output circuit; 8: vertical signal line; 9: horizontal signal line; 11: Substrate, 11a: N-type region, 11b: P-type region, 11c: p+ type region, 11d: p+ type region, 12: insulating film, 13: light shielding layer, 14: color filter layer, 14a: color filter, 14b: color filter, 15: lens layer, 15a: lens, 15b: lens, 16: polarizing filter layer, 16a: part, 16b: part, 17: Neutral density filter layer, 17a: Part, 17b: Part, 21: gate insulating film; 22: gate electrode; 23: interlayer insulating film; 24: Wiring layer, 25: Wiring layer, 26: Wiring layer, 27: Board

Claims

1. An imaging device including a plurality of pixel units, Each of the pixel units includes a plurality of first pixels and a plurality of second pixels; Each of the plurality of first pixels includes a color filter region having a first area; Each of the second pixels includes a color filter region having a second area smaller than the first area; An imaging device, wherein at least one pixel unit of the plurality of pixel units comprises the plurality of first pixels including at least one clear pixel and the plurality of second pixels including no clear pixel.

2. the color filter region included in the clear pixel is a region including a white color filter or a region including no color filter; The color filter region included in the pixel other than the clear pixel is a region including a color filter of a color other than white. The imaging device according to claim 1 .

3. the color filter region having the first area has an octagonal shape in a plan view, The color filter region having the second area has a rectangular shape in a plan view. The imaging device according to claim 1 .

4. 2. The imaging device of claim 1, wherein the at least one pixel unit comprises, as the plurality of first pixels, at least one clear pixel, a pixel of a first color different from white, a pixel of a second color different from white and the first color, and a pixel of a third color different from white, the first color, and the second color.

5. The imaging device according to claim 4 , wherein the at least one pixel unit includes, as the plurality of second pixels, a pixel of the first color, a pixel of the second color, and a pixel of the third color.

6. 2 . The imaging device of claim 1 , wherein the at least one pixel unit comprises, as the plurality of first pixels, at least two clear pixels, a pixel of a first color different from white, and a pixel of a second color different from white and the first color.

7. 7. The imaging device of claim 6, wherein the at least one pixel unit comprises, as the plurality of second pixels, a pixel of the first color, a pixel of the second color, and a pixel of a third color different from white, the first color, and the second color.

8. The imaging device according to claim 1 , wherein in the at least one pixel unit, each of the second pixels includes a polarizing filter or a neutral density filter.

9. The imaging device according to claim 8 , wherein in the at least one pixel unit, each of the plurality of first pixels does not include a polarizing filter and a neutral density filter.

10. 9. The imaging device of claim 8, wherein the at least one pixel unit includes, as the plurality of second pixels, a pixel including a polarizing filter that transmits polarized light vibrating in a first direction, and a pixel including a polarizing filter that transmits polarized light vibrating in a second direction different from the first direction.

11. The imaging device of claim 10 , wherein the second direction is different from the first direction by 90 degrees.

12. 11. The imaging device of claim 10, wherein the at least one pixel unit further comprises, as the plurality of second pixels, a pixel including a polarizing filter that transmits polarized light vibrating in a third direction different from the first and second directions, and a pixel including a polarizing filter that transmits polarized light vibrating in a fourth direction different from the first, second, and third directions.

13. The imaging device of claim 12 , wherein each of the third and fourth directions differs from each of the first and second directions by 45 degrees.

14. 9. The imaging device of claim 8, wherein the plurality of pixel units include, as the plurality of second pixels, a pixel including a polarizing filter that transmits polarized light vibrating in a first direction, and a pixel including a polarizing filter that transmits polarized light vibrating in a second direction different from the first direction.

15. 15. The imaging device of claim 14, wherein the plurality of pixel units further comprises, as the plurality of second pixels, a pixel including a polarizing filter that transmits polarized light vibrating in a third direction different from the first and second directions, and a pixel including a polarizing filter that transmits polarized light vibrating in a fourth direction different from the first, second, and third directions.

16. The imaging device according to claim 8 , wherein in the plurality of pixel units, each of the plurality of second pixels includes a polarizing filter that transmits polarized light vibrating in a first direction.

17. a first calculation unit that calculates a luminance of light incident on each pixel unit for a plurality of colors based on the luminance detected by the plurality of first pixels of each pixel unit; a second calculation unit that calculates a luminance of light incident on each pixel unit for a plurality of colors based on the luminance detected by the plurality of second pixels of each pixel unit; The imaging device according to claim 1 , further comprising:

18. 18. The imaging device of claim 17, wherein the first calculation unit calculates a luminance of a first color different from white, a luminance of a second color different from white and the first color, and a luminance of a third color different from white, the first color, and the second color, based on the luminance detected by the clear pixels.

19. An imaging device including a plurality of pixel units, Each of the pixel units includes a plurality of first pixels and a plurality of second pixels; Each of the plurality of first pixels includes a color filter region having a first area; Each of the second pixels includes a color filter region having a second area smaller than the first area; An imaging device, wherein in at least one pixel unit among the plurality of pixel units, each of the plurality of second pixels includes a polarizing filter or a neutral density filter, and each of the plurality of first pixels does not include a polarizing filter or a neutral density filter.

20. 20. The imaging device of claim 19, wherein the at least one pixel unit comprises the first plurality of pixels including at least one clear pixel and the second plurality of pixels including no clear pixel.

21. the color filter region included in the clear pixel is a region including a white color filter or a region including no color filter; The color filter region included in the pixel other than the clear pixel is a region including a color filter of a color other than white. The imaging device according to claim 20.

22. An imaging device including a plurality of pixel units, Each of the pixel units includes a plurality of first pixels and a plurality of second pixels; Each of the first pixels and the second pixels includes a color filter region having a first area; In each of the plurality of pixel units, the number of the plurality of first pixels is greater than the number of the plurality of second pixels; An imaging device, wherein at least one pixel unit of the plurality of pixel units comprises the plurality of first pixels including at least one clear pixel and the plurality of second pixels including no clear pixel.

23. In each of the plurality of pixel units, the number of the plurality of first pixels is N times the number of the plurality of second pixels (N is an integer equal to or greater than 2); 23. The imaging device of claim 22, wherein the at least one pixel unit comprises the first plurality of pixels including at least N clear pixels and the second plurality of pixels including no clear pixels.

24. The imaging device of claim 22 , wherein in the at least one pixel unit, each of the second pixels includes a polarizing filter or a neutral density filter.

25. The imaging device of claim 24 , wherein in the at least one pixel unit, each of the plurality of first pixels does not include a polarizing filter and a neutral density filter.

Images