Image Sensors and Cameras

Abstract

An image sensor (IS) includes a plurality of pixel blocks (PB) to which mutually different colors are allocated. Each of the plurality of pixel blocks (PB) includes a plurality of pixels (PX). The plurality of pixels (PX) provided in at least one pixel block (PB) among the plurality of pixel blocks (PB) includes at least one unique pixel (UPX). The unique pixels (UPX) detect light of at least one color allocated to at least one other pixel block (PB).

Description

[Technical field]

[0001] The present invention relates to an image sensor and a camera. [Background technology]

[0002] A method known as a method for increasing the sensitivity of an image sensor is called binning, which is a technology that groups multiple adjacent pixels together and treats them as a single virtual pixel.

[0003] Patent documents 1 to 3 disclose image sensors in which a plurality of pixel blocks are arranged according to a Bayer array. Each pixel block includes a plurality of pixels arranged in a matrix. During binning, detection values ​​(pixel signals) of a plurality of pixels belonging to the same pixel block are added together and output as a total detection value of one pixel block. Then, demosaicing is performed on the total detection value of each pixel block, and color information (information on the color value of each color) for each pixel block is estimated. In a normal mode in which binning is not performed, demosaicing is performed on the detection value of each pixel, and color information for each pixel is estimated. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2010-239337 A [Patent Document 2] JP 2019-012968 A [Patent Document 3] JP 2007-235888 A Summary of the Invention [Problem to be solved by the invention]

[0005] In the conventional pixel array described above, the color sampling interval increases according to the size of the pixel block. When the size of the pixel block increases, it becomes difficult to accurately estimate the color information of each pixel by the demosaic process, and color reproducibility may decrease.

[0006] Therefore, the present disclosure proposes an image sensor and a camera with high sensitivity and excellent color reproducibility. [Means for solving the problem]

[0007] According to the present disclosure, there is provided an image sensor and a camera having a plurality of pixel blocks assigned different colors, each of the plurality of pixel blocks including a plurality of pixels, and the plurality of pixels provided in at least one of the plurality of pixel blocks including one or more unique pixels that detect light of one or more colors assigned to one or more other pixel blocks. [Brief description of the drawings]

[0008] [Figure 1] FIG. 2 is a schematic diagram of a camera. [Diagram 2] FIG. 1 illustrates an example of a configuration of an image sensor. [Diagram 3] FIG. 2 is a diagram showing a configuration of a pixel array section of the image sensor according to the first embodiment. [Figure 4] FIG. 13 is a diagram showing a configuration of a pixel array portion of an image sensor according to a second embodiment. [Diagram 5] FIG. 13 is a diagram showing a configuration of a pixel array portion of an image sensor according to a third embodiment. [Figure 6] FIG. 4 is a diagram showing exposure timing of each pixel. [Figure 7] FIG. 13 is a diagram showing a configuration of a pixel array portion of an image sensor according to a fourth embodiment. [Figure 8] FIG. 13 is a diagram showing a configuration of a pixel array portion of an image sensor according to a fifth embodiment. [Figure 9] FIG. 11 is a diagram illustrating an example of a method for estimating color information. [Figure 10]FIG. 13 is a diagram showing a configuration of a pixel array portion of an image sensor according to a sixth embodiment. [Figure 11] FIG. 13 is a diagram showing a configuration of a pixel array portion of an image sensor according to a seventh embodiment. [Figure 12] FIG. 13 is a diagram showing a configuration of a pixel array portion of an image sensor according to an eighth embodiment. [Figure 13] 11A and 11B are diagrams illustrating comparison results of variations of a pixel array unit. [Figure 14] 11A to 11C are diagrams illustrating variations in the arrangement of anomalous pixels. [Figure 15] 11A to 11C are diagrams illustrating variations in the arrangement of anomalous pixels. [Figure 16] 11A to 11C are diagrams illustrating variations in the arrangement of anomalous pixels. [Figure 17] 11A to 11C are diagrams illustrating variations in the arrangement of anomalous pixels. [Figure 18] 11A to 11C are diagrams illustrating variations in the arrangement of anomalous pixels. [Figure 19] 13A and 13B are diagrams showing other variations of the pixel array portion. [Figure 20] 13A and 13B are diagrams showing other variations of the pixel array portion. [Figure 21] 13A and 13B are diagrams showing other variations of the pixel array portion. [Figure 22] 13A and 13B are diagrams showing other variations of the pixel array portion. [Figure 23] 13A and 13B are diagrams showing other variations of the pixel array portion. [Figure 24] 13A and 13B are diagrams showing other variations of the pixel array portion. [Diagram 25] 13A and 13B are diagrams showing other variations of the pixel array portion. [Figure 26] 13A and 13B are diagrams showing other variations of the pixel array portion. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0009] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In the following embodiments, the same components are designated by the same reference numerals, and duplicated descriptions will be omitted.

[0010] The explanation will be given in the following order. [1. Camera and image sensor configuration] [2. Image Sensor of First Embodiment] [2-1. Pixel structure] [2-2. Operation in normal mode] [2-3. Binning mode operation] [2-4. Effects] [3. Image Sensor of Second Embodiment] [4. Image Sensor of Third Embodiment] [5. Image Sensor of Fourth Embodiment] [6. Image Sensor of Fifth Embodiment] [7. Image Sensor of Sixth Embodiment] [8. Image Sensor of Seventh Embodiment] [9. Image Sensor of Eighth Embodiment] [10. Variations in the arrangement of anomalous pixels] [11. Other variations of the pixel array]

[0011] [1. Camera and image sensor configuration] FIG. 1 is a schematic diagram of a camera CA.

[0012] The camera CA has a lens LE, a UV / IR cut filter UVF, a low-pass filter LPF, and an image sensor IS. The UV / IR cut filter UVF cuts out ultraviolet and infrared rays. The low-pass filter LPF passes only light with wavelengths necessary for image information and cuts out other light. The low-pass filter LPF intentionally blurs the image captured by the lens LE to suppress the occurrence of moire and false colors.

[0013] The image sensor IS converts the light incident from the lens LE into an electrical signal. The image sensor IS has, for example, a lens array LA, a color filter array CFA, and a sensor plate SP. The sensor plate SP has a plurality of light source conversion elements (photodiodes) PD arranged two-dimensionally. The light source conversion elements PD photoelectrically convert an amount of charge according to the amount of incident light, accumulate the charge internally, and output it as a signal. The color filter array CFA has a plurality of color filters CF arranged in one-to-one correspondence with the plurality of light receiving elements PD. The lens array LA has a plurality of microlenses ML that focus the light incident from the lens LE onto the plurality of light receiving elements PD.

[0014] As the image sensor IS, for example, a CMOS (Complementary Metal Oxide Semiconductor) image sensor and a CCD (Charge-Coupled Device) image sensor are used. As the color filter array CFA, for example, a primary color filter array and a complementary color filter array are used. The primary color filter array has three color filters CF of red, green, and blue. The complementary color filter array has four color filters CF of cyan, yellow, magenta, and green. In this embodiment, a CMOS image sensor using a primary color filter array is used. The camera CA is used for a wide range of applications, such as in-vehicle use.

[0015] FIG. 2 is a diagram showing an example of the configuration of the image sensor IS.

[0016] The image sensor IS includes a pixel array unit PA, a vertical drive unit VD, a column readout circuit unit CRC, a column signal processing unit CSP, a horizontal drive unit HD, a system control unit SC, and a signal processing unit SP. The pixel array unit PA, the vertical drive unit VD, the column readout circuit unit CRC, the column signal processing unit CSP, the horizontal drive unit HD, the system control unit SC, and the signal processing unit SP are realized by a processing circuit PR such as an IC (Integrated Circuit) formed on the sensor plate SP.

[0017] The pixel array section PA has a plurality of pixels PX arranged two-dimensionally. Each pixel PX includes a photoelectric conversion element PD and a color filter CF. In the pixel array section PA, a plurality of pixel drive lines LD extending in the horizontal direction (row direction: left-right direction in the figure) and a plurality of vertical pixel wirings LV extending in the vertical direction (column direction: up-down direction in the figure) are provided in a lattice pattern. The pixel drive lines LD are provided for each pixel row extending in the horizontal direction. The vertical pixel wirings LV are provided for each pixel column extending in the vertical direction. One end of the pixel drive line LD is connected to an output terminal corresponding to each row of the vertical drive section VD.

[0018] The column readout circuit unit CRC includes at least a circuit for supplying a constant current to the pixels PX in a selected row in the pixel array unit PA for each column, a current mirror circuit, a switch for changing over the pixels PX to be read out, etc. The column readout circuit unit CRC configures an amplifier together with the transistor in the selected pixel in the pixel array unit PA, converts the photocharge signal into a voltage signal, and outputs it to the vertical pixel wiring LV.

[0019] The vertical driving unit VD includes a shift register, an address decoder, etc. The vertical driving unit VD drives each pixel PX of the pixel array unit PA on a row-by-row basis. Although the specific configuration is not shown in the figure, the vertical driving unit VD has a readout scanning system and a sweep scanning system or a batch sweep and batch transfer system.

[0020] The readout scanning system sequentially selects and scans the pixels PX of the pixel array section PA row by row in order to read out pixel signals from the pixels PX. In the case of row drive (rolling shutter operation), for the readout row on which the readout scanning system performs readout scanning, the sweeping scan is performed a time period equal to the shutter speed prior to the readout scanning. In the case of global exposure (global shutter operation), the collective sweeping is performed a time period equal to the shutter speed prior to the collective transfer. This sweeping sweeping sweeps out (resets) unnecessary charges from the photodiodes PD of the pixels PX of the readout row. The sweeping out (resetting) of unnecessary charges performs a so-called electronic shutter operation.

[0021] Here, the electronic shutter operation refers to an operation of discarding unnecessary photoelectric charges that have been accumulated in the photodiode PD until immediately before and starting a new exposure (starting the accumulation of photoelectric charges).

[0022] The signal read by the readout operation by the readout scanning system corresponds to the amount of light that has entered since the previous readout operation or electronic shutter operation. In the case of row driving, the period from the readout timing of the previous readout operation or the sweep timing of the electronic shutter operation to the readout timing of the current readout operation is the accumulation time (exposure time) of the photocharge in the pixel PX. In the case of global exposure, the time from the collective sweep to the collective transfer is the accumulation time (exposure time).

[0023] The pixel signals output from each pixel PX in a pixel row selected and scanned by the vertical drive unit VD are supplied to a column signal processor CSP through each vertical pixel wiring LV. The column signal processor CSP performs predetermined signal processing on the pixel signals output from each pixel PX in the selected row through the vertical pixel wiring LV for each pixel column in the pixel array unit PA, and temporarily holds the pixel signals after signal processing.

[0024] Specifically, the column signal processor CSP performs at least a noise removal process, such as a correlated double sampling (CDS) process, as signal processing. The CDS performed by the column signal processor CSP removes pixel-specific fixed pattern noise such as reset noise and threshold variation of the amplifying transistor AMP. In addition to the noise removal process, the column signal processor CSP can also be configured to have, for example, an AD conversion function and output the pixel signal as a digital signal.

[0025] The horizontal driving unit HD includes a shift register, an address decoder, etc. The horizontal driving unit HD sequentially selects the unit circuits corresponding to the pixel columns of the column signal processing unit CSP. By selective scanning by the horizontal driving unit HD, the pixel signals processed by the column signal processing unit CSP are sequentially output to the signal processing unit SP.

[0026] The system control unit SC includes a timing generator that generates various timing signals, etc. The system control unit SC controls the driving of the vertical driving unit VD, the column signal processing unit CSP, the horizontal driving unit HD, etc. based on the various timing signals generated by the timing generator.

[0027] The image sensor IS further includes a signal processing unit SP and a data storage unit (not shown). The signal processing unit SP has at least an addition processing function and performs various signal processing such as addition processing on pixel signals output from the column signal processing unit CSP. The data storage unit temporarily stores data required for signal processing in the signal processing unit SP. The processing of the signal processing unit SP and the data storage unit may be substituted by an external signal processing unit provided on a board separate from the image sensor IS, such as a DSP (Digital Signal Processor) or software.

[0028] [2. Image Sensor of First Embodiment] [2-1. Pixel structure] FIG. 3 is a diagram showing the configuration of a pixel array unit PA1 of the image sensor IS1 according to the first embodiment.

[0029] The image sensor IS1 has a plurality of pixel blocks PB to which different colors are assigned. The pixel block PB is a pixel group including a group of pixels PX to be subjected to binning. Each of the plurality of pixel blocks PB includes a plurality of pixels PX. "Assigned a color" means that the detection value of the pixel block PB, which is treated as one virtual pixel in the binning mode, is treated as a color value of the assigned color.

[0030] Each of the pixel blocks PB mainly includes a plurality of pixels PX that detect light of the assigned color. "Mainly includes" means that the number of pixels PX that detect light of the assigned color is the largest.

[0031] The pixels PX provided in at least one pixel block PB among the pixel blocks PB include one or more anomalous pixels UPX. The anomalous pixel UPX is a pixel PX that detects light of one or more colors assigned to one or more other pixel blocks PB to which the anomalous pixel UPX does not belong.

[0032] 3, the pixel blocks PB include a red pixel block PB1 to which the color red is assigned, a green pixel block PB2 to which the color green is assigned, and a blue pixel block PB3 to which the color blue is assigned. The red pixel block PB1, the green pixel block PB2, and the blue pixel block PB3 are arranged according to a Bayer array pattern.

[0033] Each of the pixel blocks PB is, for example, N rows and N columns (N is an integer of 3 or more) arranged in the horizontal and vertical directions. 2 3, each pixel block PB includes nine pixels PX arranged in three rows and three columns (N=3).

[0034] The red pixel block PB1 includes, for example, one peculiar pixel UPX1A. The peculiar pixel UPX1A is located, for example, in the center of the red pixel block PB1. The peculiar pixel UPX1A detects, for example, blue light assigned to the blue pixel block PB3. The blue pixel block PB3 includes, for example, one peculiar pixel UPX3A. The peculiar pixel UPX3A is located, for example, in the center of the blue pixel block PB3. The peculiar pixel UPX3A detects, for example, red light assigned to the red pixel block PB1. The green pixel block PB2 does not include the peculiar pixel UPX. The number of peculiar pixels UPX included in one pixel block PB may be two or more.

[0035] [2-2. Operation in normal mode] The signal processing unit SP performs demosaicing on the detection value of each pixel PX. The demosaicing is a process of complementing missing color information for each pixel PX based on the detection values ​​of the surrounding pixels PX. The demosaicing can be performed by various known methods. A simple method is a linear interpolation method using the detection values ​​of multiple nearby pixels PX that are responsible for the same color. The color information of each pixel PX may be estimated using a machine learning technique. For example, the signal processing unit SP can estimate the color value of each color for each pixel PX from the detection value of each pixel PX using an analysis model that has been machine-learned to learn the relationship between a known luminance distribution and the detection value of each pixel PX.

[0036] The red pixel block PB1 includes an anomalous pixel UPX1A that detects blue. The blue pixel block PB3 includes an anomalous pixel UPX3A that detects red. This reduces the sampling interval between red and blue. As a result, the color information of each pixel PX is calculated with high accuracy by the demosaic process. As a result, the color reproducibility is improved in the normal mode.

[0037] [2-3. Binning mode operation] The signal processor SP treats each pixel block PB as a single virtual pixel. The signal processor SP detects the detection values ​​of the multiple pixel blocks PB as color values ​​of the colors respectively assigned to the multiple pixel blocks PB, and performs demosaic processing. Since multiple pixels PX are treated as a single virtual pixel, the detection sensitivity is improved. As a result, images with less noise can be captured even in dark environments.

[0038] For example, the signal processing unit SP adds up the detection values ​​of multiple pixels PX in the same pixel block PB that includes one or more anomalous pixels UPX. The signal processing unit SP performs color correction on the total detection value obtained by the addition using the linear matrix of the following formula (1). Color correction is a process that corrects color shifts caused by adding the detection value of the anomalous pixel UPX to the detection values ​​of the other pixels PX. The signal processing unit SP detects the color-corrected total detection value as the color value of the color assigned to the pixel block PB, and performs demosaic processing.

[0039]

number

[0040] In formula (1), R, G, B are the total detection values ​​of the red pixel block PB1, green pixel block PB2, and blue pixel block PB3. R', G', B' are the corrected color values ​​of the red pixel block PB1, green pixel block PB2, and blue pixel block PB3. The linear matrix coefficients (Rr, Rg, Rb, Gr, Gg, Gb, Br, Bg, Bb) are determined by the spectral transmittance of the color filter CF and the area ratio of the anomalous pixel region (the region where the anomalous pixel UPX is located) to the non-anomalous pixel region (the region where multiple pixels PX other than the anomalous pixel UPX are located) in one pixel block PB.

[0041] In order to suppress color shifts caused by the anomalous pixel UPX, the signal processor SP can also choose not to add the detection value of the anomalous pixel UPX to the detection values ​​of the other pixels PX. For example, the signal processor SP adds together the detection values ​​of multiple pixels PX in the same pixel block PB excluding one or more anomalous pixels UPX. The signal processor SP detects the total detection value obtained by the addition as the color value of the color assigned to the pixel block PB, and performs demosaic processing.

[0042] [2-4. Effects] The image sensor IS1 has a plurality of pixel blocks PB to which different colors are assigned. Each of the plurality of pixel blocks PB includes a plurality of pixels PX. The plurality of pixels PX provided in at least one pixel block PB among the plurality of pixel blocks PB include one or more peculiar pixels UPX. Each of the one or more peculiar pixels UPX detects light of one or more colors assigned to one or more other pixel blocks PB. The camera CA has the image sensor IS1 described above.

[0043] According to this configuration, the color sampling interval is reduced. Therefore, the color information of each pixel PX is calculated with high accuracy by demosaic processing. The color reproducibility is improved in the normal mode in which binning is not performed. Therefore, an image sensor IS1 and a camera CA with high sensitivity and high color reproducibility are provided.

[0044] The image sensor IS1 includes, for example, a processing circuit PR. The processing circuit PR detects detection values ​​of a plurality of pixel blocks PB as color values ​​of colors respectively assigned to the plurality of pixel blocks PB in, for example, a binning mode.

[0045] With this configuration, the pixel block PB is treated as a single virtual pixel, which increases detection sensitivity, resulting in images with less noise even in dark environments.

[0046] For example, in a binning mode, the processing circuit PR adds up the detection values ​​of a plurality of pixels PX in the same pixel block PB including one or more anomalous pixels UPX. The processing circuit PR performs color correction on the total detection value obtained by the addition. The processing circuit PR detects the color-corrected total detection value as the color value of the color assigned to the pixel block PB.

[0047] This configuration improves color reproducibility in the binning mode.

[0048] For example, in a binning mode, the processing circuit PR adds up the detection values ​​of the pixels PX in the same pixel block PB, excluding one or more anomalous pixels UPX. The processing circuit PR detects the total detection value obtained by the addition as the color value of the color assigned to the pixel block PB.

[0049] This configuration improves color reproducibility in the binning mode.

[0050] Each of the pixel blocks PB is, for example, N pixels arranged in N rows and N columns (N is an integer of 3 or more). 2 It contains pixels PX.

[0051] This configuration provides high sensitivity in the binning mode.

[0052] The pixel blocks PB include, for example, a red pixel block PB1 to which red is assigned, a green pixel block PB2 to which green is assigned, and a blue pixel block PB3 to which blue is assigned. The red pixel block PB1, the green pixel block PB2, and the blue pixel block PB3 are arranged, for example, according to a Bayer array pattern.

[0053] This configuration provides high resolution for green, thereby improving visual resolution.

[0054] [3. Image Sensor of Second Embodiment] 4 is a diagram showing the configuration of a pixel array unit PA2 of an image sensor IS2 according to the second embodiment. This embodiment differs from the first embodiment in that the anomalous pixel UPX is provided only in the green pixel block PB2. The red pixel block PB1 and the blue pixel block PB3 do not include the anomalous pixel UPX. The following description will focus on the differences from the first embodiment.

[0055] The image sensor IS2 has, for example, a first green pixel block PB2A and a second green pixel block PB2B as the green pixel block PB2. The first green pixel block PB2A includes, for example, one peculiar pixel UPX2A. The peculiar pixel UPX2A is located, for example, in the center of the first green pixel block PB2A. The peculiar pixel UPX2A detects, for example, red light assigned to the red pixel block PB1. The second green pixel block PB2B includes, for example, one peculiar pixel UPX2B. The peculiar pixel UPX2B is located, for example, in the center of the second green pixel block PB2B. The peculiar pixel UPX2B detects, for example, blue light assigned to the blue pixel block PB3. The first green pixel block PB2A and the second green pixel block PB2B are alternately arranged, for example, in the horizontal and vertical directions. The number of peculiar pixels UPX included in one pixel block PB may be two or more.

[0056] In this embodiment, the sampling intervals for red and blue are also reduced. Therefore, the color information of each pixel PX is calculated with high accuracy by demosaic processing. As a result, the color reproducibility is improved in the normal mode.

[0057] [4. Image Sensor of Third Embodiment] 5 is a diagram showing the configuration of a pixel array unit PA3 of an image sensor IS3 of the third embodiment. This embodiment differs from the first embodiment in that the anomalous pixel UPX detects light of two or more colors selected from a plurality of colors assigned to a plurality of pixel blocks PB. The anomalous pixel UPX selectively detects, for example, light of a color assigned to the pixel block PB to which the anomalous pixel UPX belongs and light of a color assigned to a pixel block PB to which the anomalous pixel UPX does not belong. The following description will focus on the differences from the first embodiment.

[0058] The red pixel block PB1 includes, for example, one peculiar pixel UPX1B. The peculiar pixel UPX1B is located, for example, in the center of the red pixel block PB1. The peculiar pixel UPX1B detects, for example, red light assigned to the red pixel block PB1 and blue light assigned to the blue pixel block PB3. The blue pixel block PB3 includes, for example, one peculiar pixel UPX3B. The peculiar pixel UPX3B is located, for example, in the center of the blue pixel block PB3. The peculiar pixel UPX3B detects, for example, red light assigned to the red pixel block PB1 and blue light assigned to the blue pixel block PB3. The green pixel block PB2 does not include the peculiar pixel UPX. The number of peculiar pixels UPX included in one pixel block PB may be two or more. The number of colors detected in the peculiar pixel UPX may be more than two.

[0059] The peculiar pixel UPX detects light of two or more colors. Therefore, the signal processing unit SA estimates the color values ​​of the two or more colors detected in the peculiar pixel UPX, for example, by using color information of the pixels PX surrounding the peculiar pixel UPX. For example, the signal processing unit SA estimates the red color value to be detected in the peculiar pixel UPX1B based on the detection values ​​of the pixels PX other than the peculiar pixel UPX1B in the red pixel block PB1. The signal processing unit SA estimates the blue color value to be detected in the peculiar pixel UPX1B by subtracting the estimated red color value from the detection value (including the red color value and the blue color value) of the peculiar pixel UPX1B. The red color value and blue color value to be detected in the peculiar pixel UPX3B are also estimated in a similar manner.

[0060] In this embodiment, one peculiar pixel UPX detects light of two or more colors. Therefore, the sampling interval of the two or more colors is reduced. The sensitivity in the binning mode is also increased. In addition, the peculiar pixel UPX detects light of two or more colors including the color assigned to the pixel block PB to which the peculiar pixel UPX belongs. Therefore, the color reproducibility in the normal mode is high.

[0061] The peculiar pixel UPX detects light of two or more colors. Therefore, the pixel signal is more likely to become saturated than the other pixels PX that detect only one color of light. Therefore, the processing circuit PR, for example, makes the exposure time of the peculiar pixel UPX shorter than the exposure time of the other pixels PX.

[0062] FIG. 6 is a diagram showing the exposure timing of each pixel PX.

[0063] The exposure start timing of the peculiar pixel UPX in the center of the pixel block PB is later than the exposure start timing of the pixels PX other than the peculiar pixel UPX. The exposure end timing is the same for the peculiar pixel UPX and the pixels PX other than the peculiar pixel UPX. Therefore, the exposure time of the peculiar pixel UPX is shorter than the exposure time of the pixels PX other than the peculiar pixel UPX. The exposure time of the peculiar pixel UPX is set to, for example, half the exposure time of the pixels PX other than the peculiar pixel UPX. Therefore, saturation of the pixel signal of the peculiar pixel UPX is suppressed.

[0064] [5. Image Sensor of Fourth Embodiment] 7 is a diagram showing the configuration of a pixel array unit PA4 of an image sensor IS4 of a fourth embodiment. This embodiment differs from the second embodiment in that the anomalous pixel UPX detects light of two or more colors selected from a plurality of colors assigned to a plurality of pixel blocks PB. The anomalous pixel UPX selectively detects, for example, light of a color assigned to the pixel block PB to which the anomalous pixel UPX belongs and light of a color assigned to a pixel block PB to which the anomalous pixel UPX does not belong. The following description will focus on the differences from the second embodiment.

[0065] The first green pixel block PB2A includes, for example, one peculiar pixel UPX2C. The peculiar pixel UPX2C is located, for example, in the center of the first green pixel block PB2A. The peculiar pixel UPX2C detects, for example, red light assigned to the red pixel block PB1 and green light assigned to the green pixel block PB2. The second green pixel block PB2B includes, for example, one peculiar pixel UPX2D. The peculiar pixel UPX2D is located, for example, in the center of the second green pixel block PB2B. The peculiar pixel UPX2D detects, for example, green light assigned to the green pixel block PB2 and blue light assigned to the blue pixel block PB3. The first green pixel block PB2A and the second green pixel block PB2B are arranged alternately in, for example, the horizontal and vertical directions. The number of peculiar pixels UPX included in one pixel block PB may be two or more.

[0066] The peculiar pixel UPX detects light of two or more colors. Therefore, the signal processing unit SA estimates the color values ​​of the two or more colors detected in the peculiar pixel UPX, for example, by using color information of the pixels PX surrounding the peculiar pixel UPX. For example, the signal processing unit SA estimates the green color value to be detected in the peculiar pixel UPX2C based on the detection values ​​of the pixels PX other than the peculiar pixel UPX2C in the first green pixel block PB2A. The signal processing unit SA estimates the red color value to be detected in the peculiar pixel UPX2C by subtracting the estimated green color value from the detection value (including the red color value and the green color value) of the peculiar pixel UPX2C. The green color value and blue color value to be detected in the peculiar pixel UPX2D are also estimated in a similar manner.

[0067] The processing circuit PR, for example, sets the exposure time of the peculiar pixel UPX shorter than the exposure time of the other pixels PX, thereby preventing the pixel signal of the peculiar pixel UPX from becoming saturated.

[0068] In this embodiment, one peculiar pixel UPX also detects light of two or more colors. Therefore, the sampling interval of the two or more colors is reduced. The sensitivity in the binning mode is also increased. Moreover, the peculiar pixel UPX detects light of two or more colors including the color assigned to the pixel block PB to which the peculiar pixel UPX belongs. Therefore, the color reproducibility in the normal mode is high.

[0069] [6. Image Sensor of Fifth Embodiment] FIG. 8 is a diagram showing the configuration of a pixel array unit PA5 of an image sensor IS5 of the fifth embodiment. The present embodiment differs from the first embodiment in that the anomalous pixel UPX is provided in the green pixel block PB2 in addition to the red pixel block PB1 and the blue pixel block PB3. One or more anomalous pixels UPX are included in each pixel block PB. The anomalous pixel UPX2E provided in the green pixel block PB2 detects light of two or more colors selected from a plurality of colors assigned to the plurality of pixel blocks PB. The anomalous pixel UPX2E selectively detects light of two or more colors assigned to two or more pixel blocks PB to which the anomalous pixel UPX does not belong. The following description will focus on the differences from the first embodiment.

[0070] The green pixel block PB2 includes, for example, one peculiar pixel UPX2E. The peculiar pixel UPX2E is located, for example, in the center of the green pixel block PB2. The peculiar pixel UPX2E detects, for example, red light assigned to the red pixel block PB1 and blue light assigned to the blue pixel block PB3. The peculiar pixel UPX2E detects magenta light, which is complementary to green light assigned to the green pixel block PB2 to which the peculiar pixel UPX2E belongs. The number of peculiar pixels UPX2E included in one green pixel block PB2 may be two or more. The number of colors detected by the peculiar pixel UPX2E may be more than two.

[0071] The peculiar pixel UPX2E detects light of two or more colors. Therefore, the signal processing unit SA estimates the color values ​​of the two or more colors detected in the peculiar pixel UPX2E, for example, by using color information of the pixels PX surrounding the peculiar pixel UPX2E. For example, the signal processing unit SA estimates the red color value and blue color value to be detected in the peculiar pixel UPX2E based on the detection values ​​of the red pixels PX and blue pixels PX detected in the red pixel block PB1 and blue pixel block PB3 surrounding the green pixel block PB2.

[0072] The signal processor SA can estimate the red and blue color values ​​of each pixel PX in the green pixel block PB2 with high accuracy by, for example, comparing the sum of the estimated red and blue color values ​​with the detected value (including the red and blue color values). The color information of the other pixels PX can be estimated based on the surrounding color information with high accuracy.

[0073] FIG. 9 is a diagram illustrating an example of a method for estimating color information.

[0074] 9 shows a state where white light is incident on a part of the pixel array section PA5. The white light is measured as light whose red, green and blue color values ​​are all 128. The red, green and blue color values ​​of dark areas are all zero. In this case, the red, green and blue color values ​​of the anomalous pixel UPX2E shown as "A" in the figure are estimated as follows.

[0075] First, the detection values ​​of red and blue around the peculiar pixel UPX2E are obtained. In the example of Fig. 9, the red and blue color values ​​of the pixel PX above the peculiar pixel UPX2E are both 128. The red and blue color values ​​of the pixel PX to the left of the peculiar pixel UPX2E are both 128. The red and blue color values ​​of the pixel PX to the right of the peculiar pixel UPX2E are both 0. The red and blue color values ​​of the pixel PX below the peculiar pixel UPX2E are both 0.

[0076] When linear interpolation is performed using the red and blue detection values ​​around the peculiar pixel UPX2E, the red and blue color values ​​of the peculiar pixel UPX2E are both estimated to be 64. Therefore, the detection value (the sum of the red color value and the blue color value) of the peculiar pixel UPX2E is estimated to be 128. However, the actual detection value of the peculiar pixel UPX2E is 256 (the sum of the red color value 128 and the blue color value 128). It is understood that the estimated red and blue color values ​​should be corrected to larger values. Therefore, the signal processor SP performs processing to increase or decrease the estimated red color value and the estimated blue color value, for example, while maintaining the ratio between the estimated red color value and the estimated blue color value, so that the sum of the estimated red color value and the estimated blue color value becomes the same value as the actual detection value (the sum of the red color value and the blue color value). Note that the estimation and correction of the color values ​​may be performed using a machine learning technique.

[0077] The processing circuit PR, for example, sets the exposure time of the peculiar pixel UPX2E shorter than the exposure time of the other pixels PX, thereby preventing the pixel signal of the peculiar pixel UPX2E from becoming saturated.

[0078] In this embodiment, all pixel blocks PB include one or more anomalous pixels UPX. Therefore, the sampling interval is reduced for all colors assigned to the multiple pixel blocks PB. The sensitivity in the binning mode is also increased. In addition, the green pixel block PB2 is provided with a anomalous pixel UPX2E that detects red and blue light, thereby improving the resolution of red and blue. In addition, the anomalous pixel UPX2E selectively detects light of two or more colors that are assigned to two or more pixel blocks PB to which the anomalous pixel UPX2E does not belong. Therefore, in the normal mode, the estimation accuracy of the color values ​​of these two or more colors in the anomalous pixel UPX2E is increased.

[0079] [7. Image Sensor of Sixth Embodiment] 10 is a diagram showing the configuration of a pixel array unit PA6 of an image sensor IS6 of the sixth embodiment. The present embodiment differs from the fifth embodiment in that the anomalous pixel UPX of the red pixel block PB1 and the blue pixel block PB3 detects light of two or more colors selected from a plurality of colors assigned to the plurality of pixel blocks PB. The anomalous pixel UPX of the red pixel block PB1 and the blue pixel block PB3 selectively detects light of two or more colors assigned to two or more pixel blocks PB to which the anomalous pixel UPX does not belong, for example. The following description will focus on the differences from the fifth embodiment.

[0080] The red pixel block PB1 includes, for example, one peculiar pixel UPX1C. The peculiar pixel UPX1C is located, for example, in the center of the red pixel block PB1. The peculiar pixel UPX1C detects, for example, green light assigned to the green pixel block PB2 and blue light assigned to the blue pixel block PB3. The peculiar pixel UPX1C detects cyan light, which is complementary to the red light assigned to the red pixel block PB1 to which the peculiar pixel UPX1C belongs. The number of peculiar pixels UPX1C included in one red pixel block PB1 may be two or more. The number of colors detected by the peculiar pixel UPX1C may be more than two.

[0081] The blue pixel block PB3 includes, for example, one peculiar pixel UPX3C. The peculiar pixel UPX3C is located, for example, in the center of the blue pixel block PB3. The peculiar pixel UPX3C detects, for example, red light assigned to the red pixel block PB1 and green light assigned to the green pixel block PB2. The peculiar pixel UPX3C detects yellow light, which is complementary to the blue color assigned to the blue pixel block PB3 to which the peculiar pixel UPX3C belongs. The number of peculiar pixels UPX3C included in one blue pixel block PB3 may be two or more. The number of colors detected by the peculiar pixel UPX3C may be more than two.

[0082] The peculiar pixel UPX1C detects light of two or more colors. Therefore, the signal processing unit SA estimates the color values ​​of the two or more colors detected in the peculiar pixel UPX1C, for example, by using color information of the pixels PX surrounding the peculiar pixel UPX1C. For example, the signal processing unit SA estimates the green color value and blue color value to be detected in the peculiar pixel UPX1C based on the detection values ​​of the green pixels PX and blue pixels PX detected in the green pixel block PB2 and blue pixel block PB3 surrounding the red pixel block PB1.

[0083] The signal processor SA can estimate the green and blue color values ​​of each pixel PX in the red pixel block PB1 with high accuracy by, for example, comparing the sum of the estimated green and blue color values ​​with the detection value (including the green and blue color values). The color information of the other pixels PX can be estimated based on the surrounding color information with high accuracy.

[0084] The peculiar pixel UPX3C detects light of two or more colors. Therefore, the signal processing unit SA estimates the color values ​​of the two or more colors detected in the peculiar pixel UPX3C, for example, using color information of the pixels PX surrounding the peculiar pixel UPX3C. For example, the signal processing unit SA estimates the red color value and green color value to be detected in the peculiar pixel UPX3C based on the detection values ​​of the red pixels PX and green pixels PX detected in the red pixel block PB1 and green pixel block PB2 surrounding the blue pixel block PB3.

[0085] The signal processor SA can estimate the red and green color values ​​of each pixel PX in the blue pixel block PB3 with high accuracy by, for example, comparing the sum of the estimated red and green color values ​​with the detected value (including the red and green color values). The color information of the other pixels PX can be estimated based on the surrounding color information with high accuracy.

[0086] In this embodiment, in addition to the effects of the fifth embodiment, the following effects can be obtained. Since the red pixel block PB1 is provided with the peculiar pixel UPX1C that detects green and blue light, the resolution of green and blue is improved. Since the blue pixel block PB3 is provided with the peculiar pixel UPX3C that detects red and green light, the resolution of red and green is improved. Furthermore, the peculiar pixel UPX1C selectively detects light of two or more colors that are respectively assigned to two or more pixel blocks PB to which the peculiar pixel UPX1C does not belong. Therefore, in the normal mode, the estimation accuracy of the color values ​​of these two or more colors in the peculiar pixel UPX1C is improved. The peculiar pixel UPX3C selectively detects light of two or more colors that are respectively assigned to two or more pixel blocks PB to which the peculiar pixel UPX3C does not belong. Therefore, in the normal mode, the estimation accuracy of the color values ​​of these two or more colors in the peculiar pixel UPX3C is improved.

[0087] [8. Image Sensor of Seventh Embodiment] 11 is a diagram showing the configuration of a pixel array unit PA7 of an image sensor IS7 according to a seventh embodiment. This embodiment differs from the fifth embodiment in that an anomalous pixel UPX2F provided in a green pixel block PB2 detects light of all colors assigned to the multiple pixel blocks PB. The following description will focus on the differences from the fifth embodiment.

[0088] The green pixel block PB2 includes, for example, one peculiar pixel UPX2F. The peculiar pixel UPX2F is located, for example, in the center of the green pixel block PB2. The peculiar pixel UPX2F detects light of all colors assigned to the multiple pixel blocks PB. The light detected by the peculiar pixel UPX2F is white light containing the colors red, green, and blue. The number of peculiar pixels UPX2F included in one green pixel block PB2 may be two or more.

[0089] The peculiar pixel UPX2F detects light of three colors. Therefore, the signal processing unit SA estimates the color values ​​of the three colors detected in the peculiar pixel UPX2F, for example, using color information of the pixels PX surrounding the peculiar pixel UPX2F. For example, the signal processing unit SA estimates the green color value to be detected in the peculiar pixel UPX2F based on the detection values ​​of the pixels PX other than the peculiar pixel UPX2F in the green pixel block PB2. The signal processing unit SA subtracts the estimated green color value from the detection values ​​(including the red, green, and blue color values) of the peculiar pixel UPX2F. This estimates the sum of the red and blue color values ​​of the peculiar pixel UPX2F.

[0090] The method of estimating the red color value and the blue color value from the sum of the red color value and the blue color value is the same as that shown in the fifth embodiment.

[0091] In this embodiment, in addition to the effects of the fifth embodiment, the following effects can be obtained: The anomalous pixel UPX2F detects light of all colors assigned to the multiple pixel blocks PB, thereby achieving high sensitivity in the binning mode.

[0092] [9. Image Sensor of Eighth Embodiment] 12 is a diagram showing the configuration of a pixel array unit PA8 of an image sensor IS8 according to the eighth embodiment. This embodiment differs from the seventh embodiment in that the anomalous pixels UPX provided in all pixel blocks PB detect light of all colors assigned to the pixel blocks PB. The following description will focus on the differences from the seventh embodiment.

[0093] The red pixel block PB1 includes, for example, one peculiar pixel UPX1D. The peculiar pixel UPX1D is located, for example, in the center of the red pixel block PB1. The peculiar pixel UPX1D detects light of all colors assigned to the multiple pixel blocks PB. The light detected by the peculiar pixel UPX1D is white light containing the colors red, green, and blue. The number of peculiar pixels UPX1D included in one red pixel block PB1 may be two or more.

[0094] The blue pixel block PB3 includes, for example, one peculiar pixel UPX3D. The peculiar pixel UPX3D is located, for example, in the center of the blue pixel block PB3. The peculiar pixel UPX3D detects light of all colors assigned to the multiple pixel blocks PB. The light detected by the peculiar pixel UPX3D is white light containing the colors red, green, and blue. The number of peculiar pixels UPX3D included in one blue pixel block PB3 may be two or more.

[0095] The signal processing unit SA estimates the color values ​​of the three colors detected in the peculiar pixel UPX1D, for example, using color information of the pixels PX surrounding the peculiar pixel UPX1D. The signal processing unit SA estimates the color values ​​of the three colors detected in the peculiar pixel UPX3D, for example, using color information of the pixels PX surrounding the peculiar pixel UPX3D. The estimation method is the same as that shown in the seventh embodiment.

[0096] In addition to the effects of the seventh embodiment, the present embodiment has the following effects: The anomalous pixels UPX provided in all pixel blocks PB detect light of all colors assigned to the pixel blocks PB, thereby achieving higher sensitivity in the binning mode.

[0097] FIG. 13 is a diagram showing a comparison result of the above-mentioned variations of the pixel array unit PA.

[0098] In FIG. 13, "monochrome" indicates a configuration in which the peculiar pixel UPX selectively detects light of one color. "Complementary colors" indicates a configuration in which the peculiar pixel UPX detects light of multiple colors assigned to all pixel blocks PB other than the pixel block PB to which the peculiar pixel UPX belongs. "Original + single color" indicates a configuration in which the peculiar pixel UPX detects light of a color assigned to the pixel block PB to which the peculiar pixel UPX belongs, and light of a color assigned to another pixel block PB to which the peculiar pixel UPX does not belong. "White" indicates a configuration in which the peculiar pixel UPX detects light of all colors assigned to multiple pixel blocks PB.

[0099] The numbers (1, 2, 3, 4) in the table in Figure 13 indicate the ranking of the performance of each configuration. The configuration with a number of 1 has the best performance. As shown in Figure 13, the red and blue resolution is highest with the "monochrome" configuration. The sensitivity in the binning mode is highest with the "white" configuration. The color reproducibility in the binning mode is best with the "original + monochrome" configuration.

[0100] [10. Variations in the arrangement of anomalous pixels] 14 to 18 are diagrams showing variations in the arrangement of the anomalous pixel UPX.

[0101] 14 shows an example in which one anomalous pixel UPX is arranged in the center of a pixel block PB. The anomalous pixel UPX is located in the center of nine pixels PX arranged in three rows and three columns.

[0102] 15 shows an example in which four anomalous pixels UPX are arranged adjacent to one another in the center of a pixel block PB. Of the 16 pixels PX arranged in 4 rows and 4 columns, the four pixels PX arranged in 2 rows and 2 columns in the center are the anomalous pixels UPX.

[0103] 16 shows an example in which four peculiar pixels UPX are arranged in the center of a pixel block PB so as not to be adjacent to one another. The four peculiar pixels UPX are arranged in positions that are rotationally symmetric with respect to the center of the pixel block PB.

[0104] 14 to 16, one or more anomalous pixels UPX are located in the center of the pixel block PB, so that the color information of each pixel PX is calculated with high accuracy by the demosaic process.

[0105] 17 and 18 show an example in which the pixel block PB includes one or more anomalous pixels UPX in each row and each column.

[0106] 17, the four pixels PX located at the outermost periphery of a pixel block PB consisting of 16 pixels PX arranged in 4 rows and 4 columns are anomalous pixels UPX. The four pixels UPX are arranged in rotational symmetry with respect to the center of the pixel block PB.

[0107] 18, one pixel PX located at the center of a pixel block PB composed of 25 pixels PX arranged in 5 rows and 5 columns and four pixels PX located at the outermost periphery are anomalous pixels UPX. The five anomalous pixels UPX are arranged at positions rotationally symmetrical with respect to the center of the pixel block PB.

[0108] In the examples of FIGS. 17 and 18, one or more anomalous pixels UPX are provided in each row and each column of the pixel block PB, thereby reducing the color sampling interval.

[0109] 14 to 18, the number of pixels PX constituting the pixel block PB is 9, 16, or 25. However, the number of pixels PX constituting the pixel block PB is not limited to this.

[0110] [11. Other variations of the pixel array] 19 to 26 are diagrams showing other variations of the pixel array section PA.

[0111] The examples of FIGS. 19 to 21 are examples in which the color of light detected by a plurality of anomalous pixels UPX belonging to the same pixel block PB is all the same.

[0112] For example, image sensor IS9 in Fig. 19 is an example in which the arrangement of peculiar pixels UPX in Fig. 18 is applied to the configuration of the first embodiment. Image sensor IS10 in Fig. 20 is an example in which the arrangement of peculiar pixels UPX in Fig. 18 is applied to the configuration of the third embodiment. Image sensor IS11 in Fig. 21 is an example in which the arrangement of peculiar pixels UPX in Fig. 18 is applied to the configuration of the eighth embodiment. In the example of Fig. 21, unlike the eighth embodiment, the green pixel block PB2 does not include the peculiar pixel UPX.

[0113] 19 to 21, the pixel block PB includes one or more anomalous pixels UPX in each row and each column, so that the color sampling interval is reduced.

[0114] The examples of FIGS. 22 to 26 are examples in which the same pixel block PB includes multiple types of anomalous pixels UPX that detect light of different colors.

[0115] For example, the image sensor IS12 in Fig. 22 differs from the example in Fig. 19 in the following respects: the color of light detected by one anomalous pixel UPX located in the center of the pixel block PB is different from the color of light detected by the other four anomalous pixels UPX located in the outermost periphery of the pixel block PB.

[0116] For example, the peculiar pixel UPX1A located at the outermost periphery of the red pixel block PB1 detects blue light assigned to the blue pixel block PB3. The peculiar pixel UPX1B located at the center of the red pixel block PB1 detects red light assigned to the red pixel block PB1 and blue light assigned to the blue pixel block PB3. The peculiar pixel UPX3A located at the outermost periphery of the blue pixel block PB3 detects red light assigned to the red pixel block PB1. The peculiar pixel UPX3B located at the center of the blue pixel block PB3 detects red light assigned to the red pixel block PB1 and blue light assigned to the blue pixel block PB3. The method of demosaic processing is the same as that described in the first and third embodiments.

[0117] In addition to the effects shown in the example of FIG. 19, this configuration provides the following effects: The anomalous pixel UPX located at the center of the pixel block PB detects light of two or more colors. As a result, the sampling interval for the two or more colors is reduced. The sensitivity in the binning mode is also increased. In addition, the anomalous pixel UPX located at the center of the pixel block PB detects light of two or more colors including the color assigned to the pixel block PB to which the anomalous pixel UPX belongs. As a result, color reproducibility in the normal mode is high.

[0118] The image sensor IS13 in FIG. 23 and the image sensor IS14 in FIG. 24 are different from the example in FIG. 22 in the color of light detected by the anomalous pixel UPX located in the center of the pixel block PB.

[0119] For example, in the example of FIG. 23, the anomalous pixel UPX1E located at the center of the red pixel block PB1 detects red light assigned to the red pixel block PB1 and green light assigned to the green pixel block PB2. The anomalous pixel UPX3E located at the center of the blue pixel block PB3 detects green light assigned to the green pixel block PB2 and blue light assigned to the blue pixel block PB3. In the example of FIG. 24, the anomalous pixel UPX1D located at the center of the red pixel block PB1 detects light of all colors assigned to the multiple pixel blocks PB. The anomalous pixel UPX3D located at the center of the blue pixel block PB3 detects light of all colors assigned to the multiple pixel blocks PB. These examples also provide the same effect as the example of FIG. 22.

[0120] The image sensor IS15 in FIG. 25 detects different colors of light from the anomalous pixel UPX located at the outermost periphery of the pixel block PB, compared to the example in FIG. 24. For example, the anomalous pixel UPX1B located at the outermost periphery of the red pixel block PB1 detects red light assigned to the red pixel block PB1 and blue light assigned to the blue pixel block PB3. The anomalous pixel UPX3B located at the outermost periphery of the blue pixel block PB3 detects red light assigned to the red pixel block PB1 and blue light assigned to the blue pixel block PB3. In this configuration, in addition to the anomalous pixel UPX located at the center of the pixel block PB, the anomalous pixel UPX located at the outermost periphery of the pixel block PB also detects light of multiple colors. Therefore, the color sampling interval is reduced.

[0121] The image sensor IS16 in FIG. 26 differs from the example in FIG. 25 in that a plurality of anomalous pixels UPX that detect light of different colors are provided on the outermost periphery of the same pixel block PB.

[0122] For example, peculiar pixels UPX1A and UPX1B that detect light of different colors are provided at the outermost periphery of the red pixel block PB1. The peculiar pixel UPX1A detects blue light assigned to the blue pixel block PB3. The peculiar pixel UPX1B detects red light assigned to the red pixel block PB1 and blue light assigned to the blue pixel block PB3. The red pixel block PB1 has two peculiar pixels UPX1A at positions that are point-symmetric with respect to the center of the red pixel block PB1. The red pixel block PB1 has two peculiar pixels UPX1B at positions that are point-symmetric with respect to the center of the red pixel block PB1.

[0123] The blue pixel block PB3 is provided at its outermost periphery with peculiar pixels UPX3A and UPX3B which detect light of different colors. The peculiar pixel UPX3A detects the red light assigned to the red pixel block PB1. The peculiar pixel UPX3B detects the red light assigned to the red pixel block PB1 and the blue light assigned to the blue pixel block PB3. The blue pixel block PB3 is provided with two peculiar pixels UPX3A at positions point-symmetrical with respect to the center of the blue pixel block PB3. The blue pixel block PB3 is provided with two peculiar pixels UPX3B at positions point-symmetrical with respect to the center of the blue pixel block PB3.

[0124] This configuration also reduces the color sampling interval.

[0125] It should be noted that the effects described in this specification are merely examples and are not limiting, and other effects may also be obtained.

[0126] The present technology can also be configured as follows.

[0127] (1) A plurality of pixel blocks each having a different color assigned thereto, Each of the plurality of pixel blocks includes a plurality of pixels, The plurality of pixels provided in at least one pixel block of the plurality of pixel blocks includes one or more anomalous pixels that detect light of one or more colors assigned to one or more other pixel blocks. Image sensor. (2) A processing circuit detects, in a binning mode, the detected values ​​of the plurality of pixel blocks as color values ​​of the colors respectively assigned to the plurality of pixel blocks. The image sensor according to (1) above. (3) In the binning mode, the processing circuit adds up the detection values ​​of the plurality of pixels in the same pixel block including the one or more anomalous pixels, performs color correction on the total detection value obtained by the addition, and detects the color-corrected total detection value as a color value of the color assigned to the pixel block. The image sensor according to (2) above. (4) In the binning mode, the processing circuit adds up detection values ​​of a plurality of pixels in the same pixel block excluding the one or more anomalous pixels, and detects the total detection value obtained by the addition as a color value of the color assigned to the pixel block. The image sensor according to (2) above. (5) The anomalous pixel detects light of two or more colors selected from a plurality of colors assigned to the plurality of pixel blocks. The image sensor according to any one of (1) to (4) above. (6) The peculiar pixel selectively detects light of a color assigned to a pixel block to which the peculiar pixel belongs and light of one or more colors respectively assigned to one or more pixel blocks to which the peculiar pixel does not belong. The image sensor according to (5) above. (7) The peculiar pixel selectively detects light of two or more colors respectively assigned to two or more pixel blocks to which the peculiar pixel does not belong. The image sensor according to (5) above. (8) The specific pixel detects light of all colors assigned to the plurality of pixel blocks. The image sensor according to (5) above. (9) A processing circuit is provided for shortening the exposure time of the specific pixel relative to the exposure time of other pixels. The image sensor according to any one of (5) to (8) above. (10) The plurality of pixel blocks are each arranged in N rows and N columns (N is an integer of 3 or more). 2 Contains pixels The image sensor according to any one of (1) to (9) above. (11) The one or more anomalous pixels are located in the center of the pixel block. The image sensor according to (10) above. (12) The pixel block includes one or more singular pixels in each row and each column. The image sensor according to (10) above. (13) the plurality of pixel blocks include a red pixel block to which a red color is assigned, a green pixel block to which a green color is assigned, and a blue pixel block to which a blue color is assigned; The red pixel block, the green pixel block, and the blue pixel block are arranged according to a Bayer array pattern. The image sensor according to any one of (10) to (12) above. (14) A camera having the image sensor according to any one of (1) to (13) above. [Explanation of symbols]

[0128] CA Camera IS, IS1 to IS16 Image Sensors PB Pixel Block PX pixels PR processing circuit UPX, UPX1A~UPX1E, UPX2A~UPX2F, UPX3A~UPX3E anomalous pixels

Claims

1. A pixel array having a plurality of pixel blocks to which different colors are assigned, Each of the plurality of pixel blocks includes a plurality of pixels, the plurality of pixels provided in at least one pixel block among the plurality of pixel blocks includes one or more anomalous pixels that detect light of one or more colors assigned to one or more other pixel blocks; a processing circuit configured to detect, in a binning mode, detection values ​​of the plurality of pixel blocks as color values ​​of colors respectively assigned to the plurality of pixel blocks; In the binning mode, the processing circuit adds up the detection values ​​of the plurality of pixels in the same pixel block including the one or more anomalous pixels, performs color correction on the total detection value obtained by the addition, and detects the color-corrected total detection value as a color value of the color assigned to the pixel block. Image sensor.

2. A pixel block having a plurality of pixel blocks to which different colors are assigned, Each of the plurality of pixel blocks includes a plurality of pixels, the plurality of pixels provided in at least one pixel block among the plurality of pixel blocks includes one or more anomalous pixels that detect light of one or more colors assigned to one or more other pixel blocks; a processing circuit configured to detect, in a binning mode, detection values ​​of the plurality of pixel blocks as color values ​​of colors respectively assigned to the plurality of pixel blocks; In the binning mode, the processing circuit adds up detection values ​​of a plurality of pixels in the same pixel block excluding the one or more anomalous pixels, and detects the total detection value obtained by the addition as a color value of the color assigned to the pixel block. Image sensor.

3. A pixel block having a plurality of pixel blocks to which different colors are assigned, Each of the plurality of pixel blocks includes a plurality of pixels, the plurality of pixels provided in at least one pixel block among the plurality of pixel blocks includes one or more anomalous pixels that detect light of one or more colors assigned to one or more other pixel blocks; the anomalous pixel detects light of two or more colors selected from a plurality of colors assigned to the plurality of pixel blocks; The peculiar pixel selectively detects light of a color assigned to a pixel block to which the peculiar pixel belongs and light of one or more colors assigned to one or more pixel blocks to which the peculiar pixel does not belong. Image sensor.

4. A pixel block having a plurality of pixel blocks to which different colors are assigned, Each of the plurality of pixel blocks includes a plurality of pixels, the plurality of pixels provided in at least one pixel block among the plurality of pixel blocks includes one or more anomalous pixels that detect light of one or more colors assigned to one or more other pixel blocks; the anomalous pixel detects light of two or more colors selected from a plurality of colors assigned to the plurality of pixel blocks; The peculiar pixel selectively detects light of two or more colors respectively assigned to two or more pixel blocks to which the peculiar pixel does not belong. Image sensor.

5. A pixel block having a plurality of pixel blocks to which different colors are assigned, Each of the plurality of pixel blocks includes a plurality of pixels, the plurality of pixels provided in at least one pixel block among the plurality of pixel blocks includes one or more anomalous pixels that detect light of one or more colors assigned to one or more other pixel blocks; the anomalous pixel detects light of two or more colors selected from a plurality of colors assigned to the plurality of pixel blocks; The specific pixel detects light of all colors assigned to the plurality of pixel blocks. Image sensor.

6. A pixel block having a plurality of pixel blocks to which different colors are assigned, Each of the plurality of pixel blocks includes a plurality of pixels, the plurality of pixels provided in at least one pixel block among the plurality of pixel blocks includes one or more anomalous pixels that detect light of one or more colors assigned to one or more other pixel blocks; the anomalous pixel detects light of two or more colors selected from a plurality of colors assigned to the plurality of pixel blocks; A processing circuit is provided for shortening the exposure time of the specific pixel relative to the exposure time of other pixels. Image sensor.

7. A pixel block having a plurality of pixel blocks to which different colors are assigned, Each of the plurality of pixel blocks includes a plurality of pixels, the plurality of pixels provided in at least one pixel block among the plurality of pixel blocks includes one or more anomalous pixels that detect light of one or more colors assigned to one or more other pixel blocks; Each of the pixel blocks includes N 2 pixels arranged in N rows and N columns (N is an integer equal to or greater than 3); The one or more anomalous pixels are located in the center of the pixel block. Image sensor.

8. the plurality of pixel blocks include a red pixel block to which a red color is assigned, a green pixel block to which a green color is assigned, and a blue pixel block to which a blue color is assigned; The red pixel block, the green pixel block, and the blue pixel block are arranged according to a Bayer array pattern.

8. The image sensor according to claim 7.

9. A camera having the image sensor of claim 1.

Images