Image pickup device

Abstract

To realize independent autonomous exposure in each of a plurality of pixels.SOLUTION: An imaging element including a first semiconductor substrate including a first pixel and a second pixel, a first circuit unit including a first processing unit that performs an arithmetic operation using a signal from the first pixel, a first control unit that controls an accumulation time for accumulating a first photoelectrically converted charge, and a second control unit that controls an accumulation time for accumulating a second photoelectrically converted charge; A second circuit unit including a third processing unit configured to perform a calculation using a signal from the first pixel and a fourth processing unit configured to perform a calculation using a signal from the second pixel, the first control unit controls a time for accumulating the first photoelectrically converted charge based on a first calculation result calculated by at least one of the first processing unit and the third processing unit, and the second control unit controls a time for accumulating the second photoelectrically converted charge based on a second calculation result calculated by at least one of the second processing unit and the fourth processing unit.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to an imaging element and an imaging device. [Background technology]

[0002] Solid-state imaging devices having a plurality of pixel cells are known (for example, see Patent Document 1). Conventionally, there has been a demand for an expanded dynamic range. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2014-75767 Summary of the Invention

[0004] The imaging element of the first disclosed technique includes a first semiconductor substrate having a pixel portion including a first pixel including a first photoelectric conversion unit that converts light into an electric charge and a second pixel including a second photoelectric conversion unit that converts light into an electric charge; a semiconductor substrate stacked together with the first semiconductor substrate, the first circuit portion including a first processing unit that performs calculations using signals read out from the first pixel, a first control unit that controls an accumulation time for accumulating the electric charge converted by the first photoelectric conversion unit, a second processing unit that performs calculations using signals read out from the second pixel, and a second control unit that controls an accumulation time for accumulating the electric charge converted by the second photoelectric conversion unit; and a second semiconductor substrate having a second circuit unit including a third processing unit that performs calculations using signals read out from the second pixel and a fourth processing unit that performs calculations using signals read out from the second pixel, wherein the first control unit controls an accumulation time for accumulating charges converted in the first photoelectric conversion unit based on a first calculation result calculated in at least one of the first processing unit and the third processing unit, and the second control unit controls an accumulation time for accumulating charges converted in the second photoelectric conversion unit based on a second calculation result calculated in at least one of the second processing unit and the fourth processing unit.

[0005] The imaging device of the second disclosed technique includes the imaging element of the first disclosed technique. [Brief explanation of the drawings]

[0006] [Figure 1] FIG. 1 is an exploded perspective view showing an example of an imaging element. [Figure 2] FIG. 2 is an explanatory diagram showing an example of a specific configuration of a pixel unit. [Figure 3] FIG. 3 is a circuit diagram showing an example of a circuit configuration of a pixel. [Figure 4] FIG. 4 is an explanatory diagram showing an example of a specific configuration of the control circuit unit. [Figure 5] FIG. 5 is an explanatory diagram showing an example of the internal configuration of the control block. [Figure 6] FIG. 6 is an explanatory diagram showing an example of signal transmission between a first semiconductor substrate and a second semiconductor substrate in an imaging element. [Figure 7] FIG. 7 is an explanatory diagram showing an example of an XZ direction cross section of the imaging element according to this embodiment. [Figure 8] FIG. 8 is a timing chart showing an example 1 of the imaging operation of the imaging element. [Figure 9] FIG. 9 is a timing chart showing a second example of the imaging operation of the imaging element. [Figure 10] FIG. 10 is a timing chart showing the imaging operation of the imaging element according to the comparative example. [Figure 11] FIG. 11 is an explanatory diagram showing an example of a subject imaged by an imaging element. [Figure 12] FIG. 12 is a timing chart showing the exposure time for each of the regions 1 to 5 shown in FIG. [Figure 13] FIG. 13 is a plan view showing an example of the layout of a plurality of control blocks. [Figure 14] FIG. 14 is a circuit diagram showing another example of the circuit configuration of a pixel. [Figure 15] FIG. 15 is a timing chart showing a third example of an imaging operation of the imaging element. [Figure 16]FIG. 16 is an exploded perspective view showing another example of the imaging element. [Figure 17] FIG. 17 is an explanatory diagram showing another example of the specific configuration of the control circuit section. [Figure 18] FIG. 18 is an explanatory diagram showing the connection relationship between the first semiconductor substrate and the second semiconductor substrate in the imaging element. [Figure 19] FIG. 19 is an explanatory diagram showing an example of signal transmission between a first semiconductor substrate and a second semiconductor substrate in an imaging element. [Figure 20] FIG. 20 is an explanatory diagram showing the connection relationship between the ADC unit and the pixel block. [Figure 21] FIG. 21 is a timing chart showing the imaging operation in a pixel block of the imaging element. [Figure 22] FIG. 22 is an explanatory diagram showing an example of exposure timing for each pixel block. [Figure 23] FIG. 23 is a block diagram showing an example of the configuration of the autonomous exposure control system 1. As shown in FIG. [Figure 24] FIG. 24 is a block diagram showing an example of the configuration of the autonomous exposure control system 2. In FIG. [Figure 25] FIG. 25 is a block diagram showing an example of the configuration of the autonomous exposure control system 3. [Figure 26] FIG. 26 is a block diagram showing an example of a layout in which autonomous exposure processing units are implemented in adjacent control blocks. [Figure 27] FIG. 27 is a block diagram showing an example of a layout when an autonomous exposure processing unit is implemented in a peripheral circuit. [Figure 28] FIG. 28 is a block diagram showing a detailed internal configuration of the peripheral circuitry shown in FIG. [Figure 29] FIG. 29 is an explanatory diagram showing an example of delaying the reflection period of the exposure time. [Figure 30] FIG. 30 is an explanatory diagram showing Example 1 of shortening the reflection period of the exposure time. [Figure 31] FIG. 31 is an explanatory diagram showing a second example of shortening the exposure time reflection period. [Figure 32]FIG. 32 is a timing chart 1-1 when a change in exposure time occurs. [Figure 33] FIG. 33 is a timing chart 1-2 when a change in exposure time occurs. [Figure 34] FIG. 34 is a timing chart 2-1 when a change in exposure time occurs. [Figure 35] FIG. 35 is a timing chart 2-2 when a change in exposure time occurs. [Figure 36] FIG. 36 is a timing chart 3-1 when a change in exposure time occurs. [Figure 37] FIG. 37 is a timing chart 3-2 when a change in exposure time occurs. [Figure 38] FIG. 38 is a timing chart 3-3 when a change in exposure time occurs. [Figure 39] FIG. 39 is an explanatory diagram showing a first method for reading out the exposure value to the outside of the second semiconductor substrate. [Figure 40] FIG. 40 is an explanatory diagram showing a second method for reading out the exposure value to the outside of the second semiconductor substrate. [Figure 41] FIG. 41 is a block diagram showing a first example of speeding up autonomous exposure control within a control block. [Figure 42] FIG. 42 is an explanatory diagram showing an example of a counter latch in Example 1 of increasing the speed of autonomous exposure control within a control block. [Figure 43] FIG. 43 is an explanatory diagram showing a specific example of autonomous exposure control in Example 1 of increasing the speed of autonomous exposure control within a control block. [Figure 44] FIG. 44 is an explanatory diagram showing an example of a counter latch in Example 2 of increasing the speed of autonomous exposure control within a control block. [Figure 45] FIG. 45 is an explanatory diagram showing a specific example of autonomous exposure control in Example 2 of increasing the speed of autonomous exposure control within a control block. [Figure 46] FIG. 46 is a block diagram showing a third example of speeding up autonomous exposure control within a control block. [Figure 47]FIG. 47 is a circuit diagram showing an example of a comparator. [Figure 48] FIG. 48 is an explanatory diagram showing an example 1 of exposure control by switching exposure values ​​inside and outside the control block. [Figure 49] FIG. 49 is an explanatory diagram showing a second example of exposure control by switching between exposure values ​​inside and outside the control block. [Figure 50] FIG. 50 is an explanatory diagram showing a third example of exposure control by switching between exposure values ​​inside and outside the control block. [Figure 51] FIG. 51 is an explanatory diagram showing a first example of reading exposure values ​​for each control block. [Figure 52] FIG. 52 is an explanatory diagram showing a second example of reading the exposure value for each control block. [Figure 53] FIG. 53 is a block diagram showing a detailed block configuration example of a control block in Example 2 of reading exposure values ​​for each control block. [Figure 54] FIG. 54 is a block diagram showing an example of the internal configuration of the preprocessing unit in color shift reduction example 1. In FIG. [Figure 55] FIG. 55 is an explanatory diagram showing an example of a pixel block in the second example of reducing color misregistration. [Figure 56] FIG. 56 is a block diagram showing an example of the internal configuration of the preprocessing unit in color shift reduction example 3. [Figure 57] FIG. 57 is a block diagram showing an example of the internal configuration of an image sensor in color shift reduction example 4. In FIG. [Figure 58] FIG. 58 is a circuit diagram showing an example of defect analysis of a bonding pad between semiconductor substrates in a pixel drive signal line. [Figure 59] FIG. 59 is a circuit diagram showing a first example of failure analysis of a bonding pad between semiconductor substrates in a vertical signal line. [Figure 60] FIG. 60 is a circuit diagram showing a failure analysis example 2-1 of a bonding pad between semiconductor substrates in a vertical signal line. [Figure 61] FIG. 61 is a circuit diagram showing a failure analysis example 2-2 of a bonding pad between semiconductor substrates in a vertical signal line 2. In FIG. [Figure 62]FIG. 62 is a circuit diagram showing an example of failure analysis of bonding pads between semiconductor substrates when a signal path is shared between multiple circuits. [Figure 63] FIG. 63 is a circuit diagram showing an example of settings after failure analysis of bonding pads between semiconductor substrates when a signal path is shared among a plurality of circuits. [Figure 64] FIG. 64 is a circuit diagram showing a first example of failure analysis of a bonding pad between semiconductor substrates when a bonding portion is shared between multiple circuits. [Figure 65] FIG. 65 is a circuit diagram showing a second example of failure analysis of a bonding pad between semiconductor substrates when a bonding portion is shared between multiple circuits. [Figure 66] FIG. 66 is a block diagram illustrating an example of the configuration of an imaging device according to an embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0007] The present invention will be described below through embodiments of the invention, but the following embodiments do not limit the scope of the invention as claimed. Furthermore, not all of the combinations of features described in the embodiments are necessarily essential to the solution of the invention.

[0008] In this specification, the X-axis and Y-axis are perpendicular to each other, and the Z-axis is perpendicular to the XY plane. The XYZ-axes form a right-handed system. The direction parallel to the Z-axis may be referred to as the stacking direction of the image sensor 100. In this specification, the terms "up" and "down" are not limited to the up and down directions in the direction of gravity. These terms merely refer to relative directions in the Z-axis direction. Note that in this specification, the arrangement in the X-axis direction will be described as a "row" and the arrangement in the Y-axis direction as a "column," but the matrix direction is not limited to this.

[0009] <Image sensor configuration> First, the configuration of the imaging element will be described with reference to Figures 1 to 22. The imaging element may have a back-illuminated or front-illuminated structure.

[0010] FIG. 1 is an exploded perspective view showing an example of an image sensor 100A. The image sensor 100A captures an image of a subject. The image sensor 100A generates image data of the captured subject. The image sensor 100A includes a first semiconductor substrate 110, a second semiconductor substrate 120, and a third semiconductor substrate 130. As shown in FIG. 1, the first semiconductor substrate 110 is stacked on the second semiconductor substrate 120, and the second semiconductor substrate 120 is stacked on the third semiconductor substrate 130.

[0011] The first semiconductor substrate 110 has a pixel section 101. The pixel section 101 outputs a pixel signal based on incident light.

[0012] The second semiconductor substrate 120 has a control circuit section 102 and a peripheral circuit section 121 .

[0013] The control circuit unit 102 receives pixel signals output from the first semiconductor substrate 110. The control circuit unit 102 processes the received pixel signals. The control circuit unit 102 is disposed on the second semiconductor substrate 120 at a position facing the pixel unit 101. For example, the control circuit unit 102 is disposed so as to overlap with the pixel unit 101 in the direction in which the first semiconductor substrate 110 and the second semiconductor substrate 120 are stacked. The control circuit unit 102 may output a control signal to the pixel unit 101 for controlling the driving of the pixel unit 101.

[0014] The peripheral circuit unit 121 controls the driving of the control circuit unit 102. The peripheral circuit unit 121 is arranged around the control circuit unit 102 on the second semiconductor substrate 120. Specifically, the peripheral circuit unit 121 is arranged in an area on the second semiconductor substrate 120 that is arranged outside the area in which the control circuit unit 102 is arranged. The peripheral circuit unit 121 may also be electrically connected to the first semiconductor substrate 110 and control the driving of the pixel unit 101. The peripheral circuit unit 121 is arranged along two sides of the second semiconductor substrate 120, but the arrangement of the peripheral circuit unit 121 is not limited to this example.

[0015] The third semiconductor substrate 130 has a data processing unit 103. The data processing unit 103 uses the digital data output from the second semiconductor substrate 120 to perform addition processing, thinning processing, and other image processing.

[0016] 2 is an explanatory diagram showing an example of a specific configuration of the pixel unit 101. The pixel unit 101 has a plurality of pixel blocks 200. The plurality of pixel blocks 200 are arranged in the row and column directions in the pixel unit 101. Specifically, the plurality of pixel blocks 200 includes M×N (M and N are natural numbers) pixel blocks 200 arranged in the row and column directions in the pixel unit 101. Although the figure shows a case where M is equal to N, M and N may be different.

[0017] The pixel block 200 has a plurality of pixels 201. The plurality of pixels 201 are arranged in rows and columns in the pixel block 200. The pixel block 200 has m×n (m and n are natural numbers) pixels 201 arranged in the rows and columns. For example, the pixel block 200 has 16×16 pixels 201 arranged in the rows and columns. The number of pixels 201 corresponding to the pixel block 200 is not limited to this. Although the illustration shows a case where m is equal to n, m may be different from n.

[0018] The pixel block 200 has a plurality of pixels 201 connected to a common control line (for example, a transfer control line 311 and a discharge control line 312, which will be described later) in the row direction. For example, each pixel 201 in the pixel block 200 is connected to the common control line so that the pixels 201 are set to the same exposure time. Specifically, for example, every n pixels 201 arranged in the row direction are connected by the common control line.

[0019] On the other hand, between different pixel blocks 200, one pixel block 200 may be set to a different exposure time from the other pixel block 200. For example, when one pixel block 200 and the other pixel block 200 are arranged side by side in the row direction, the multiple pixels 201 included in one pixel block 200 and the multiple pixels 201 included in the other pixel block 200 are connected by different control lines. The multiple pixels 201 in the m-th row of one pixel block 200 are connected in common by a control line that is different from the common control line to which the multiple pixels 201 in the m-th row of the other pixel block 200 are connected. Furthermore, when one pixel block 200 and the other pixel block 200 are arranged side by side in the column direction, the multiple pixels 201 included in one pixel block 200 and the multiple pixels 201 included in the other pixel block 200 are connected by different control lines. The pixels 201 in the mth row of one pixel block 200 are commonly connected to a control line that is different from the common control line to which the pixels 201 in the mth row of the other pixel block 200 are connected.

[0020] Furthermore, for example, when one pixel block 200 and the other pixel block 200 are arranged side by side in the row direction, the multiple pixels 201 included in one pixel block 200 and the multiple pixels 201 included in the other pixel block 200 are connected by different signal lines 202. The multiple pixels 201 in the n-th column of one pixel block 200 are connected in common by a signal line 202 that is different from the common signal line 202 to which the multiple pixels 201 in the n-th column of the other pixel block 200 are connected. Furthermore, when one pixel block 200 and the other pixel block 200 are arranged side by side in the column direction, the multiple pixels 201 included in one pixel block 200 and the multiple pixels 201 included in the other pixel block 200 are connected in common by different signal lines 202. The multiple pixels 201 in the n-th column of one pixel block 200 are connected in common by a signal line 202 that is different from the common signal line 202 to which the multiple pixels 201 in the n-th column of the other pixel block 200 are connected.

[0021] The pixel blocks 200 are arranged corresponding to the control blocks 400A and 400B (see FIGS. 4 and 17) described later. That is, one pixel block 200 is arranged for one control block 400A and 400B.

[0022] Furthermore, multiple pixel blocks 200 may be arranged for one control block 400A, 400B. Even when multiple pixel blocks 200 are arranged for one control block 400A, 400B, different exposure times may be set for the respective pixel blocks 200. When two pixel blocks 200 arranged in the column direction are arranged for one control block, the control blocks 400A, 400B control 2m×n pixels 201. Specifically, for example, the control blocks 400A, 400B control 32×16 pixels 201. The number of pixels 201 corresponding to the control blocks 400A, 400B is not limited to this.

[0023] 3 is a circuit diagram showing an example of the circuit configuration of a pixel 201. The pixel 201 includes a photoelectric conversion unit 300 and a readout unit 310. The readout unit 310 has a transfer unit 301, a discharge unit 302, an FD (floating diffusion) 303, a reset unit 304, and a pixel output unit 305, and reads out a pixel signal based on the charge converted by the photoelectric conversion unit 300 to a signal line 202. The pixel output unit 305 has an amplifier unit 351 and a selection unit 352. The transfer unit 301, the discharge unit 302, the FD 303, the reset unit 304, the amplifier unit 351, and the selection unit 352 are collectively referred to as the readout unit 310. The readout unit 310 will be described as an N-channel FET, but the type of transistor is not limited to this.

[0024] The photoelectric conversion unit 300 has a photoelectric conversion function of converting light into electric charges. The photoelectric conversion unit 300 accumulates the electric charges generated by photoelectric conversion. The photoelectric conversion unit 300 is configured by, for example, a photodiode.

[0025] The transfer unit 301 transfers the charges in the photoelectric conversion unit 300 to the FD 303. The transfer unit 301 controls the electrical connection between the photoelectric conversion unit 300 and the FD 303. The transfer unit 301 is configured, for example, by a transistor. The transfer unit 301 may also be an element that has at least a gate terminal and configures part of a transistor with a part of the photoelectric conversion unit 300 as the source terminal and a part of the FD 303 as the drain terminal. The gate terminal of the transfer unit 301 is connected to a transfer control line 311 for inputting a transfer control signal φTX. The transfer control line 311 will be described later.

[0026] The discharge unit 302 discharges the charge accumulated in the photoelectric conversion unit 300 to a power supply wiring to which a power supply voltage VDD is supplied. The discharge unit 302 controls the connection between the photoelectric conversion unit 300 and the power supply wiring. The discharge unit 302 is configured, for example, by a transistor. The discharge unit 302 may also be an element that has at least a gate terminal and constitutes part of a transistor in which a part of the photoelectric conversion unit 300 serves as a source terminal and a part of a diffusion region connected to the power supply wiring serves as a drain terminal. The gate terminal of the discharge unit 302 is connected to a discharge control line 312 for inputting a discharge control signal φPDRST. Note that although the discharge unit 302 has been described as discharging the charge of the photoelectric conversion unit 300 to a power supply wiring to which a power supply voltage VDD is supplied, the discharge unit 302 may also be discharged to a power supply wiring to which a power supply voltage different from the power supply voltage VDD is supplied.

[0027] The FD 303 receives charges transferred from the photoelectric conversion unit 300 by the transfer unit 301. The FD 303 accumulates the charges transferred from the photoelectric conversion unit 300.

[0028] The reset unit 304 discharges the charge accumulated in the FD 303 to the power supply wiring to which the power supply voltage VDD is supplied. The reset unit 304 resets the potential of the FD 303 to the power supply voltage VDD, which is the reference potential. The reset unit 304 controls the electrical connection between the FD 303 and the power supply wiring. The reset unit 304 is configured, for example, by a transistor. The reset unit 304 may also be an element that has at least a gate terminal and configures part of a transistor with a part of the FD 303 as the source terminal and a part of a diffusion region connected to the power supply wiring as the drain terminal. The gate terminal of the reset unit 304 is connected to a reset control line 313 for inputting a reset control signal φRST. The reset control line 313 will be described later.

[0029] The pixel output unit 305 outputs a pixel signal based on the potential of the FD 303 to the signal line 202. The pixel output unit 305 has an amplifier unit 351 and a selection unit 352. The amplifier unit 351 is configured with a transistor. The amplifier unit 351 has a gate terminal connected to the FD 303, a drain terminal connected to a power supply line to which a power supply voltage VDD is supplied, and a source terminal connected to the drain terminal of the selection unit 352.

[0030] The selection unit 352 controls the electrical connection between the pixel 201 and the signal line 202. When the selection unit 352 electrically connects the pixel 201 and the signal line 202, a pixel signal is output from the pixel 201 to the signal line 202. The selection unit 352 is configured with a transistor. The selection unit 352 may also be an element that has at least a gate terminal and configures part of a transistor with a part of the amplifier unit 351 as a source terminal and a part of a diffusion region connected to the signal line 202 as a drain terminal. The gate terminal of the selection unit 352 is connected to a selection control line 314 that spans multiple pixel blocks 200 and is used to input a selection control signal φSEL. The source terminal of the selection unit 352 is connected to the load current source 306.

[0031] The load current source 306 is connected to the signal line 202 and supplies a current for reading out pixel signals from the pixels 201. This stabilizes the operation of the amplifier unit 351. The load current source 306 is also connected to the signal line 202. The load current source 306 may be provided on the first semiconductor substrate 110 or on the second semiconductor substrate 120.

[0032] Furthermore, the FD 303 and the pixel output unit 305 may be shared with other pixels 201. For example, the FD 303 and the pixel output unit 305 may be shared by a plurality of pixels 201 arranged side by side in the row or column direction. Furthermore, the pixel 201 may be configured with a plurality of photoelectric conversion units 300 and transfer units 301.

[0033] FIG. 4 is an explanatory diagram showing an example of a specific configuration of the control circuit unit 102. The control circuit unit 102 has multiple control blocks 400A. The multiple control blocks 400A are arranged in a row and column direction in the control circuit unit 102. Specifically, the control circuit unit 102 has M×N control blocks 400A. When one pixel block 200 is arranged for one control block 400A, the control circuit unit 102 has the control block 400A immediately below the pixel block 200. One pixel block 200 and one control block 400A have substantially the same shape and size. Furthermore, when multiple pixel blocks 200 arranged in a column direction are arranged for one control block 400A, the control circuit unit 102 has one control block 400A immediately below the multiple pixel blocks 200 arranged in a column direction.

[0034] The control block 400A is provided corresponding to the pixel block 200. As an example of the correspondence between the control block and the pixel block, for example, the control block 400A is located directly below the pixel block 200 in the direction in which the first semiconductor substrate 110 and the second semiconductor substrate 120 are stacked (stacking direction). The control block 400A is electrically connected to the pixel block 200 via a signal line 202, a transfer control line 311, and a discharge control line 312. Specifically, the control block 400A located directly below the pixel block 200 in the stacking direction is electrically connected to the pixel block 200 directly above it in the stacking direction (hereinafter referred to as the corresponding pixel block 200) via local control lines such as the transfer control line 311 and the discharge control line 312. The control block 400A receives pixel signals output from the pixels 201 of the corresponding pixel block 200 via the signal line 202.

[0035] The control block 400A controls the driving of the corresponding pixel block 200. For example, the control block 400A controls the exposure time of the pixels 201 included in the corresponding pixel block 200. The control block 400A also has a signal processing unit 402 that processes input signals, and processes pixel signals output from the pixels 201 included in the corresponding pixel block 200. For example, the control block 400A converts analog pixel signals output from the pixels 201 included in the corresponding pixel block 200 into digital signals.

[0036] The control block 400A has a pixel control unit 401 and a signal processing unit 402. The pixel control unit 401 has an autonomous exposure processing unit 411, an exposure control unit 412, and a pixel driving unit 413, and controls the pixels 201 of the pixel unit 101. The signal processing unit 402 has a signal input unit 421, a signal conversion unit 422, and a signal output unit 423, and converts analog pixel signals from the pixel unit 101 into digital signals and transfers them to the pixel control unit 401 and the data processing unit 103.

[0037] The autonomous exposure processor 411 is a circuit that calculates the exposure time of the pixels 201 included in the corresponding pixel block 200 based on the pixel signals converted into digital signals by the signal processor 402. Details of the autonomous exposure processor 411 will be described later.

[0038] The exposure control unit 412 is a circuit that controls the exposure of the pixels 201 included in the corresponding pixel block 200 based on the exposure time calculated by the autonomous exposure processing unit 411. Specifically, the exposure control unit 412 generates a control signal for controlling the exposure time (charge accumulation time of the photoelectric conversion unit 300) of the pixels 201 included in the corresponding pixel block 200. For example, the exposure control unit 412 adjusts the start timing or end timing of exposure of the pixels 201 included in the corresponding pixel block 200 to control the exposure time for each pixel block 200. The exposure control unit 412 is provided in the control block 400A, extending in the row direction.

[0039] The pixel driving unit 413 outputs the control signal generated by the exposure control unit 412 to the pixels 201 included in the corresponding pixel block 200. The pixel driving unit 413 is a driving circuit that drives the pixels 201 included in the corresponding pixel block 200. The pixel driving unit 413 drives the pixels 201 in a pixel row selected from the pixels 201 included in the corresponding pixel block 200. The pixel driving unit 413 is provided extending in the column direction. As a result, the pixel driving unit 413 is disposed at a position corresponding to the m pixels 201 arranged in the column direction. In the control block 400A, the autonomous exposure processing unit 411, exposure control unit 412, and pixel driving unit 413 are arranged in an L shape, with the pixel driving unit 413 extending in the column direction and the autonomous exposure processing unit 411 and exposure control unit 412 extending in the row direction.

[0040] The signal input unit 421 receives pixel signals output from pixels 201 included in the corresponding pixel block 200. The signal input unit 421 outputs the received pixel signals to the signal conversion unit 422. The signal input unit 421 may be provided for each n pixels 201 arranged in the row direction in the corresponding pixel block 200. The signal input unit 421 may include a processing circuit that performs signal processing such as noise reduction on the pixel signals output from the first semiconductor substrate 110. The signal input unit 421 may also include a voltage adjustment circuit that adjusts the voltage of the signal line 202 connected to the pixel 201 included in the corresponding pixel block 200 so that it does not fall below a predetermined value. When the load current source 306 is disposed on the second semiconductor substrate, it may be disposed in the signal input unit 421 included in the corresponding control block 400A.

[0041] The signal conversion unit 422 converts the pixel signals output from the signal input unit 421 into digital signals. The signal conversion unit 422 sequentially converts into digital signals the pixel signals output from m pixels 201 arranged in the column direction in the corresponding pixel block 200. The signal conversion unit 422 converts into parallel digital signals the pixel signals output from the pixels 201 arranged in n columns in the row direction in the corresponding pixel block 200.

[0042] The signal output unit 423 stores the pixel signals converted into digital signals by the signal conversion unit 422. The signal output unit 423 may have a latch circuit for storing the digital signals. The signal output unit 423 is arranged between the signal conversion unit 422 and the autonomous exposure processing unit 411 in the column direction. The signal output unit 423 outputs the pixel signals converted into digital signals to the outside of the control circuit unit 102. The signal output unit 423 is provided in the control block 400A and extends in the row direction. The signal output unit 423 is arranged between the signal conversion unit 422 and the autonomous exposure processing unit 411 in the column direction.

[0043] 5 is an explanatory diagram showing an example of the internal configuration of the control block 400A. The signal conversion unit 422 includes n comparators 501 and n storage units 502. The exposure control unit 412 includes a pixel block control unit 503 and a level shift unit 504. A combination of one comparator 501 and a storage unit 502 connected to that comparator 501 forms one ADC (Analog-to-Digital Converter) 500.

[0044] The comparators 501 are provided in the control block 400A, extending in the column direction. n comparators 501 are arranged side by side in the row direction. A comparator 501 is arranged for every m pixels 201 arranged in the column direction in the corresponding pixel block 200. The comparators 501 sequentially read out pixel signals from the m pixels 201 arranged in the column direction in the corresponding pixel block 200 and convert them into digital signals.

[0045] The storage unit 502 stores pixel signals converted into digital signals using the comparator 501. The storage unit 502 is provided on the negative side of the comparator 501 in the Y-axis direction in the signal conversion unit 422. For example, the storage unit 502 has a latch circuit. The storage unit 502 may have a memory configured with an SRAM or the like.

[0046] The pixel block control unit 503 controls the operation of the transfer unit 301 and discharge unit 302 of the pixels 201 included in the corresponding pixel block 200. Specifically, the pixel block control unit 503 outputs a transfer control signal φTX for controlling the transfer unit 301 of the pixels 201 included in the corresponding pixel block 200, and a discharge control signal φPDRST for controlling the discharge unit 302 of the pixels 201 included in the corresponding pixel block 200. The pixel block control unit 503 is provided extending in the row direction in the control block 400A. The pixel block control unit 503 is arranged between the level shift unit 504 and the autonomous exposure processing unit 411 in the column direction.

[0047] The level shift unit 504 adjusts the voltage level of the control signal output from the pixel block control unit 503. Specifically, the level shift unit 504 boosts the voltage level of the transfer control signal φTX output from the pixel block control unit 503. The level shift unit 504 also boosts the voltage level of the discharge control signal φPDRST output from the pixel block control unit 503.

[0048] The transfer unit 301 receives the transfer control signal φTX boosted by the pixel block control unit 503 via a transfer control line 311. The discharge unit 302 receives the discharge control signal φPDRST boosted by the pixel block control unit 503 via a discharge control line 312.

[0049] In this way, the pixel block control unit 503 boosts the transfer control signal φTX and the discharge control signal φPDRST to the voltage levels used in the transfer unit 301 and the discharge unit 302 of the readout unit 310 of the pixel 201. The level shift unit 504 is provided in the control block 400A, extending in the row direction.

[0050] The level shift unit 504 is provided closer to the outer periphery of the control block 400A than the pixel block control unit 503. The end of the level shift unit 504 on the positive side in the X-axis direction and the end on the negative side in the Y-axis direction are located at the outermost sides of the control block 400A. The end of the level shift unit 504 on the negative side in the X-axis direction is in contact with the pixel driving unit 413.

[0051] The level shift unit 504 and pixel drive unit 413 handle the level-shifted signal. On the other hand, the autonomous exposure processing unit 411, pixel block control unit 503, level shift unit 504, and pixel drive unit 413 handle the pixel signal output from the first semiconductor substrate 110.

[0052] Here, each component of the control block 400A is formed in a well region provided in the second semiconductor substrate 120. The well regions are provided separately according to the voltage level of the signals to be handled. The well regions are separated depending on whether the power supply used is a digital power supply or an analog power supply. Furthermore, even if the signal conversion unit 422 uses the same analog power supply, it may be separated from an area that uses another analog power supply from the standpoint of noise. Separating the well regions requires well isolation regions spaced apart according to the manufacturing process rules.

[0053] In the control block 400A, the well regions for forming the level shift unit 504 and the pixel driving unit 413 are separated from other well regions. For example, the level shift unit 504 and the pixel driving unit 413 can be provided in an L-shape, thereby sharing the well regions of the level shift unit 504 and the pixel driving unit 413. Sharing the well region makes it possible to omit a well isolation region, thereby improving layout efficiency.

[0054] The L-shaped pixel control unit 401 forms part of the outer periphery of the control block 400 A. This allows the well region to be shared with other control blocks 400 A adjacent in the row and column directions.

[0055] 6 is an explanatory diagram showing an example of signal transmission between the first semiconductor substrate 110 and the second semiconductor substrate 120 in the image sensor 100A. The global driving unit 600 is provided in the peripheral circuit unit 121 arranged on either side of the control circuit unit 102.

[0056] The transfer control line 311a and the discharge control line 312a are each connected to the pixels 201 included in the pixel block 200a. The transfer control line 311a is connected to the gate terminal of the transfer unit 301 of the pixel 201 included in the pixel block 200a, and the discharge control line 312a is connected to the gate terminal of the discharge unit 302 of the pixel 201 included in the pixel block 200a. The transfer control line 311a supplies the transfer control signal φTX output from the control block 400Aa to the transfer unit 301 of the pixel 201 included in the pixel block 200a. The discharge control line 312a supplies the discharge control signal φPDRST output from the control block 400Aa to the discharge unit 302 of the pixel 201 included in the pixel block 200a.

[0057] Similarly, the transfer control line 311b and the discharge control line 312b are each connected to the pixel 201 included in the pixel block 200b. The transfer control line 311b is connected to the gate terminal of the transfer unit 301 of the pixel 201 included in the pixel block 200b, and the discharge control line 312b is connected to the gate terminal of the discharge unit 302 of the pixel 201 included in the pixel block 200b. The transfer control line 311b supplies the transfer control signal φTX output from the control block 400Ab to the transfer unit 301 of the pixel 201 included in the pixel block 200b. The discharge control line 312b supplies the discharge control signal φPDRST output from the control block 400Ab to the discharge unit 302 of the pixel 201 included in the pixel block 200b.

[0058] When there is no need to distinguish between the transfer control lines 311a and 311b, they are referred to as transfer control lines 311. When there is no need to distinguish between the discharge control lines 312a and 312b, they are referred to as discharge control lines 312.

[0059] The transfer control line 311 and the discharge control line 312 are examples of local control lines connected to the first pixel of the pixel block 200. The transfer control line 311 and the discharge control line 312 are commonly connected to n pixels 201 arranged in the row direction in the pixel block 200.

[0060] The global driver 600 outputs a reset control signal φRST, a selection control signal φSEL, and a transfer selection control signal φTXSEL. The global driver 600 is connected to a reset control line 313, a selection control line 314, and a transfer selection control line 603 that output control signals to each pixel block 200.

[0061] The global driver 600 supplies a reset control signal φRST and a selection control signal φSEL to the plurality of pixel blocks 200 via a reset control line 313 and a selection control line 314. The global driver 600 supplies a transfer selection control signal φTXSEL to the plurality of control blocks 400A via a transfer selection control line 603.

[0062] The transfer selection control signal φTXSEL is supplied from the global driver 600 to the control block 400A to control the exposure time for each pixel block 200. The control block 400A, to which the transfer selection control signal φTXSEL is supplied, outputs the transfer selection control signal φTXSEL to the corresponding pixel block 200. The control block 400A determines whether to input the transfer selection control signal φTXSEL to the pixel 201 as the transfer control signal φTX or the discharge control signal φPDRST. As a result, input of the transfer control signal φTX or the discharge control signal φPDRST to the pixel 201 is skipped.

[0063] For example, when the transfer control signal φTX determines the end time of exposure, the control block 400A extends the exposure time by skipping the transfer control signal φTX. Also, when the transfer control signal φTX determines the start time of exposure, the control block 400A can shorten the exposure time by skipping the transfer control signal φTX. In this way, the exposure time of the pixel block 200 can be adjusted by the transfer selection control signal φTXSEL. The same applies when the discharge control signal φPDRST determines the start or end time of exposure.

[0064] The reset control line 313, the selection control line 314, and the transfer selection control line 603 are provided in common to multiple pixel blocks 200. The reset control line 313, the selection control line 314, and the transfer selection control line 603 are wired so as to cross the first semiconductor substrate 110 in the row direction. The reset control line 313, the selection control line 314, and the transfer selection control line 603 may also be wired so as to cross the first semiconductor substrate 110 in the column direction.

[0065] For example, the reset control line 313 is connected to the gate terminal of the reset unit 304 of the pixel 201 in the pixel block 200 and supplies the reset control signal φRST. The selection control line 314 is connected to the gate terminal of the selection unit 352 of the pixel 201 in the pixel block 200 and supplies the selection control signal φSEL. The transfer selection control line 603 is connected to each of the multiple control blocks 400A and supplies the transfer selection control signal φTXSEL to the pixel control unit 401.

[0066] Although the global driving unit 600 outputs the transfer selection control signal φTXSEL to the control block 400A from the second semiconductor substrate 120 via the first semiconductor substrate 110, the transfer selection control signal φTXSEL may be output to the control block 400A without passing through the first semiconductor substrate 110. In this case, the transfer selection control line 603 is provided on the second semiconductor substrate 120.

[0067] The bonding portion 610 is provided on the bonding surface where the first semiconductor substrate 110 and the second semiconductor substrate 120 are bonded to each other. The bonding portion 610 aligns the transfer control line 311, the discharge control line 312, and the transfer selection control line 603 between the first semiconductor substrate 110 and the second semiconductor substrate 120. Each of the bonding portions 610 is composed of a pair of conductive bonding pads, and is bonded and electrically connected by applying pressure to the first semiconductor substrate 110 and the second semiconductor substrate 120 or the like.

[0068] Image sensor 100A controls the exposure time for each pixel block 200 by changing the timing of at least one of transfer unit 301 and discharge unit 302 using local control lines such as transfer control line 311 and discharge control line 312. Image sensor 100A can control the exposure time with fewer control lines by combining local control lines such as transfer control line 311 and discharge control line 312 with global control lines such as reset control line 313, selection control line 314, and transfer selection control line 603.

[0069] FIG. 7 is an explanatory diagram showing an example of an XZ cross section of an image sensor 100A according to this embodiment. While FIG. 7 shows a back-illuminated image sensor 100A, the image sensor 100A is not limited to the back-illuminated type. The image sensor 100A includes a microlens layer 700, a color filter layer 702, a first semiconductor substrate 110, a second semiconductor substrate 120, and a third semiconductor substrate 130. As shown in the figure, light from a subject is incident in the direction indicated by the outline arrow (the negative Z-axis direction in the figure). The surface of the first semiconductor substrate 110 on which light is incident (the positive Z-axis side in the figure) may be referred to as the front surface, and the opposite surface (the negative Z-axis side in the figure) may be referred to as the back surface.

[0070] The microlens layer 700 has a plurality of microlenses 701. The plurality of microlenses 701 are stacked on the positive side of the Z axis relative to the color filter layer 702. Light is incident on the microlenses 701. The microlenses 701 focus the incident light onto the photoelectric conversion unit 300. A microlens 701 may be provided for each photoelectric conversion unit 300. The optical axis L of the microlens 701 is aligned with the stacking direction of the first semiconductor substrate 110, the second semiconductor substrate 120, and the third semiconductor substrate 130 (parallel to the Z axis).

[0071] The color filter layer 702 has a plurality of color filters 703 and a passivation film 704. The color filter layer 702 is stacked on the positive side of the Z axis from the first semiconductor layer 711. The color filter 703 is an optical filter that transmits light in a specific wavelength range. The color filter 703 is an optical filter that has specific spectral characteristics. The multiple color filters 703 have multiple optical filters with different spectral characteristics, and transmit light in different wavelength ranges. The multiple color filters 703 are arranged in a specific array (for example, a Bayer array).

[0072] An example of the first semiconductor substrate 110 is a back-illuminated CMOS image sensor. The first semiconductor substrate 110 has a first semiconductor layer 711 and a first wiring layer 712. The first semiconductor layer 711 is provided on the positive side of the Z axis relative to the first wiring layer 712. The first semiconductor layer 711 has a plurality of pixel blocks 200 arranged two-dimensionally in the row and column directions. The first semiconductor layer 711 has a plurality of pixels 201 arranged two-dimensionally in the row and column directions. Each of the plurality of pixels 201 has a plurality of photoelectric conversion units 300 that accumulate charge based on incident light, and a plurality of readout units 310.

[0073] The first wiring layer 712 is provided closer to the second semiconductor substrate 120 (toward the negative side of the Z axis in the drawing) than the first semiconductor layer 711. The first wiring layer 712 has a plurality of wires 713 made of a conductor film (metal film), a plurality of bonding pads 714, and an insulating film (insulating layer).

[0074] The first wiring layer 712 has a plurality of wirings 713 electrically connected to a power supply, a circuit, or the like. In the first semiconductor substrate 110, the wirings 713 are specifically, for example, a power supply wiring to which a predetermined power supply voltage is supplied, a signal line 202 that transmits pixel signals from the first semiconductor substrate 110 (pixels) to the second semiconductor substrate 120, a transfer control line 311 that transmits control signals from the second semiconductor substrate 120 to the first semiconductor substrate 110 (pixels), a discharge control line 312, a reset control line 313, a selection control line 314, and a transfer selection control line 603. The first wiring layer 712 may be multi-layered, and may include passive and active elements.

[0075] The bond pads 714 are provided on the surface (the surface on the negative side of the Z axis) of the first wiring layer 712 and are connected to the wiring 713. As will be described later, the bond pads 714 are also used to assist in connecting layers together. The bond pads 714 are formed of a conductive material such as copper. The bond pads 714 may also be formed of gold, silver, or aluminum. An insulating layer (insulating film) is formed between the multiple wirings 713 and between the multiple bond pads 714.

[0076] The second semiconductor substrate 120 has a second semiconductor layer 721, a second wiring layer 722, and a wiring layer 723. The second wiring layer 722 is provided closer to the first semiconductor substrate 110 than the second semiconductor layer 721 (on the positive side of the Z axis in the drawing). The wiring layer 723 is provided closer to the third semiconductor substrate 130 than the second semiconductor layer 721 (on the negative side of the Z axis in the drawing), and is provided between the second semiconductor layer 721 and the third semiconductor substrate 130. The second semiconductor layer 721 has a control circuit unit 102 and a peripheral circuit unit 121. The control circuit unit 102 has a plurality of control blocks 400A arranged two-dimensionally in the row and column directions.

[0077] Similar to the first semiconductor substrate 110, the second semiconductor substrate 120 has a plurality of wirings 713 provided on the second wiring layer 722, a plurality of bonding pads 714 provided on the second wiring layer 722 and the wiring layer 723, and an insulating film (insulating layer) provided on the second wiring layer 722 and the wiring layer 723.

[0078] The second wiring layer 722 has a plurality of wirings 713 and bonding pads 714 for electrically connecting to a power supply or circuitry, transmitting signals from the pixel unit 101 to the control circuit unit 102, and transmitting signals from the control circuit unit 102 to the pixel unit 101. In the second semiconductor substrate 120, the wirings 713 specifically include, for example, a power supply wiring for supplying a predetermined power supply voltage, a signal line 202 for transmitting pixel signals from the first semiconductor substrate 110 (pixels) to the second semiconductor substrate 120, and a transfer control line 311, a discharge control line 312, a reset control line 313, a selection control line 314, and a transfer selection control line 603 for transmitting control signals from the second semiconductor substrate 120 to the first semiconductor substrate 110 (pixels). The second wiring layer 722 may be multi-layered and may include passive and active elements. The wirings 713 and bonding pads 714 may also be provided in the wiring layer 723.

[0079] The second semiconductor substrate 120 further includes TSVs (through silicon vias) 724 that connect the circuits provided on the front and back surfaces to each other. The TSVs 724 are preferably provided in the peripheral region. The TSVs 724 transmit image data and the like generated by the data processing unit 103 to the first semiconductor substrate 110. The TSVs 724 may also be provided on the first semiconductor substrate 110 and the third semiconductor substrate 130.

[0080] The third semiconductor substrate 130 has a third semiconductor layer 731 in which the data processing unit 103 is provided, and a third wiring layer 732. The third wiring layer 732 is provided between the third semiconductor layer 731 and the second semiconductor substrate 120.

[0081] Similar to the first semiconductor substrate 110, the third semiconductor substrate 130 has wiring 713 and a plurality of bonding pads 714 provided on a third wiring layer 732. The third wiring layer 732 has the plurality of wirings 713 and bonding pads 714 for electrical connection to a power supply, a circuit, etc., for transmitting signals from the control circuit unit 102 to the data processing unit 103, and for transmitting signals from the data processing unit 103 to the control circuit unit 102 of the second semiconductor substrate 120.

[0082] The first semiconductor substrate 110, the second semiconductor substrate 120, and the third semiconductor substrate 130 are stacked by electrical connection between the bonding pads 714 provided on each layer and bonding between the wiring layers (insulating layers) of each layer.

[0083] When the first semiconductor substrate 110 and the second semiconductor substrate 120 are stacked, an interface 720 is formed between the negative surface of the first wiring layer 712 along the Z axis and the positive surface of the second wiring layer 722 along the Z axis. Similarly, when the second semiconductor substrate 120 and the third semiconductor substrate 130 are stacked, an interface 730 is formed between the negative surface of the wiring layer 723 along the Z axis and the positive surface of the third wiring layer 732 along the Z axis. A plurality of bonding pads 714 are arranged on the interface 720 and the interface 730. Specifically, corresponding bonding pads 714 are aligned, and the two layers are stacked, thereby electrically connecting the aligned bonding portions.

[0084] The first semiconductor substrate 110, the second semiconductor substrate 120, and the third semiconductor substrate 130 may be stacked in the form of a wafer before being made into chips, and then formed (singled) by dicing the stacked wafers, or may be formed by dicing each of the first semiconductor substrate 110, the second semiconductor substrate 120, and the third semiconductor substrate 130 wafers and then stacking them.

[0085] FIG. 8 is a timing chart showing an example 1 of imaging operation of the image sensor 100A. FIG. 8 shows an example of imaging operation in which the drive of the image sensor 100A is controlled by the transfer control signal φTX, the discharge control signal φPDRST, the reset control signal φRST, and the selection control signal φSEL. In FIG. 8, the discharge control signal φPDRST is locally controlled, and the transfer control signal φTX, the reset control signal φRST, and the selection control signal φSEL are globally controlled. Note that the suffixes at the end of each signal on the left side indicate <1> , <2> ,..., <m>indicates the row number of the pixel 201 within the pixel block.

[0086] The discharge control signal φPDRST controls the timing at which exposure starts. The exposure start timing corresponds to the falling edge of the discharge control signal φPDRST (for example, time T1). That is, before the exposure start time T1, the discharge control signal φPDRST turns on the discharge unit 302 to discharge the charge accumulated in the photoelectric conversion unit 300, and exposure starts at the falling edge of the discharge control signal φPDRST. Because the discharge control signal φPDRST is locally controlled, the exposure time can be adjusted for each pixel block 200.

[0087] The transfer control signal φTX controls the timing to end exposure. At time T3, the transfer control signal φTX turns on the transfer unit 301, thereby transferring the charge accumulated in the photoelectric conversion unit 300 to the FD 303. The timing to end exposure corresponds to the falling edge of the transfer control signal φTX (for example, time T4). Because the transfer control signal φTX is a globally controlled signal, the timing to end exposure is the same for each pixel block 200.

[0088] The reset control signal φRST controls the timing of discharging the charge accumulated in the FD 303. At time T2, the reset control signal φRST turns on the reset unit 304, thereby discharging the charge in the FD 303. By discharging the charge in the FD 303 before the end of exposure, the influence of the charge remaining in the FD 303 when the charge is transferred from the photoelectric conversion unit 300 can be suppressed.

[0089] The selection control signal φSEL is a signal for selecting an arbitrary pixel 201. The selection control signal φSEL controls the on / off of the selection unit 352. At time T2, the selection control signal φSEL is set to high. At time T3, the pixel 201 for which the selection control signal φSEL is set to high outputs a pixel signal to the signal line 202 in response to the transfer control signal φTX being turned on. On the other hand, the pixel 201 for which the selection control signal φSEL is not set to high does not output a pixel signal.

[0090] The image sensor 100A locally controls the discharge control signal φPDRST, thereby changing the exposure start timing for each pixel block 200 and controlling the exposure time for each pixel block 200. The image sensor 100A may also locally control the transfer control signal φTX to control the exposure end timing for each pixel block 200. The image sensor 100A may also locally control both the transfer control signal φTX and the discharge control signal φPDRST to control both the exposure start timing and end timing for each pixel block 200.

[0091] Fig. 9 is a timing chart showing a second imaging operation example of the image sensor 100A. Fig. 9 shows an imaging operation example in which the drive of the image sensor 100A is controlled by a transfer control signal φTX, a reset control signal φRST, and a selection control signal φSEL. The image sensor 100A differs from the case of Fig. 8 in that the timing of the start of exposure is controlled by a transfer control signal φTX. The differences from Fig. 8 will be particularly described.

[0092] The transfer control signal φTX controls the timing of the start and end of exposure. In frame (n), exposure starts at time T5 and ends at time T7.

[0093] At exposure start time T5, the transfer control signal φTX falls, thereby starting exposure. That is, before exposure start time T5, the transfer control signal φTX turns on the transfer unit 301 while the reset control signal φRST is on, thereby discharging the charge accumulated in the photoelectric conversion unit 300, and exposure starts at the falling edge of the transfer control signal φTX. Because the transfer control signal φTX is a locally controlled signal, the timing at which exposure starts in each pixel block 200 can be changed. However, the timing at which exposure starts in each pixel block 200 may also be synchronized.

[0094] Furthermore, at exposure end time T7, the transfer control signal φTX falls, thereby ending the exposure. That is, before exposure end time T7, the transfer control signal φTX turns on the transfer unit 301 while the reset control signal φRST is off, thereby transferring the charge accumulated in the photoelectric conversion unit 300 to the FD 303, and exposure ends at the falling edge of the transfer control signal φTX. Because the transfer control signal φTX is a locally controlled signal, the timing at which exposure ends can be changed for each pixel block 200. However, the timing at which exposure ends can also be synchronized for each pixel block 200.

[0095] The selection control signal φSEL is a signal for selecting an arbitrary pixel 201. At time T6, the pixel 201, for which the selection control signal φSEL is set high, outputs a pixel signal to the signal line 202.

[0096] The reset control signal φRST controls the timing of discharging the charge accumulated in the FD303. The reset control signal φRST may be a globally controlled signal. Since the reset control signal φRST is always on except at the timing of readout, no charge is accumulated in the FD303. On the other hand, by turning off the reset control signal φRST and turning on the transfer control signal φTX at the timing of readout, charge is transferred from the photoelectric conversion unit 300 to the FD303. The reset control signal φRST has the same switching timing as the readout, so it can be made common to the pulse of the selection control signal φSEL.

[0097] By locally controlling the transfer control signal φTX, the image sensor 100A can change the timing of the start or end of exposure for each pixel block 200, thereby controlling the exposure time for each pixel block 200. Furthermore, the image sensor 100A uses a common pulse for the reset control signal φRST and the selection control signal φSEL, which further simplifies the control circuit.

[0098] Fig. 10 is a timing chart showing an imaging operation of an image sensor according to a comparative example, in which the drive of the image sensor is controlled by the transfer control signal φTX, the reset control signal φRST, and the selection control signal φSEL, and the exposure time is not controlled for each pixel block 200.

[0099] In the comparative example, the start of exposure is controlled by the transfer control signal φTX and the reset control signal φRST. The exposure start timing is the timing (time t1) of the falling edges of the transfer control signal φTX and the reset control signal φRST. The exposure end timing is the timing (time t2) of the falling edge of the transfer control signal φTX. In the comparative example, the exposure start timing and end timing are controlled globally, and the exposure time is not controlled for each pixel block 200.

[0100] 11 is an explanatory diagram showing an example of a subject captured by the image sensor 100 A. In FIG. 11, the image sensor 100 A controls the exposure time for each pixel block 200 in a situation where the afternoon sun is shining outside a tunnel.

[0101] Areas 1 to 5 are five areas divided according to brightness. Areas 1 to 5 are numbered in order of brightness. Area 1 is the brightest area where the setting sun is directly visible. Area 2 is the area corresponding to the tunnel exit and is darker than Area 1. Area 3 is the area where the setting sun is reflected inside the tunnel and is darker than Area 2. Area 4 is the area inside the tunnel where the setting sun shines in from the exit and is darker than Area 3. Area 5 is the darkest area inside the tunnel where the setting sun does not shine in from the exit.

[0102] Image sensor 100A controls the exposure time for each pixel block 200 according to the brightness of each region. Image sensor 100A controls the exposure time so that the brighter the pixel block 200, the shorter the exposure time. The exposure time for region 1 is set to the shortest, and the exposure time for region 5 is set to the longest. For example, the exposure times for regions 1 to 5 are 1 / 19200 s, 1 / 1920 s, 1 / 960 s, 1 / 240 s, and 1 / 120 s.

[0103] Fig. 12 is a timing chart showing the exposure time for each of the regions 1 to 5 shown in Fig. 11. In Fig. 12, the image sensor 100A controls the exposure time for each of the pixel blocks 200 in the regions 1 to 5 shown in Fig. 11. The section from time T11 to time T19 corresponds to the video frame rate.

[0104] In region 1, the control block 400A controls driving so that the exposure time in the pixel block 200 is a predetermined exposure time ET1. The control block 400A controls the start of exposure with a discharge control signal φPDRST and the end of exposure with a transfer control signal φTX. In region 1, exposure ends at each of times T12 to T19.

[0105] In region 2, the control block 400A controls driving so that the exposure time in the pixel block 200 is exposure time ET2, which is longer than ET1. The control block 400A makes the exposure start time for region 2 earlier than region 1 and the exposure end time coincide with region 1. Therefore, in region 2, exposure ends at each of times T12 to T19. The exposure time ET2 for region 2 is shorter than the period of the sensor rate.

[0106] In region 3, the control block 400A controls driving so that the exposure time in the pixel block 200 is exposure time ET3, which is longer than ET2. The control block 400A makes the exposure start time for region 3 earlier than region 2 and the exposure end time coincide with region 2. Therefore, in region 3, exposure ends at each of times T12 to T19. The exposure time ET3 for region 3 is set to be the same as the period of the sensor rate.

[0107] In region 4, the control block 400A controls driving so that the exposure time in the pixel block 200 is an exposure time ET4 that is longer than ET3. The control block 400A sets the exposure start time for region 4 to the same time as region 3, but skips the end time of the exposure using the transfer selection control signal φTXSEL. The control block 400A skips three times using the transfer selection control signal φTXSEL, thereby achieving an exposure time four times longer than that of region 3. In region 4, the transfer selection control signal φTXSEL is supplied at each of times T12 to T14.

[0108] In region 5, the control block 400A controls driving so that the exposure time in the pixel block 200 is an exposure time ET5 that is longer than ET4. The control block 400A sets the same exposure start time for region 5 as for region 4, but increases the number of times to skip the end time of the exposure using the transfer selection control signal φTXSEL. The control block 400A skips seven times using the transfer selection control signal φTXSEL, thereby achieving an exposure time that is twice that of region 4. The exposure time ET5 for region 5 is set to be the same as the period of the video frame rate. In region 5, the transfer selection control signal φTXSEL is supplied at each of times T12 to T18.

[0109] The image sensor 100A achieves short-time exposure by shortening the interval between the transfer control signal φTX and the discharge control signal φPDRST. The image sensor 100 also achieves long-time exposure by skipping the control of the transfer control signal φTX using the transfer selection control signal φTXSEL. This allows for an expanded dynamic range.

[0110] 13 is a plan view showing an example layout of a plurality of control blocks 400A. The plurality of control blocks 400A are arranged in such a way that adjacent control blocks 400A are inverted. FIG. 13 illustrates 12 control blocks 400A out of the plurality of control blocks 400A provided in the control circuit section 102.

[0111] The inverted arrangement means that the areas in which the components of the control block 400A (for example, the exposure control unit 412, the pixel driving unit 413, the signal input unit 421, the signal conversion unit 422, and the signal output unit 423) are formed are arranged in a mirror-inverted arrangement (arranged in line symmetry) around the boundary between the control blocks 400A. The circuits of the components of the control block 400A do not have to be arranged in an inverted arrangement. Furthermore, the readout order of the pixels in the control block 400A is not limited to being inverted.

[0112] For example, when multiple control blocks 400A arranged adjacent to each other in the row direction are arranged in an inverted manner, the components of the control blocks 400A are arranged in an inverted manner in the row direction, so that the pixel driving units 413 of the control blocks 400A are arranged adjacent to each other at the boundary between the two control blocks 400A. This allows multiple pixel driving units 413 arranged adjacent to each other in the row direction to be laid out as a single pixel driving unit 413, thereby improving the layout efficiency of the control blocks 400A.

[0113] Similarly, when adjacent control blocks 400A in the column direction are arranged in an inverted manner, the components of the control blocks 400A are arranged in an inverted manner in the column direction, so that identical components are arranged adjacent to each other at the boundary between the two control blocks 400A. This allows the signal input units 421 adjacent to each other in the column direction to be laid out as a single signal input unit 421, improving the layout efficiency of the control blocks 400A.

[0114] The control blocks 400A are arranged in a mirrored arrangement relative to the adjacent control blocks 400A. All the control blocks 400A are arranged in a mirrored arrangement in the row and column directions, but they may be arranged in a mirrored arrangement in either the row or column directions. For example, the signal conversion unit 422 of a control block 400A is arranged in a mirrored arrangement relative to the signal conversion unit 422 of the control block 400A adjacent to it in the row direction. Furthermore, the signal conversion unit 422 of a control block 400A is also arranged in a mirrored arrangement relative to the signal conversion unit 422 of the control block 400A adjacent to it in the column direction.

[0115] The control block 400Aa and the control block 400Ab are arranged next to each other in the row direction. The control block 400Aa is arranged in an inverted manner relative to the control block 400Ab. The level shift unit 504 of the control block 400Aa is provided in the same well region as the level shift unit 504 of the control block 400Ab. Similarly, the pixel block control unit 503, the memory unit 502, and the signal output unit 423 are provided in the same well region in the control block 400Aa and the control block 400Ab.

[0116] The control block 400Ab and the control block 400Ac are arranged next to each other in the row direction. The control block 400Ab is arranged in an inverted manner relative to the control block 400Ac. The pixel driving unit 413 of the control block 400Ab is provided in the same well region as the pixel driving unit 413 of the control block 400Ac. The well region of the pixel driving unit 413 may also be shared with the well region of the level shift unit 504.

[0117] The control block 400Aa and the control block 400Ad are arranged next to each other in the column direction. The control block 400Aa is arranged in an inverted manner relative to the control block 400Ad. The pixel driving unit 413 of the control block 400Aa is provided in the same well region as the pixel driving unit 413 of the control block 400Ad. Furthermore, the signal conversion unit 422 of the control block 400Aa is provided in the same well region as the signal conversion unit 422 of the control block 400Ad.

[0118] The control block 400Ad and the control block 400Ae are arranged adjacent to each other in the column direction. The control block 400Ad is arranged in an inverted manner relative to the control block 400Ae. The pixel driving unit 413 and the level shifting unit 504 of the control block 400Ad are arranged in the same well region as the pixel driving unit 413 and the level shifting unit 504 of the control block 400Ae.

[0119] By arranging the control blocks 400A in an inverted manner, the image sensor 100 can improve the layout efficiency even when performing parallel signal processing for each control block 400A. By arranging the control blocks 400A in an inverted manner in the XY plane, the image sensor 100A can share well regions with adjacent control blocks 400A. This reduces the number of times well regions need to be switched, improving area efficiency.

[0120] 14 is a circuit diagram showing another example of the circuit configuration of pixel 201. In pixel 201, the same components as in FIG. 3 are assigned the same reference numerals, and descriptions thereof will be omitted. In pixel 201, the discharge unit 302 provided in pixel 201 is not provided. When discharging the charges accumulated in the photoelectric conversion unit 300 to the power supply wiring to which the power supply voltage VDD is supplied, a transfer control signal φTX is input to the gate terminal of the transfer unit 301, and a reset control signal φRST is input to the gate terminal of the reset unit 304.

[0121] Fig. 15 is a timing chart showing an imaging operation example 3 of the image sensor 100A. Fig. 15 shows an imaging operation example in which the pixel 201 shown in Fig. 14 is used to control the driving of the image sensor 100A by the transfer control signal φTX, the reset control signal φRST, and the selection control signal φSEL. The image sensor 100A differs from the case of Fig. 12 in that the timing of the start of exposure is controlled by the transfer control signal φTX. The differences from Fig. 12 will be particularly described.

[0122] The transfer control signal φTX controls the timing of the start and end of exposure. In frame (n), exposure starts at time T5 and ends at time T7.

[0123] At exposure start time T5, the transfer control signal φTX falls, thereby starting exposure. That is, before exposure start time T5, the transfer control signal φTX turns on the transfer unit 301 while the reset control signal φRST is on, thereby discharging the charge accumulated in the photoelectric conversion unit 300, and exposure starts at the falling edge of the transfer control signal φTX. Because the transfer control signal φTX is a locally controlled signal, the timing at which exposure starts in each pixel block 200 can also be changed.

[0124] Furthermore, at exposure end time T7, the transfer control signal φTX falls, thereby ending the exposure. That is, before exposure end time T7, the transfer control signal φTX turns on the transfer unit 301 while the reset control signal φRST is off, thereby transferring the charge accumulated in the photoelectric conversion unit 300 to the FD 303, and exposure ends at the falling edge of the transfer control signal φTX. Because the transfer control signal φTX is a locally controlled signal, the timing at which exposure ends can also be changed for each pixel block 200.

[0125] The selection control signal φSEL is a signal for selecting an arbitrary pixel 201. At time T6, the pixel 201, for which the selection control signal φSEL is set high, outputs a pixel signal to the signal line 202.

[0126] The reset control signal φRST controls the timing of discharging the charge accumulated in the FD303. The reset control signal φRST may be a globally controlled signal. Since the reset control signal φRST is always on except at the timing of readout, no charge is accumulated in the FD303. On the other hand, by turning off the reset control signal φRST and turning on the transfer control signal φTX at the timing of readout, charge is transferred from the photoelectric conversion unit 300 to the FD303. The reset control signal φRST has the same switching timing as the readout, so it can be made common to the pulse of the selection control signal φSEL.

[0127] 1 to 15, exposure is performed in units of pixel blocks 200 each consisting of a plurality of pixels 201, and pixel signals from the pixel blocks 200 are read out in units of control blocks 400A corresponding to the pixel blocks 200, converting analog signals into digital signals. Furthermore, the image sensor 100A reads out pixel signals in parallel for each pixel block 200 using the control blocks 400A provided for each pixel block 200. Therefore, the image sensor 100A can set the exposure time for each pixel block 200 according to the intensity of incident light, thereby expanding the dynamic range.

[0128] Next, the configuration of an image sensor 100B that performs exposure in units of pixel blocks 200, sequentially reads out pixel signals for each pixel row, and performs AD conversion for each pixel column will be described with reference to FIGS.

[0129] 16 is an exploded perspective view showing another example of an imaging element. The imaging element 100B includes a first semiconductor substrate 110, a second semiconductor substrate 120, and a third semiconductor substrate 130. As shown in FIG. 16, the first semiconductor substrate 110 is stacked on the second semiconductor substrate 120, and the second semiconductor substrate 120 is stacked on the third semiconductor substrate 130.

[0130] The first semiconductor substrate 110 has a pixel unit 101 and a connection region 1601. The pixel unit 101 outputs a pixel signal based on incident light. The connection region 1601 is arranged around the pixel unit 101. In the example of FIG. 16 , a pair of connection regions 1601 are arranged along two opposing sides of the first semiconductor substrate 110, in front of and behind the pixel unit 101.

[0131] The second semiconductor substrate 120 has a control circuit section 102 , a peripheral circuit section 121 and a signal processing section 1602 .

[0132] The control circuit section 102 outputs a control signal to the pixel section 101 to control the driving of the pixel section 101. The control circuit section 102 is disposed on the second semiconductor substrate 120 at a position facing the pixel section 101.

[0133] The peripheral circuit section 121 controls the driving of the control circuit section 102. The peripheral circuit section 121 is arranged around the control circuit section 102 on the second semiconductor substrate 120. The peripheral circuit section 121 may also be electrically connected to the first semiconductor substrate 110 and control the driving of the pixel section 101. The peripheral circuit section 121 is arranged along two opposing sides of the second semiconductor substrate 120, but the arrangement of the peripheral circuit section 121 is not limited to this example.

[0134] The signal processing unit 1602 receives analog pixel signals output from the first semiconductor substrate 110. The signal processing unit 1602 performs signal processing on the pixel signals. For example, the signal processing unit 1602 converts the analog pixel signals into digital signals. The signal processing unit 1602 may perform other signal processing. Examples of other signal processing include noise removal processing such as analog or digital CDS (Correlated Double Sampling). The signal processing unit 1602 is arranged on the periphery, i.e., outside, of the control circuit unit 102. In the example of FIG. 16 , a pair of signal processing units 1602 are arranged along two opposing sides of the second semiconductor substrate 120, in front and behind the control circuit unit 102. The signal processing units 1602 may be circuits included in the peripheral circuit unit 121.

[0135] The third semiconductor substrate 130 has a data processing unit 103. The data processing unit 103 uses the digital data output from the second semiconductor substrate 120 to perform addition processing, thinning processing, and other image processing.

[0136] Fig. 17 is an explanatory diagram showing another example of the specific configuration of the control circuit unit 102. In Fig. 17, the control block 400B has a pixel control unit 401 (autonomous exposure processing unit 411, exposure control unit 412, and pixel driving unit 413) but does not have a signal processing unit 402.

[0137] Instead of providing one control block 400B for one pixel block 200, one control block 400B may be provided for N pixel blocks 200 (N is a natural number greater than or equal to 2). The N pixel blocks 200 corresponding to one pixel block are sometimes referred to as a pixel block group. For example, two pixel blocks 200 arranged side by side in the column direction may be treated as one pixel block group, and one control block 400B may be provided for each pixel block group. In this case, the control block 400B may control the exposure time for each pixel block 200.

[0138] In other words, the control block 400B is electrically connected to at least one pixel block 200 and can be said to be the smallest unit of a circuit that controls exposure of the pixels 201 in the at least one pixel block 200.

[0139] 18 is an explanatory diagram showing the connection relationship between the first semiconductor substrate 110 and the second semiconductor substrate 120 in the image sensor 100B. The first semiconductor substrate 110 is provided around the pixel section 101 and includes connection regions 1801 and 1601 that are electrically connected to the pixel section 101. The second semiconductor substrate 120 is provided around the control circuit section 102 and includes connection regions 1802 and 1803 that are electrically connected to the control circuit section 102.

[0140] A pair of connection regions 1801 are connected to a pair of connection regions 1802 located opposite each other. The mutually connected connection regions 1801 and 1802 input control signals from the global driving unit 600 to the pixel unit 101 using global control lines.

[0141] The pair of connection regions 1601 are connected to a pair of connection regions 1803 located opposite each other. The mutually connected connection regions 1601 and 1803 input pixel signals from the pixel unit 101 to the corresponding ADC units 1820 and 1830 using a common signal line.

[0142] 19 is an explanatory diagram showing an example of signal transmission between the first semiconductor substrate 110 and the second semiconductor substrate 120 in the image sensor 100B. The global driver 600 outputs a reset control signal φRST, a selection control signal φSEL, and a transfer selection control signal φTXSEL. The global driver 600 is connected to a reset control line 1903 and a selection control line 1904 that output signals to each pixel block 200. The global driver 600 supplies the reset control signal φRST to the multiple pixel blocks 200 via the reset control line 1903 and the selection control signal φSEL via the selection control line 1904. The global driver 600 supplies the transfer selection control signal φTXSEL to the multiple control blocks 400B via a transfer selection control line 1905.

[0143] The transfer selection control signal φTXSEL is supplied from the global driver 600 to the control block 400B to control the exposure time for each pixel block 200. The control block 400B, to which the transfer selection control signal φTXSEL is supplied, outputs the transfer selection control signal φTXSEL to the corresponding pixel block 200. The pixel block 200 determines whether to input the transfer selection control signal φTXSEL to the pixel 201 as the transfer control signal φTX or the discharge control signal φPDRST. As a result, input of the transfer control signal φTX or the discharge control signal φPDRST to the pixel 201 is skipped.

[0144] For example, when the transfer control signal φTX determines the end time of exposure, the control block 400B extends the exposure time by skipping the transfer control signal φTX. Also, when the transfer control signal φTX determines the start time of exposure, the control block 400B can shorten the exposure time by skipping the transfer control signal φTX. In this way, the exposure time of the pixel block 200 can be adjusted by the transfer selection control signal φTXSEL. The same applies when the discharge control signal φPDRST determines the start or end time of exposure.

[0145] The reset control line 1903, the selection control line 1904, and the transfer selection control line 1905 are wired globally, i.e., are provided in common to a plurality of pixel blocks 200. The reset control line 1903, the selection control line 1904, and the transfer selection control line 1905 are wired in the row direction so as to cross the pixel unit 101. The reset control line 1903, the selection control line 1904, and the transfer selection control line 1905 may also be wired in the column direction so as to cross the pixel unit 101.

[0146] For example, the reset control line 1903 is connected to the gate terminal of the reset unit 304 of the pixel block 200 and supplies a reset control signal φRST. The selection control line 1904 is connected to the gate terminal of the selection unit 352 of the pixel block 200 and supplies a selection control signal φSEL. In addition, the transfer selection control line 1905 is connected to each of the multiple control blocks 400B and supplies a transfer selection control signal φTXSEL to the pixel control unit 401.

[0147] Although the global driving unit 600 outputs the transfer selection control signal φTXSEL from the second semiconductor substrate 120 to the first semiconductor substrate 110, the transfer selection control signal φTXSEL may be output to the control block 400B without being supplied to the first semiconductor substrate 110. In this case, the transfer selection control line 1905 is provided on the second semiconductor substrate 120.

[0148] On the other hand, the transfer control line 1901a and the discharge control line 1902a are connected to the pixel block 200a. The transfer control line 1901a is connected to the gate terminal of the transfer unit 301 provided in the pixel block 200a. The transfer control line 1901a supplies the transfer control signal φTX output from the control block 400Ba to the pixel block 200a. The discharge control line 1902a is connected to the gate terminal of the discharge unit 302 provided in the pixel block 200a. The discharge control line 1902a supplies the discharge control signal φPDRST output from the control block 400Ba to the pixel block 200a.

[0149] The transfer control line 1901b and the discharge control line 1902b are connected to the pixel block 200b. The transfer control line 1901b is connected to the gate terminal of the discharge transfer unit 301 provided in the pixel block 200b. The transfer control line 1901b supplies the transfer control signal φTX output from the control block 400Bb to the pixel block 200b. The discharge control line 1902b is connected to the gate terminal of the discharge unit 302 provided in the pixel block 200b. The discharge control line 1902b supplies the discharge control signal φPDRST output from the control block 400Bb to the pixel block 200b.

[0150] A plurality of junctions 610 are provided on the bonding surfaces where the first semiconductor substrate 110 and the second semiconductor substrate 120 are bonded to each other. The junctions 610 of the first semiconductor substrate 110 are aligned with the junctions 610 of the second semiconductor substrate 120. The opposing junctions 610 are bonded and electrically connected by, for example, applying pressure to the first semiconductor substrate 110 and the second semiconductor substrate 120. In this case, the junctions 610 of the global control lines may be located under the corresponding pixel block 200, or may be located in the connection region 1801 or the connection region 1802. On the other hand, the junctions 610 of the local control lines are provided under the corresponding pixel block 200 (and also on the control block 400B).

[0151] The image sensor 100B controls the exposure time for each pixel block 200 by changing the timing of at least one of the transfer unit 301 and the discharge unit 302 using local control lines. By combining local control lines and global control lines, the image sensor 100B can control the exposure time with fewer control lines.

[0152] 20 is an explanatory diagram showing the connection relationship between the ADC unit and pixel blocks. As shown in FIG. 20, a common signal line 202 extending in the column direction is arranged for each column within a pixel block 200c. Furthermore, this signal line 202 is also common to a plurality of pixel blocks 200c, 200d arranged in the column direction. Therefore, in this example, one signal line 202 is connected to m×M pixels 201 arranged in a single column, and pixel signals from these pixels 201 are output.

[0153] An ADC 2000 is connected to each of the signal lines 202 on the side of the second semiconductor substrate 120 via a joint 610. A plurality of ADCs 2000 corresponding to the plurality of signal lines 202 constitute an ADC unit 1820.

[0154] 20, the ADCs 2000 corresponding to the pixel blocks 200c and 200d in the odd-numbered columns are provided in the ADC unit 1820, and the ADCs 2000 corresponding to the pixel blocks 200e and 200f in the even-numbered columns are provided in the ADC unit 1830. However, the arrangement of the pixel blocks 200c, etc. and the corresponding ADC units 1820, etc. is not limited to this.

[0155] With the above configuration, each ADC 2000 converts pixel signals output sequentially from the m×M pixels 201 in one connected column into digital signals and outputs the converted signals. In this case, the ADC units 1820 and 1830 as a whole convert pixel signals from the pixels 201 arranged in n×N columns in the row direction into digital signals in parallel. From this perspective, this digital conversion can also be considered a type of so-called column ADC. Note that, although a single-slope ADC is an example of an ADC, other digital conversion methods may also be used. Furthermore, the connection positions of each pixel 201 and the signal line 202 are not limited to the form shown in FIG. 20 and may, for example, be within each pixel block 200c, etc.

[0156] 21 is a timing chart showing the imaging operation in the pixel block 200 of the image sensor 100B. Driving of the pixel block 200 is controlled by the transfer control signal φTX, the discharge control signal φPDRST, the reset control signal φRST, and the selection control signal φSEL.

[0157] The discharge control signal φPDRST controls the timing to start exposure. The exposure start timing corresponds to the falling edge of the discharge control signal φPDRST (for example, time T1). That is, before the exposure start time T1, the discharge control signal φPDRST turns on the discharge unit 302 to discharge the charge accumulated in the photoelectric conversion unit 300, and exposure starts at the falling edge of the discharge control signal φPDRST. Because the discharge control signal φPDRST is controlled locally, the exposure time can be adjusted for each pixel block 200.

[0158] The transfer control signal φTX controls the timing to end exposure. At time T3, the transfer control signal φTX turns on the transfer unit 301, thereby transferring the charges accumulated in the photoelectric conversion unit 300 to the FD 303. The timing to end exposure corresponds to the falling edge of the transfer control signal φTX (for example, time T4).

[0159] The reset control signal φRST controls the timing of discharging the charge accumulated in the FD 303. At time T2, the reset control signal φRST turns on the reset unit 304, thereby discharging the charge in the FD 303. By discharging the charge in the FD 303 before the end of exposure, the influence of the charge remaining in the FD 303 when the charge is transferred from the photoelectric conversion unit 300 can be suppressed.

[0160] The selection control signal φSEL is a signal for selecting an arbitrary pixel 201. The selection control signal φSEL controls the on / off of the selection unit 352. At time T2, the selection control signal φSEL is set to high. At time T3, the pixel 201 for which the selection control signal φSEL is set to high outputs a pixel signal to the signal line 202 in response to the transfer control signal φTX being turned on. On the other hand, the pixel 201 for which the selection control signal φSEL is not set to high does not output a pixel signal.

[0161] The image sensor 100B can locally control the discharge control signal φPDRST to change the exposure start timing for each pixel block 200 and control the exposure time for each pixel block 200. The image sensor 100B can also locally control the transfer control signal φTX to control the exposure end timing for each pixel block 200. The image sensor 100B can also locally control both the transfer control signal φTX and the discharge control signal φPDRST to control both the exposure start timing and end timing for each pixel block 200.

[0162] The pixel signal of each pixel 201 corresponds to the amount of charge accumulated in the photoelectric conversion unit 300. Therefore, controlling the timing of exposure of the pixel 201 can be said to be controlling the timing of charge accumulation in the photoelectric conversion unit 300. More specifically, controlling the timing of exposure of the pixel 201 can be said to be controlling the timing and length of the charge accumulation time from discharge to transfer of the charge.

[0163] 22 is an explanatory diagram showing an example of exposure timing for each pixel block 200. For three pixel blocks 200 arranged in a row, the exposure time is controlled for each pixel block 200. Here, the image sensor 100B changes the amount of exposure by shifting the pixel reset time for each pixel block 200.

[0164] Meanwhile, the timing of pixel signal readout is in order starting from the top pixel block 200. That is, pixel signals are read out from the pixels 201 in "pixel block 1," then from the pixels 201 in "pixel block 2," and then from the pixels 201 in "pixel block 3."

[0165] 21, pixel signals are read out sequentially from the pixels 201 in the upper rows within each pixel block 200. Therefore, when viewed from the entire pixel unit 101, pixel signals are read out sequentially from the upper row of the m×M pixels 201 in the same column that are connected to a common signal line 202. In other words, the global drive unit 600 sets the selection control signal φSEL to high for each row, from the first row to the m×Mth row, across the pixel blocks 200 arranged in a single column.

[0166] 20, for multiple pixel blocks 200 arranged in one row, a common selection control line 1904 is connected to the n×N pixels arranged in the same row. Therefore, pixel signals are read out in parallel from the n×N pixels 201 connected to the row for which the selection control signal φSEL is set high. This makes it possible to output pixel signals for one frame.

[0167] 20, these pixel signals are converted into digital form by the ADC units 1820 and 252. The digitally converted pixel signals are output to the subsequent image processing stage, where an image for one frame is formed.

[0168] As described above, from the viewpoint that pixel signals are read out sequentially from the top row of the same column among multiple pixel blocks 200, the readout method of this embodiment can also be said to be a so-called rolling shutter method for the entire pixel unit 101. However, it should be noted that even in this case, different exposure times can be set for each pixel block 200.

[0169] As described above, the image sensor 100B shown in FIGS. 16 to 22 performs exposure in units of pixel blocks 200, sequentially reading out pixel signals for each pixel row and performing AD conversion for each pixel column. Specifically, the image sensor 100B reads out pixel signals from the pixels 201 of the upper pixel block 200 among the pixel blocks 200 arranged in a row, and then reads out pixel signals from the pixels 201 of the pixel block 200 below it. This smooths out image distortion caused by the readout order when capturing an image of a moving subject, thereby reducing the sense of incongruity felt by the viewer. More specifically, when a moving subject is captured in parallel from the pixel blocks 200 arranged in a row, multiple sawtooth-like steps corresponding to the pixel blocks 200 appear in the vertical direction of the image (i.e., corresponding to the pixel column direction), causing the viewer to feel uncomfortable. In contrast, the image sensor 100B shown in FIGS. 16 to 22 does not display these steps in the image.

[0170] Furthermore, the image sensor 100B shown in FIGS. 16 to 22 does not include an ADC unit that converts analog signals to digital signals within the control block 400B, but instead has a signal processing unit 1602 located outside the control circuit unit 102. This allows the area of ​​the control block 400B to be reduced, thereby reducing the size of the pixel blocks 200 located at positions corresponding to the control block 400B. In other words, exposure control by the control block 400B can be performed in units of a small number of pixels. This allows for precise exposure time control within an image, making the boundaries of the pixel blocks 200 less noticeable on the image. Furthermore, since digital conversion is not performed directly below the pixels 201, the impact of noise on the pixels 201 due to heat generation can be suppressed.

[0171] The signal processing unit 1602 does not have to be provided in multiple separate regions, and may be provided in one region for the entire pixel portion 101.

[0172] As described above, from the viewpoint that pixel signals are ultimately read out sequentially from the top row of the same column among the multiple pixel blocks 200, just like in the image sensor 100A, the readout method of the image sensor 100B can also be said to be a so-called rolling shutter method for the entire pixel unit 101. However, even in this case, just like the image sensor 100A, it is possible to set different exposure times for each pixel block 200. As a result, just like the image sensor 100A, the image sensor 100B also smooths out image distortion caused by the readout order when capturing an image of a moving subject, thereby reducing the sense of incongruity felt by the viewer.

[0173] [Autonomous exposure processing unit 411] Next, we will explain the details of the autonomous exposure processing unit 411. In the following explanation, when there is no need to distinguish between the image sensors 100A and 100B, they will be referred to as image sensor 100, and when there is no need to distinguish between the control blocks 400A and 400B, they will be referred to as control block 400.

[0174] 4 and 17, the autonomous exposure processing unit 411 is implemented in the control block 400. The autonomous exposure processing unit 411 can also be implemented in the peripheral circuit unit 121 instead of in the control block 400, or it can be implemented in both the control block 400 and the peripheral circuit unit 121. These three patterns will be explained below with reference to FIGS. 23 to 25.

[0175] 23 is a block diagram showing an example configuration of autonomous exposure control system 1. Autonomous exposure control system 1 is an example configuration in which an autonomous exposure processing unit 411 is implemented within a control block 400. Adding the autonomous exposure processing unit 411 within the control block 400 increases the circuit size of the control block 400, but each pixel 201 in the pixel block 200 may become larger by that amount, making it possible to increase the light receiving area.

[0176] 23 will be described using the control block 400A as an example (the same applies to FIG. 25). The control block 400A has a signal conversion unit 422, a signal output unit 423, an autonomous exposure processing unit 411, an exposure control unit 412, and a pixel driving unit 413. For ease of explanation, the signal input unit 421 is omitted. In the case of the control block 400B, the signal input unit 421, the signal conversion unit 422, and the signal output unit 423 are not included in the control block 400B, but are arranged on the second semiconductor substrate 120 as a signal processing unit 1602 (the same applies to FIG. 25).

[0177] The signal conversion unit 422 has n ADCs 500. Each of the n ADCs 500 converts analog pixel signals from the m pixels 201 connected in the column direction into digital signals. The ADC 500 is configured with a comparator 501 and a storage unit 502.

[0178] The column selection circuit 2301 is included in the signal output unit 423. The column selection circuit 2301 sequentially selects columns of the pixel block 200 each time a readout column selection signal is input from an external device. Each time a horizontal transfer clock is input from an external device, the column selection circuit 2301 outputs digital pixel signals from m pixels 201 in the selected column to the peripheral circuit unit 121 via a horizontal transfer line 2300, and also outputs the signals to the autonomous exposure processing unit 411.

[0179] The autonomous exposure processor 411 calculates an exposure value that indicates the exposure time of the pixel block 200. Specifically, the autonomous exposure processor 411 has, for example, a preprocessing unit 2311, a controller 2312, and an exposure value calculation unit 2313.

[0180] The preprocessing unit 2311 acquires digital pixel signals for each pixel column of the pixel block 200 from the column selection circuit 2301. The preprocessing unit 2311 then calculates statistical values ​​(e.g., average, median, maximum, or minimum) of the acquired pixel signals. The preprocessing unit 2311 outputs the calculation results to the exposure value calculation unit 2313.

[0181] The controller 2312 inputs a reset signal to the pre-processing unit 2311, causing the pre-processing unit 2311 to reset the pre-processing. This causes the pre-processing unit 2311 to calculate statistical values ​​of pixel signals from the pixel block 200 each time it is reset, that is, for each frame.

[0182] The exposure value calculation unit 2313 determines the next exposure value based on the calculation result (statistical value of pixel signals) from the preprocessing unit 2311. Specifically, for example, the exposure value calculation unit determines the next exposure value based on the calculation result so as not to result in underexposure or overexposure. For example, the exposure value calculation unit 2313 holds a first threshold value and a second threshold value. The first threshold value is a threshold value for determining whether the calculation result will be underexposed. The second threshold value is a threshold value greater than the first threshold value and is a threshold value for determining whether the calculation result will be overexposed.

[0183] The exposure value calculation unit 2313 determines whether the calculation result is equal to or greater than the first threshold value and equal to or less than the second threshold value. If the calculation result is equal to or greater than the first threshold value and equal to or less than the second threshold value, the exposure value calculation unit outputs the calculation result as the exposure value to the latch circuit 2321 of the exposure control unit 412. If the calculation result is less than the first threshold value, the exposure value calculation unit 2313 outputs the first threshold value as the exposure value to the latch circuit 2321 of the exposure control unit 412. If the calculation result is greater than the second threshold value, the exposure value calculation unit outputs the second threshold value as the exposure value to the latch circuit 2321 of the exposure control unit 412.

[0184] The exposure value calculation unit 2313 may also hold multiple exposure value ranges. In this case, if the calculation result is equal to or greater than the first threshold value and equal to or less than the second threshold value, the exposure value calculation unit 2313 outputs the number of levels of the exposure value range that includes the calculation result as the exposure value to the latch circuit 2321 of the exposure control unit 412.

[0185] If the calculation result is less than the first threshold value, the exposure value calculation unit 2313 outputs a number that is one or more steps higher than the number of steps in the exposure value range that includes the calculation result as the exposure value to the latch circuit 2321 of the exposure control unit 412. If the calculation result exceeds the second threshold value, the exposure value calculation unit 2313 outputs a number that is one or more steps lower than the number of steps in the exposure value range that includes the calculation result as the exposure value to the latch circuit 2321 of the exposure control unit 412.

[0186] The exposure control unit 412 includes, for example, a latch circuit 2321, a shift register 2322, a pixel block control unit, and a level shift unit. The latch circuit 2321 holds the exposure value from the autonomous exposure processing unit. Each time a latch pulse is input from the outside, the latch circuit 2321 outputs the held exposure value to the pixel block control unit and the shift register 2322.

[0187] The shift register 2322 converts the exposure value from the latch circuit 2321 from parallel to serial and outputs the serial signal to the data processing unit.

[0188] If the exposure time is calculated by an external system outside the image sensor 100 and the calculation result is fed back to the image sensor 100, it takes time for the exposure time to be reflected in the image sensor 100, resulting in increased power consumption. In contrast, by providing an autonomous exposure processing unit 411 within the control block 400, it is possible to improve the speed at which the exposure time is reflected in the pixel block 200 and reduce power consumption.

[0189] 23 has described a case where one control block 400 controls the exposure of one pixel block 200, but when one control block 400 controls the exposure of multiple pixel blocks 200, the autonomous exposure processing unit 411 may calculate an exposure value by sequentially selecting one pixel block 200 from the multiple pixel blocks 200 in synchronization with a reset signal. A selector is provided on the output side of the exposure value calculation unit 2313, and the controller 2312 outputs a selection signal to the selector to select one pixel block 200 from the multiple pixel blocks 200.

[0190] Furthermore, in this case, the exposure control unit 412 has a latch circuit 2321 and a shift register 2322 for each pixel block 200. Each latch circuit 2321 is connected to a selector (not shown) in the autonomous exposure processing unit 411, and when an exposure value is input from the selector, the latch circuit 2321 outputs the held exposure value to the pixel block control unit 503 and the shift register 2322 each time a latch pulse is input. This makes it possible to achieve autonomous exposure even when one control block 400 controls the exposure of multiple pixel blocks 200.

[0191] 24 is a block diagram showing an example configuration of autonomous exposure control method 2. Autonomous exposure control method 2 is an example configuration in which an autonomous exposure processing unit 411 is implemented in the peripheral circuit unit 121. The autonomous exposure processing unit 411 is implemented in the peripheral circuit unit 121 rather than in the control block. This allows the circuit scale of the control block 400 to be smaller than in the case of FIG. 23.

[0192] The peripheral circuit unit 121 is connected to the pixel unit 101 via a horizontal transfer unit 2410. The horizontal transfer unit 2410 is connected to each pixel block 200 arranged in the row direction (hereinafter referred to as a pixel block row), and transfers pixel signals for each pixel block row to the peripheral circuit unit 121. Because the pixel unit 101 is a collection of pixel blocks 200 with M rows and N columns, the horizontal transfer unit 2410 transfers pixel signals to the peripheral circuit unit 121 for each M pixel block rows.

[0193] The peripheral circuit unit 121 has row-direction autonomous exposure processor groups 2400-1 to 2400-M (when not distinguishing between them, simply referred to as row-direction autonomous exposure processor groups 2400) for each pixel block row. The row-direction autonomous exposure processor group 2400 has a data sampling unit 2411 and autonomous exposure processors 411 (pre-processing units 2311, controllers 2312, and exposure value calculation units 2313) for the number N of columns of pixel blocks. In FIG. 24, since N=4, four sets of pre-processing units 2311, controllers 2312, and exposure value calculation units 2313 are implemented.

[0194] The data sampling unit 2411 divides the pixel signal sequence of the pixel block row from the horizontal transfer unit 2410 into N equal parts and samples them. The data sampling unit 2411 outputs each of the sampled pixel signal sequences to the corresponding pre-processing unit 2311.

[0195] As described above, the preprocessing unit 2311 calculates statistical values ​​of pixel signals from the corresponding pixel block 200. Furthermore, since the peripheral circuit unit 121 can have a larger circuit scale than the control block 400, the preprocessing unit 2311 can perform other processes in addition to calculating statistical values ​​of pixel signals.

[0196] For example, the preprocessing unit 2311 has a memory that stores the pixel numbers of defective pixels in the corresponding pixel block 200 that were defective during manufacturing, and when the data sampling unit 2411 samples a pixel signal of that pixel number, the preprocessing unit 2311 does not use the sampled pixel signal in calculating the statistical value of that pixel signal. This makes it possible to improve the accuracy of calculating the statistical value of the pixel signal.

[0197] Furthermore, the preprocessing unit 2311 may acquire calculation results from other preprocessing units 2311 that are responsible for pixel blocks 200 adjacent to the corresponding pixel block 200, and calculate statistical values ​​of pixel signals from the corresponding pixel block 200 based on the calculation results acquired from the other preprocessing units 2311. This makes it possible to smooth out exposure differences between adjacent pixel blocks 200.

[0198] Furthermore, the exposure value calculation unit 2313 is set with a first threshold value and a second threshold value, but at least one of the first threshold value and the second threshold value may be changeable according to the shooting mode of the imaging device in which the image sensor 100 is implemented, thereby enabling optimal exposure calculation according to the shooting mode.

[0199] The peripheral circuit unit 121 also has a latch circuit 2321 and a shift register 2322 for each exposure value calculation unit 2313. The shift register 2322 performs parallel-to-serial conversion on the exposure value from the latch circuit 2321, outputs the serial signal to the data processing unit 103, and also outputs the exposure value to the exposure control unit 412 in the control block 400 corresponding to the pixel block 200.

[0200] The configuration shown in FIG. 24 allows the circuit scale of the control block 400 to be smaller than that of FIG. 23, and the size of the corresponding pixel block 200 to be reduced. This increases the number of pixel blocks, enabling more precise autonomous exposure control. The exposure control unit 412 and pixel driving unit 413 may also be implemented in the peripheral circuit unit 121. This allows the circuit scale of the control block 400 to be further reduced, and the size of the corresponding pixel block 200 to be reduced.

[0201] 25 is a block diagram showing an example configuration of autonomous exposure control method 3. Autonomous exposure control method 3 is an example configuration in which autonomous exposure processing unit 411 is implemented both in control block 400A and in peripheral circuit unit 121. When performing automatic exposure control in control block 400A, data transmission such as sending pixel signals from control block 400A to peripheral circuit unit 121 and sending exposure values ​​from peripheral circuit unit 121 to pixel block 200 is not necessary. Therefore, feedback to the corresponding pixel block 200 is faster than when performing in peripheral circuit unit 121.

[0202] On the other hand, since the area of ​​the control block 400A is restricted by the area of ​​the corresponding pixel block 200, the circuit scale of the autonomous exposure processing unit 411 can be made larger by implementing it in the peripheral circuit unit 121 rather than implementing it within the control block 400A. For this reason, implementing it in the peripheral circuit unit 121 makes it possible to implement more advanced functions for autonomous exposure control (for example, removal of pixel signals from defective pixels, control of exposure gaps between adjacent pixel blocks 200, and calculation of optimal exposure according to the shooting mode, as explained in FIG. 24).

[0203] Therefore, in autonomous exposure control method 3, image sensor 100 performs autonomous exposure control depending on the situation, using peripheral circuitry 121 when performing high-performance calculations related to autonomous exposure control, or using control block 400A when performing high-speed feedback of exposure values. In Fig. 25, as an example, in autonomous exposure control method 3, autonomous exposure control is performed by row-direction autonomous exposure processing units 2400 in peripheral circuitry 121, but image sensor 100 performs autonomous exposure control for each control block 400A when a trigger is given to control circuitry 102.

[0204] For example, when a user selects high-performance calculations related to autonomous exposure control, the image sensor 100 executes autonomous exposure control in the peripheral circuit unit 121, and when a user selects high-speed execution of exposure value feedback, the image sensor 100 executes autonomous exposure control in the control block 400A. Furthermore, when the remaining battery charge falls below a predetermined level, the image sensor 100 may select and execute low-power consumption processing between high-performance calculations related to autonomous exposure control and high-speed execution of exposure value feedback.

[0205] The row-direction autonomous exposure processing unit group 2400 mounted in the peripheral circuit unit 121 has the same configuration as that shown in FIG. 24, and is therefore omitted in FIG.

[0206] The column selection circuit 2301 outputs an n-bit digital pixel signal to n OR circuits 2501. The autonomous exposure processing unit 2500 in the control block 400A has, in addition to the controller 2312, n OR circuits 2501, an output data latch circuit 2502, and an n-bit AND circuit 2503.

[0207] When the n-bit signal is output from the output data latch circuit 2502 , the controller 2312 inputs a reset signal to the output data latch circuit 2502 .

[0208] The OR circuit 2501 is a logic circuit with two inputs and one output. One input of the OR circuit 2501 is connected to the column selection circuit, and the other input is connected to the output of the n-bit AND circuit 2503.

[0209] The n OR circuits 2501 are connected to the input of an output data latch circuit 2502. The output data latch circuit 2502 holds the n-bit signal from the n OR circuits 2501. When a horizontal transfer clock is input, the output data latch circuit 2502 outputs an n-bit signal to an n-bit AND circuit 2503. When a reset signal is input from the controller 2312, the output data latch circuit 2502 resets the n-bit signal it is holding, and outputs an n-bit signal in which at least one bit of the n bits is 0 to the n-bit AND circuit 2503.

[0210] The n-bit AND circuit 2503 is an AND circuit with n inputs and 1 output, and the output of the output data latch circuit 2502 is connected to the input of the n-bit AND circuit 2503. The output of the n-bit AND circuit 2503 is connected to the selector 2512 of the exposure control unit 412 and the input of each OR circuit 2501. If the output from the n-bit AND circuit 2503 is "0", this indicates that the pixel row that output the n-bit digital pixel signal is not saturated. If the output from the n-bit AND circuit 2503 is "1", this indicates that the pixel row that output the n-bit digital pixel signal is saturated. Hereinafter, a 1-bit signal whose output is "1" from the n-bit AND circuit 2503 will be referred to as a saturation detection signal.

[0211] If the value of the digital pixel signal from a pixel 201 in a pixel column is "1," this indicates that the pixel 201 is saturated. If all values ​​of the n-bit signal from the column selection circuit 2301 are "1," this indicates that the entire pixel column is saturated. In this case, all "1"s are input to one input of each OR circuit 2501, and each OR circuit 2501 outputs a 1-bit signal with a value of "1" to the output data latch circuit 2502.

[0212] The output data latch circuit 2502 holds these n-bit signals, all of which have the value “1”, and outputs the held n-bit signal to an n-bit AND circuit 2503 when a horizontal transfer clock is input.

[0213] When an n-bit signal whose value is all "1" is input, the n-bit AND circuit 2503 outputs a saturation detection signal whose value is "1" to the selector 2512 and each OR circuit 2501. As a result, the output data latch circuit 2502 outputs an n-bit signal whose value is all "1" to the n-bit AND circuit 2503 until a reset signal is input. Therefore, the n-bit AND circuit 2503 outputs a saturation detection signal until a reset signal is input to the output data latch circuit 2502 from the controller 2312.

[0214] 24, the exposure control unit 412 has a shift register 2511 and a selector 2512. The shift register 2511 converts the exposure value from the peripheral circuit unit 121 from serial to parallel, and outputs the converted value to the level shift unit 504 and the selector 2512.

[0215] The selector 2512 receives the exposure value and the set exposure value from the shift register 2511. The selector 2512 selects either the exposure value from the shift register 2511 or the set exposure value based on the output signal from the n-bit AND circuit 2503, and outputs the selected exposure value to the latch circuit 2321. The set exposure value is an exposure value that corresponds to an exposure time that does not saturate the pixel 201, and is, for example, an exposure value that is set so as to minimize the exposure time.

[0216] The set exposure value is calculated and set, for example, by an external system outside the control block 400A. The set exposure value may be a fixed value or may be selected by the external system. The external system may be, for example, the peripheral circuit unit 121 in the image sensor 100, the data processing unit 103 on the third semiconductor substrate 130, or an image processing unit connected to the image sensor 100 in an imaging device having the image sensor 100.

[0217] Specifically, for example, when the output signal from the n-bit AND circuit 2503 is not a saturation detection signal, the selector 2512 selects the exposure value from the shift register 2511 and outputs it to the latch circuit 2321. On the other hand, when the output signal from the n-bit AND circuit 2503 is a saturation detection signal, the selector 2512 selects the set exposure value and outputs it to the latch circuit 2321.

[0218] In the control block 400A, the autonomous exposure processing unit 2500 and the exposure control unit 412 execute autonomous exposure control using the exposure value from the peripheral circuit unit 121 until saturation is detected in the control block 400A. When saturation is detected in the control block 400A, autonomous exposure control is executed using the set exposure value in the exposure control unit 412.

[0219] This makes it possible to select between a process in which a highly accurate exposure value is set for a non-saturated pixel column using the exposure value from the peripheral circuit unit 121, and a process that enables simple and high-speed feedback in which a set exposure value is changed to a non-saturated state for a saturated pixel column.

[0220] Furthermore, the autonomous exposure processing unit 2500 in the control block 400 may be the autonomous exposure processing unit 411 shown in Fig. 23. In this case, for example, it may be possible to make it possible to select between the autonomous exposure processing unit 411 in the peripheral circuit unit 121 and the autonomous exposure processing unit 411 in the control block 400 by user setting.

[0221] For example, an imaging device incorporating the image sensor 100 may be able to select between the autonomous exposure processing unit 411 in the peripheral circuit unit 121 and the autonomous exposure processing unit 411 in the control block 400 based on the remaining battery power. In this case, the imaging device may select autonomous exposure control by the autonomous exposure processing unit 411 in the peripheral circuit unit 121 if the remaining battery power is equal to or greater than a predetermined value, and may select autonomous exposure control by the autonomous exposure processing unit 411 in the control block 400 if the remaining battery power is less than the predetermined value. Furthermore, a user may select the autonomous exposure processing unit 411 in the peripheral circuit unit 121 if they want to capture high-quality images, or select the autonomous exposure processing unit 411 in the control block 400 if they want to reduce power consumption.

[0222] <Layout of autonomous exposure control system> Next, the layout of the autonomous exposure control system will be described. The autonomous exposure processing unit 411 may be implemented in the control block 400 as shown in Figures 23 and 25, or in the peripheral circuit unit 121 as shown in Figures 24 and 25. The former will be described in Figure 26, and the latter will be described in Figures 27 and 28. In Figures 26 to 28, the circuit configuration of the control block 400A will be used as an example, but in the case of the control block 400B, the signal processing unit 402 in the control block 400A will be laid out on the second semiconductor substrate 120 outside the control block 400B as the signal processing unit 1602.

[0223] Fig. 26 is a block diagram showing an example layout when autonomous exposure processing units are implemented in adjacent control blocks. Fig. 13 shows an example layout of multiple control blocks 400A. Fig. 26 provides a detailed explanation of the internal configuration of two control blocks 400Aa, 400Ab that are adjacent in the row direction without a pixel driving unit 413 in between in the configuration of autonomous exposure control system 1 shown in Fig. 23.

[0224] 26 will be described taking as an example two control blocks 400Aa and 400Ab that are adjacent to each other in the row direction shown in FIG. 13 without a pixel driving unit 413 in between. To indicate which of the control blocks 400Aa and 400Ab the internal configuration of the control block 400Aa is referred to, the internal configuration of the control block 400Aa will have an a suffix added to the end of the reference symbol, and the internal configuration of the control block 400Ab will have an b suffix added to the end of the reference symbol.

[0225] The signal lines shown in the legend indicate the connections within the internal configuration. Solid arrows are global pixel signal lines 2601G, and dotted arrows are local pixel signal lines 2601L. Solid thick arrows are global control signal lines 2602G, and dotted thick arrows are local control signal lines 2602L. Dot-dash lines are data lines 2603 between control blocks. Pixel signal lines are signal lines that transmit pixel signals, and control signal lines are signal lines that transmit control signals.

[0226] The global pixel signal line 2601G is a pixel signal line (horizontal transfer line) shared by the row-oriented control blocks 400A. The local pixel signal line 2601L is a pixel signal line within that control block 400A. The global control signal line 2602G is a control signal line shared by the row-oriented control blocks 400A. The local control signal line 2602L is a control signal line within that control block 400A. The inter-control block data line 2603 is a data line for transmitting and receiving data between the exposure value calculation units 2313a and 2313b.

[0227] In the control blocks 400Aa and 400Ab, as described in FIG. 13, the signal conversion units 422a and 422b, the autonomous exposure processing units 411a and 411b, and the exposure control units 412a and 412b are arranged in a mirrored manner.

[0228] Furthermore, a signal output unit 423 common to the control blocks 400Aa and 400Ab is disposed between the signal conversion units 422a and 422b, thereby improving the layout efficiency between the control blocks 400Aa and 400Ab.

[0229] The autonomous exposure processors 411a and 411b are also internally mirrored, so that the pre-processors 2311a and 2311b are arranged along the row direction. Digital pixel signals from the signal converters 422a and 422b are horizontally transferred to the global pixel signal line 2601G via the signal output unit 423. For this reason, each of the pre-processors 2311a and 2311b is arranged adjacent to the signal converters 422a and 422b and the signal output unit 423 (column selection circuit 2301).

[0230] This allows the local pixel signal line 2601L between the preprocessing units 2311a, 2311b and the signal output unit 423 to be routed without detouring other internal components, thereby improving the transmission efficiency of digital pixel signals between the preprocessing units 2311a, 2311b and the signal output unit 423.

[0231] The controllers 2312a and 2312b and the exposure value calculation units 2313a and 2313b are also arranged in the row direction. Specifically, for example, the exposure value calculation units 2313a and 2313b are arranged close to each other in the row direction, and the controllers 2312a and 2312b are arranged at a distance from each other. For example, when the exposure value calculation unit 2313b calculates an exposure value using the exposure value from the exposure value calculation unit 2313a, communication occurs between the exposure value calculation units 2313a and 2313b. This communication distance is shorter than when the controllers 2312a and 2312b are arranged at a distance from each other. Therefore, the calculation efficiency of the exposure value calculation unit 2313b is improved.

[0232] Furthermore, the local pixel signal line 2601L connects the signal output unit 423 to the pre-processing units 2311a and 2311b, the pre-processing units 2311a and 2311b to the exposure value calculation units 2313a and 2313b, and the exposure value calculation units 2313a and 2313b to the exposure control units 412a and 412b. Therefore, in order to shorten the wiring length of the local pixel signal line 2601L, the pre-processing units 2311a and 2311b, the exposure value calculation units 2313a and 2313b, and the exposure control units 412a and 412b are arranged close to the boundary between the control blocks 400Aa and 400Ab, rather than near the pixel driving units 413a and 413b.

[0233] Such an arrangement allows the wiring scale within the control blocks 400Aa and 400Ab to be reduced.

[0234] Fig. 27 is a block diagram showing an example layout when an autonomous exposure processing unit 411 is implemented in the peripheral circuit unit 121. Fig. 28 is a block diagram showing a detailed internal configuration of the peripheral circuit unit 121 shown in Fig. 27. On the second semiconductor substrate 120, peripheral circuit units 121a and 121b are arranged on both sides of the control circuit unit 102.

[0235] The control circuit section 102 has a signal processing section 402 (a signal input section 421, a signal conversion section 422, and a signal output section 423) and an exposure control section 412 for each control block 400A.

[0236] The peripheral circuit section 121 includes a pixel driving section 413, a row-direction autonomous exposure processing section group 2400, and a digital signal processing circuit 2701. The peripheral circuit section 121 also includes a timing generator 2702.

[0237] Furthermore, an output IF 2703 is arranged outside the peripheral circuit unit 121 in proximity to the digital signal processing circuit 2701. Similarly, a PLL circuit 2704 is arranged outside the peripheral circuit unit 121 in proximity to the timing generator 2702.

[0238] The timing generator 2702 sequentially outputs all column addresses of the pixel block column during one frame to the data sampling unit 2411. The timing generator 2702 also outputs a reset signal to each autonomous exposure processing unit.

[0239] 28, the signal output unit 423 in the control block 400A outputs digital pixel signals to the data sampling unit 2401. The data sampling unit 2401 refers to the column addresses of the pixel block columns from the timing generator 2702, sorts the digital pixel signals from the control block 400A by pixel block column, and outputs them to the autonomous exposure processing unit 411. The data sampling unit 2401 also outputs the digital pixel signals to the digital signal processing unit.

[0240] The autonomous exposure processing unit 411 calculates an exposure value and outputs it to the exposure control unit 412. When the autonomous exposure processing unit 411 receives a reset signal from the timing generator, it resets the exposure value.

[0241] In the row-direction autonomous exposure processor groups 2400-1 to 2400-M, the data sampling units 2401 and the row-direction autonomous exposure processors 411 are arranged alternately in the column direction, thereby reducing the wiring lengths of the control signal lines and data signal lines.

[0242] The digital signal processing circuit 2701 uses the output signal from the PLL circuit 2704 to serially convert the exposure values ​​from the row direction autonomous exposure processor group 2400 and send them to the output IF 2703. The timing generator 2702 supplies the row direction autonomous exposure processor group 2400 with clock signals for generating various timing signals used in the row direction autonomous exposure processor group 2400.

[0243] 27, a signal (for example, a digital pixel signal) from the control circuit unit 102 is output to the autonomous exposure processing unit 411 via the pixel driving unit 413, an exposure value from the autonomous exposure processing unit 411 is output to a digital signal processing circuit 2701, and an output from the digital signal processing circuit 2701 is output to an output IF 2703. Therefore, between the control circuit unit 102 and the output IF 2703, the pixel driving unit 413, the autonomous exposure processing unit 411, and the digital signal processing circuit 2701 are arranged in order of proximity from the control circuit unit 102.

[0244] Furthermore, the row-direction autonomous exposure processing unit group 2400 communicates with a timing generator 2702, and is therefore also arranged in close proximity to the timing generator 2702. The digital signal processing circuit 2701 and the timing generator 2702 are arranged in close proximity within an automatic placement and routing area 2700, which is automatically placed and routed by a computer (not shown).

[0245] In this way, the autonomous exposure processing unit 411 is arranged in the peripheral circuit section 121 in proximity to the automatic placement and routing area 2700 in accordance with the signal flow. Therefore, the wiring scale within the peripheral circuit section 121 can be reduced.

[0246] <Reduced time required for changes to exposure time> Next, shortening of the reflection period when changing the exposure time will be described with reference to FIGS.

[0247] Fig. 29 is an explanatory diagram showing an example of delaying the exposure time reflection period. Fig. 29 explains an example in which an exposure time for 1 / 2 frame (hereinafter referred to as 1 / 2 frame exposure) is changed to an exposure time for 1 frame (hereinafter referred to as 1 frame exposure). The horizontal axis of Fig. 29 represents time, and the vertical axis represents the row number within the pixel block. In Fig. 29, the number of pixel rows m in pixel block 200 is set to 32.

[0248] In 1 / 2 frame exposure, when the discharge control signal φPDRST is input to the gate terminal of the discharge unit 302 for each pixel 201 in a pixel row of the pixel block 200, charge accumulation, i.e., exposure, begins in the pixels 201 for each pixel row (Reset 1 to 3).

[0249] In the 1 / 2 frame exposure, when the 1 / 2 frame exposure has elapsed from each of resets 1 to 3, a transfer control signal φTX is input to the gate terminal of the transfer unit 301 for each pixel 201 in the pixel row of the pixel block 200, sequentially, and readout 1 of the pixel block 200 in frame Fi begins. When the analog pixel signal is read out from the final pixel row, the readout period i of the pixel block 200 in frame F1 ends.

[0250] The pixel signals read out during the readout period i are converted into digital signals by the signal processing unit 402 and data transferred to the outside. In addition, the control block 400 performs exposure value calculation i on the pixel signals read out during the readout period i and converted into digital signals.

[0251] Here, assume that an instruction to change from 1 / 2 frame exposure to full frame exposure is input to control block 400 before the elapse of readout period i. If the calculation result of exposure value calculation i is to be reflected in the full frame exposure of frame F(i+1), this must be after the end of exposure value calculation i. Therefore, reset 4 is executed at the timing of the first readout start point (readout 3) after the end of exposure value calculation i. In other words, because reset 2 is started before the end of exposure value calculation i, the calculation result of exposure value calculation i cannot be reflected in the full frame exposure of frame F(i+1) at the timing of readout 2.

[0252] In addition, in one frame exposure after the update, when one frame exposure has elapsed since reset 4, when a transfer control signal φTX is input to the gate terminal of the transfer unit 301 sequentially for each pixel 201 in a pixel row of the pixel block 200, readout 4 of the pixel block 200 in frame F(i+1) begins, and when an analog pixel signal is read out from the final pixel row, readout period i+1 of the pixel block 200 in frame F(i+1) ends.

[0253] The pixel signals read out during the readout period i+1 are converted into digital signals and data transferred i+1 to the outside by the signal processing unit 402. In addition, the control block 400 performs exposure value calculation i+1 on the pixel signals read out during the readout period i+1 and converted into digital signals.

[0254] 29, when changing from 1 / 2 frame exposure to 1 frame exposure, a delay of 2 frames occurs before the 1 frame exposure is reflected. The same applies when changing from less than 1 / 2 frame exposure to 1 frame exposure.

[0255] Figure 30 is an explanatory diagram showing Example 1 of shortening the exposure time reflection period. In Figure 30, as in Figure 29, an example will be explained in which 1 / 2 frame exposure is changed to 1 frame exposure. The difference from Figure 29 is that in Figure 30, forced resets 1 to 4 of 1 frame exposure are input at the timing of readouts 1 to 4.

[0256] Like Resets 1 to 4, Forced Resets 1 to 4 are discharge control signals φPDRST that are input sequentially to the gate terminal of the discharge unit 302 for each pixel 201 in a pixel row of the pixel block 200, thereby starting charge accumulation, i.e., exposure, in the pixels 201 in each pixel row.

[0257] Here, assume that an instruction to change from 1 / 2 frame exposure to full frame exposure is input to the control block 400 before the readout period i has elapsed. In Fig. 29, when the calculation result of exposure value calculation i is to be reflected in the full frame exposure of frame F(i+1), this must be done after exposure value calculation i has finished. However, in Fig. 30, when forced reset 2 is input, charge accumulation begins in the pixel block 200 in frame F(i+1) in the pixels 201 of each pixel row, without waiting for exposure value calculation i to finish. In this case, the control block 400 drives and controls the pixels 201 so that reset 3 is not input.

[0258] After this, exposure continues for one frame. That is, readout 4 starts at the end of readout period i+1, and forced reset 4 is applied. This causes charge accumulation to begin in the pixel block 200 in frame F(i+2). In this case, the control block 400 drives and controls the pixel 201 so that reset 5 is not input.

[0259] 30, when changing from 1 / 2 frame exposure to 1 frame exposure, the delay until the 1 frame exposure is reflected is reduced to 1 frame. This reduction also occurs when changing from less than 1 / 2 frame exposure to 1 frame exposure.

[0260] Furthermore, even when changing from full frame exposure to 1 / 2 exposure or less, the forced reset continues to be input, but a reset is also input. For example, if a command to change from full frame exposure to 1 / 2 exposure or less is input to the control block 400 before the end of exposure value calculation i+1, the calculation result of exposure value calculation i+1 (for example, 1 / 2 frame exposure) is reflected in the first reset 5 that arrives after the end of exposure value calculation i+1, and charge accumulation begins in the pixel block 200 in frame F(i+2).

[0261] Fig. 31 is an explanatory diagram showing Example 2 of shortening the exposure time reflection period. Fig. 31 shows an example in which all pixels 201 in one pixel block 200 can be controlled by each of K (K is an integer of 2 or more) pixel regions. Fig. 31 shows an example in which one pixel block 200 has 32 rows, one pixel block 200 has 8 rows, and one control block 400 controls four pixel regions 3101 to 3104.

[0262] In Figure 30, exposure value calculation and reflection of the exposure value could not be performed until the reading of 32 rows of pixel block 200 was completed, but in Figure 31, once the reading of 8 rows of pixel area 3101 is completed, control block 400 can perform exposure value calculation and reflection of the exposure value of pixel area 3101, even if the reading of pixel areas 3102 to 3104 is not completed.

[0263] In this way, even when one control block 400 controls multiple pixel areas 3102 to 3104, the delay until one frame exposure is reflected is reduced to one frame, and data output for one frame exposure becomes possible for each pixel area 3101 to 3104 during readout from the first to second frames.

[0264] Fig. 32 is a timing chart 1-1 when a change in exposure time occurs, and Fig. 33 is a timing chart 1-2 when a change in exposure time occurs. Figs. 32 and 33 are timing charts for the example of Fig. 29.

[0265] 32 and 33 show that when a 1 / 2 frame exposure is started for frame Fi and then changed to a 1 frame exposure, the change to a 1 frame exposure occurs in frame F(i+3), which is 3 frames after frame Fi.

[0266] Fig. 34 is a timing chart 2-1 when a change in exposure time occurs, and Fig. 35 is a timing chart 2-2 when a change in exposure time occurs. Figs. 34 and 35 are timing charts for the example of Fig. 30.

[0267] 34 and 35 show that if a half-frame exposure is started for frame Fi and then changed to a full-frame exposure, the change to a full-frame exposure occurs in frame F(i+2), two frames after frame Fi. If full-frame exposure continues from frame F(i+2), only forced reset is driven.

[0268] Fig. 36 is a timing chart 3-1 when a change in exposure time occurs, Fig. 37 is a timing chart 3-2 when a change in exposure time occurs, and Fig. 38 is a timing chart 3-3 when a change in exposure time occurs. Figs. 36 to 38 are timing charts for an example in which a forced reset is driven as in Fig. 30 and a change is made from 1-frame exposure to 1 / 2-frame exposure.

[0269] For 1-frame exposure, forced resets 0 to 3 are driven for each frame N. When frame N is changed to 1 / 2 frame exposure, reset 1 for 1 / 2 frame exposure is driven for frame F(i+2) after the calculation of the exposure value for frame N is completed. Thereafter, reset 2 for 1 / 2 frame exposure is driven at the same timing for frame F(i+3). In Figure 38, forced reset and reset for 1 / 2 frame exposure are driven within one frame, but because the reset for 1 / 2 frame exposure is driven after the forced reset, the forced reset is not reflected by the reset drive for 1 / 2 frame exposure, and the exposure time becomes 1 / 2 frame exposure.

[0270] <Reading out the exposure value to the outside of the second semiconductor substrate 120> Next, we will explain how to read out the exposure value to the outside of the second semiconductor substrate 120. There are two methods for reading out the exposure value to the outside of the second semiconductor substrate 120, in addition to the method of outputting it from the shift register shown in FIGS.

[0271] One is a method in which the exposure value is read out via a route separate from the pixel signals for 200 pixel blocks (hereinafter referred to as image signals) and output as a header for the image signals, which will be explained in Fig. 39. The other is a method in which the exposure value is read out along with the digital pixel signals via a horizontal transfer line and output together with the image signals to the outside of the second semiconductor substrate 120, which will be explained in Fig. 41.

[0272] 39 is an explanatory diagram showing method 1 for reading out exposure values ​​to the outside of the second semiconductor substrate 120. The horizontal transfer line 3900 is, for example, a 16-bit transfer line, and connects each control block 400A to the digital signal processing circuit 2701. The data line 3901 connects the pixel control unit 401 of each control block 400A to the digital signal processing circuit 2701.

[0273] The digital pixel signal for each pixel 201 from the signal processing unit 402 of each control block 400A is output to the digital signal processing circuit 2701 via a horizontal transfer line 3900. The exposure value is read out via a path separate from the horizontal transfer line 3900. Therefore, the signal line 4100 can output the exposure value at a lower frequency than the horizontal transfer line 3900.

[0274] The digital signal processing circuit 2701 adds the exposure value from the signal line 4100 as a header (or a footer) of the image signal, and outputs image data consisting of the header and the image signal to the data processing unit 103. According to the configuration of Fig. 39, the amount of image data transmitted to the data processing unit 103 is reduced compared to the case of Fig. 41, which will be described later.

[0275] 40 is an explanatory diagram showing a second method for reading out exposure values ​​from the second semiconductor substrate 120. The horizontal transfer line 3900 is, for example, a 16-bit transfer line that connects each control block 400 to the digital signal processing circuit 2701. The digital pixel signal for each pixel 201 from the signal processing unit 402 of each control block 400 is output to the digital signal processing circuit 2701 via the horizontal transfer line 3900. The exposure value from the pixel control unit 401 of each control block 400 is output to the outside of the second semiconductor substrate 120 via the horizontal transfer line 3900 at the same timing as the corresponding digital pixel signal.

[0276] The digital signal processing circuit 2701 is connected to the data processing unit 103 on the third semiconductor substrate 130 via an output IF 2703. The digital signal processing circuit 2701 embeds an exposure value from the pixel control unit 401 of the same control block 400 into the image signal from the signal processing unit 402, and outputs the signal to the data processing unit 103. For example, if the digital pixel signal for one pixel is 12 bits and the exposure value is 4 bits, the signal is output to the outside of the second semiconductor substrate 120 as a 16-bit digital pixel signal.

[0277] In this way, the exposure value is included in part of the digital pixel signal for one pixel, which makes it easy for the data processing unit 103 to correct the exposure time for each pixel.

[0278] 39 and 40, in the case of the control block 400B, instead of the signal processing unit 402, a signal processing unit 1602 outside the control circuit unit 210 is connected to a horizontal transfer line 3900, and the digital pixel signal for each pixel 201 from the signal processing unit 1602 is output to the digital signal processing circuit 2701 via the horizontal transfer line 3900.

[0279] <Increasing the speed of autonomous exposure control within the control block 400 and increasing the accuracy of exposure control by switching exposure values ​​inside and outside the control block 400> Next, another example of the autonomous exposure control shown in Fig. 23 will be described with reference to Figs. 41 to 51. Figs. 41 to 51 show an example in which the autonomous exposure control is increased in speed within the control block 400, and exposure control is achieved by switching between exposure values ​​inside and outside the control block 400. First, an example of increasing the speed of the autonomous exposure control within the control block 400 will be described with reference to Figs. 41 to 47. Note that Figs. 41 to 47 use the control block 400A as an example, but the control block 400B can also be implemented by arranging a configuration similar to that of the signal processing unit 402 in the signal processing unit 1602.

[0280] [Increasing the speed of autonomous exposure control within the control block 400] 41 is a block diagram showing Example 1 of increasing the speed of autonomous exposure control within a control block 400A. The control block 400A has n ADCs 500 and an SRAM 4100, which is an example of a signal output unit 423. For the sake of simplicity, FIG. 41 shows only one ADC 500.

[0281] In this example, the pixel signal for each pixel 201 digitally converted by the ADC 500 is a 13-bit digital pixel signal. This digital pixel signal is held in the SRAM 4100 and, as shown in FIG. 23 , is output to the peripheral circuit unit 121 via the column selection circuit 2301 and the horizontal transfer line 2300. In addition, the most significant 4-bit signal of the 13-bit digital pixel signal is output to the autonomous exposure processing unit 4101.

[0282] The autonomous exposure processing unit 4101 is connected to a selector 4103 in an exposure control unit 412. The exposure control unit 412 also has a pixel block control unit 503, a level shift unit 504, a latch circuit 2321, a shift register 4102, and a selector 4103. The shift register 4102 holds a set exposure value.

[0283] The selector 4103 is connected on the input side to the shift register 4102 and the autonomous exposure processor 4101, and is connected on the output side to the latch circuit 2321. The selector 4103 selects either the set exposure value from the shift register 4102 or the exposure value from the autonomous exposure processor 4101 based on a selection signal. The selection signal is a signal that selects either the set exposure value or the exposure value from the autonomous exposure processor 4101. The selection signal is input to the selector 4103 from the external system described above. The exposure value selected by the selector 4103 is output to the latch circuit 2321.

[0284] 42 is an explanatory diagram showing an example of a counter latch in Example 1 of High-Speed ​​Autonomous Exposure Control inside the control block 400A. The counter latch (storage unit) 502 holds a 13-bit digital pixel signal and outputs it to the SRAM 4100. In FIG. 42, "x" represents "0" or "1." The hatched upper 4 bits of the digital signal are output to the autonomous exposure processing unit 4101 via the SRAM 4100.

[0285] 43 is an explanatory diagram showing a specific example of autonomous exposure control in Example 1 of Speeding Up Autonomous Exposure Control inside the control block 400A. The autonomous exposure processing unit 4101 holds a lookup table 4300. The lookup table 4300 is a table that associates the most significant four bits 4301 with exposure times 4302. For convenience, the range of values ​​that a 13-bit digital pixel signal that associates the most significant four bits 4301 with the exposure times 4302 is shown.

[0286] When the upper 4-bit signal is input from the SRAM 4100, the autonomous exposure processor 4101 refers to the lookup table 4300 to identify the upper 4 bits 4301 and reads out the corresponding exposure time 4302. The autonomous exposure processor 4101 outputs a 4-bit signal indicating the read exposure time 4302 to the selector 4103.

[0287] The shift register 4102 has a setting value table 4310 that associates setting values ​​4311 with exposure times 4312. The shift register 4102 outputs, to the selector 4103, as a set exposure value, a setting value 4311 that matches a 4-bit input setting value from an external system or a setting value 4311 that corresponds to an exposure time 4312 that matches the input exposure time.

[0288] Because it is important whether the pixel 201 is saturated or not, the counter latch (hereinafter referred to as the counter latch 502), which is an example of the storage unit 502, does not need to output all 13 bits of the digital pixel signal to the autonomous exposure processor 4101. Furthermore, because the lowest 9 bits contain noise, it is not important whether the pixel 201 is saturated or not. Therefore, the autonomous exposure processor 4101 refers to the lookup table 4300 and specifies the exposure time 4302 using the highest 4-bit signal. This makes it possible to speed up the processing of the autonomous exposure processor 4101.

[0289] Next, Example 2 of increasing the speed of autonomous exposure control within control block 400A will be described. Example 2 of increasing the speed of autonomous exposure control within control block 400A is an example in which the exposure value is determined by using the upper bits of the digital pixel signal to select whether to maintain the previously output exposure value, increase it by one step, or decrease it by one step. The block configuration is the same as in Figure 41, so a description is omitted.

[0290] 44 is an explanatory diagram showing an example of the counter latch 502 in Example 2 of increasing the speed of autonomous exposure control inside the control block 400A. In Example 2 of use, the counter latch 502 outputs the hatched most significant 3-bit digital signal to the autonomous exposure processing unit 4101 via the SRAM 4100.

[0291] 45 is an explanatory diagram showing a specific example of autonomous exposure control in Example 2 of High-Speed ​​Autonomous Exposure Control inside the control block 400A. The autonomous exposure processing unit 4101 holds a lookup table 4500. The lookup table 4500 is a table that associates the most significant three bits 4501 with actions 4502. For convenience, the range of values ​​that a 13-bit digital pixel signal can take, which associates the most significant three bits 4501 with the actions 4502, is shown.

[0292] The autonomous exposure processor 4101 sets the value "001" (corresponding to "keep" in action 4502) of the upper three bits 4501 of the lookup table 4500 as the reference value. The autonomous exposure processor 4101 also holds the setting value 4311 of the shift register the first time, and the setting value output from the selector 4103 in the previous frame (referred to as the previous output value) from the second time onwards.

[0293] When the upper 3-bit signal is input from the SRAM 4100, the autonomous exposure processor 4101 refers to the lookup table 4500 to identify the upper 3 bits 4501 and reads out the corresponding action 4502. The autonomous exposure processor 4101 updates the previous output value with the read action 4502.

[0294] Here, the previous output value is assumed to be "0011." If the upper three bits 4501 are "000," the action 4502 is "up by one step." In this case, the autonomous exposure processor 4101 raises the previous output value "0011" by one step to "0100," and outputs the updated setting value "0100" to the selector 4103.

[0295] Furthermore, if the upper three bits 4501 are "001", the action 4502 is "keep", that is, the status quo is maintained. In this case, the autonomous exposure processor 4101 outputs the previous output value "0011" to the selector 4103. Furthermore, if the upper three bits 4501 are, for example, "011", the action 4502 is "down by one step". In this case, the autonomous exposure processor 4101 updates the previous output value "0011" by one step to "0010", and outputs the updated setting value "0010" to the selector 4103.

[0296] As in the first application example, what is important is whether the pixel 201 is saturated, so the counter latch 502 does not need to output all 13 bits of the digital pixel signal to the autonomous exposure processing unit 4101. Moreover, because the lowest 10 bits contain noise, it is not important whether the pixel 201 is saturated.

[0297] Therefore, the autonomous exposure processor 4101 refers to the lookup table 4500 and executes the processing 4502 of the exposure time 4302 using the most significant 3-bit signal. This makes it possible to speed up the processing of the autonomous exposure processor 4101.

[0298] In application example 2, the autonomous exposure processor 4101 executes the action 4502 of increasing or decreasing the exposure time 4312 by one step, so the number of upper bits to be handled is 3 bits instead of 4 bits. Therefore, compared to application example 1, the transmission bit width from the counter latch 502 to the autonomous exposure processor 4101 can be reduced.

[0299] Also, lookup table 4500 is just an example, and the range of "up by one step," "keep," and "down by one step" may be expanded or reduced. Also, for example, action 4502 for "1xx" in the upper three bits 4501 may be "down by two steps." Also, any one of the values ​​of action 4502 "up by one step," "down by one step," and "keep" may be excluded.

[0300] Next, a description will be given of Example 3 of increasing the speed of autonomous exposure control within the control block 400A. Unlike the above-mentioned Examples 1 and 2 of increasing the speed, Example 3 of increasing the speed of autonomous exposure control within the control block 400A is an example in which analog pixel signals from the signal line 202 are output to the autonomous exposure processing unit 4101 to perform autonomous exposure control.

[0301] 46 is a block diagram showing Example 3 of increasing the speed of autonomous exposure control within the control block 400A. The autonomous exposure processor 4101 is connected to the signal line 202 of each pixel column of the pixel block 200. The autonomous exposure processor 4101 has a comparator 4601, a 1-bit latch 4602, and a down counter 4603.

[0302] 47 is a circuit diagram showing an example of the comparator 4601. The comparator 4601 is a so-called CMOS inverter, which compares the voltage of the analog pixel signal with a voltage threshold. The less charge accumulated in the photoelectric conversion unit 300, the higher the potential of the analog pixel signal flowing from the pixel 201 to the comparator 4601 via the signal line 202. When the voltage of the analog pixel signal exceeds the threshold voltage, the comparator 4601 outputs "0" to the one-bit latch 4602. The one-bit latch 4602 then holds "0."

[0303] The more charge accumulated in the photoelectric conversion unit 300, the lower the potential of the analog pixel signal flowing through the signal line 202 from the pixel 201 to the comparator 4601. When the voltage of the analog pixel signal falls below the threshold voltage, the comparator 4601 outputs "1" to the 1-bit latch 4602. The 1-bit latch 4602 then holds "1" and outputs it to the down counter 4603.

[0304] Returning to FIG. 46 , the down counter 4603 does not output a signal to the selector 4103 until a 1-bit signal indicating “1” is input from the 1-bit latch 4602. This causes the selector 4103 to select the set exposure value in the shift register 4102 and output it to the latch circuit 2321. On the other hand, when a 1-bit signal indicating “1” is input from the 1-bit latch 4602, the down counter 4603 decreases the set value 4311, which is the set exposure value of the shift register 4102, by one step. For example, if the set exposure value is “0111” of the set value 4311, the shift register 4102 decreases the value by one step from “0111” to “0110” and outputs it to the selector 4103 as the set exposure value. The selector 4103 selects the updated set value “0110” and outputs it to the latch circuit 2321.

[0305] According to an example of using the signal line 202, the saturation of the pixel 201 is detected using the analog pixel signal before digital conversion, and the exposure time is autonomously reduced and controlled, thereby enabling faster processing compared to autonomous exposure control using a digital pixel signal.

[0306] Furthermore, when a 1-bit signal of "0" is input to the 1-bit latch 4602 multiple times in succession, the 1-bit latch 4602 may output a 1-bit signal indicating "1" to the down counter 4603. In this case, since the pixel 201 continues to be in a dark state, the down counter 4603 may perform control to increase the set exposure value by one step.

[0307] [Exposure control by switching exposure values ​​inside and outside the control block 400] Next, exposure control by switching between exposure values ​​inside and outside the control block 400 will be described with reference to Figures 48 to 51. Exposure control by switching between exposure values ​​inside and outside the control block 400 is executed by an external system.

[0308] 48 is an explanatory diagram showing exposure control example 1 by switching exposure values ​​inside and outside the second semiconductor substrate 120. Exposure control example 1 aims to improve the accuracy of exposure by reducing the exposure time difference (step) between adjacent pixel blocks 200. The external system creates an exposure table 4810 for image data 4800 obtained from the pixel section 101. The exposure table 4810 is a table in which the TV value for each pixel block 200 is calculated. The TV value indicates the exposure time set for the pixel block 200.

[0309] The external system identifies a location where a difference in TV values ​​exceeds a threshold value at a boundary between one or more pixel blocks arranged in a column direction (pixel block columns) or one or more pixel blocks arranged in a row direction (pixel block rows). For example, in image data 4800, in an image region 4801 that includes a luminous filament and its black background, the difference in TV values ​​exceeds a threshold value at the boundary, increasing noise.

[0310] For this reason, the external system identifies pixel block columns or pixel block rows at the boundary and updates them so that the difference in TV values ​​does not exceed the threshold. In Fig. 48, the difference in TV values ​​between pixel block column 4812, the second column from the left in exposure table 4810, and pixel block column 4813, the third column, is greater than the threshold, so pixel block columns 4812 and 4813 are at the boundary. The TV value of pixel block column 4813, the third column from the left, is then updated. For example, the external system sets the TV value of pixel block column 4813, the third column from the left, to the average (fractions may be rounded down or rounded up) of each TV value in pixel block column 4812, the second column from the left, and each TV value in pixel block column 4814, the fourth column from the left.

[0311] In addition, the external system may set the TV value of the pixel block column 4812, second from the left, to be the average value (fractions may be rounded down or rounded up) of each TV value of the pixel block column 4811, first from the left, and each TV value of the pixel block column 4813, third from the left.

[0312] The external system writes the updated TV value to the shift register 4102 as the set exposure value for the control block 400 responsible for the pixel block 200 with the updated TV value, and outputs a selection signal to the selector 4103 to select the set exposure value from the shift register 4102. This makes it possible to obtain image data with reduced noise at the boundary between light and dark.

[0313] 49 is an explanatory diagram showing a second example of exposure control by switching between exposure values ​​inside and outside the second semiconductor substrate 120. In the second example of exposure control, when there is a phase mismatch between the light emission frequency, movement frequency, or rotation frequency of a subject such as a light-emitting body, moving body, or rotating body and the sampling frequency of the image sensor 100, the autonomous exposure control by the control block 400 is switched to exposure control by an external system, thereby stabilizing the exposure.

[0314] If the light emission frequency, movement frequency, or rotation frequency of the subject does not match the sampling frequency of the image sensor 100, the brightness of a certain pixel block 200 will repeatedly fluctuate between bright and dark. Because the exposure value in the autonomous exposure processor is reflected with a one-frame delay, when the brightness of a pixel block 200 is "bright," the exposure value will be a long-second exposure value delayed by one frame, and that pixel block 200 will appear blown out in the captured image.

[0315] Furthermore, when the brightness of pixel block 200 is "dark," the exposure value is delayed by one frame and is a short second, causing crushed shadows in the captured image of pixel block 200. In this way, in pixel block 200, the above-mentioned phase mismatch between the subject frequency and the exposure value causes blown-out highlights and crushed shadows to appear alternately, resulting in continuous oscillation.

[0316] In such a case, the external system detects the number of times or the duration of repetition of blown-out highlights and crushed shadows for each pixel block 200, and for the pixel block 200 in which oscillation is detected, outputs a selection signal to select the set exposure value from the shift register 4102 to the selector 4103. This prevents oscillation of blown-out highlights and crushed shadows and stabilizes the exposure of that pixel block 200. After the exposure has stabilized, the external system may output a selection signal to the selector 4103 that selects the exposure value from the autonomous exposure processors 411, 4101.

[0317] 50 is an explanatory diagram showing an exposure control example 3 by switching between exposure values ​​inside and outside the control block 400. Exposure control example 3 aims to optimize exposure by setting for each pixel block 200 whether to apply autonomous exposure control within the control block 400 or exposure control by an external system.

[0318] For a pixel block 200 (hereinafter referred to as a first pixel block 5001) in which the number of defective pixels is equal to or less than the allowable number, the external system outputs a selection signal to the selector 4103 that selects the exposure value obtained by the autonomous exposure processing unit 411. On the other hand, for a pixel block 200 (hereinafter referred to as a second pixel block 5002) in which the number of defective pixels is greater than the allowable number or a pixel block 200 that includes a partially shaded AF pixel (hereinafter referred to as a third pixel block 5003), the external system outputs a selection signal to the selector 4103 that selects the set exposure value from the shift register 4102.

[0319] In addition, for a pixel block 200 in which a defective pixel is identified after shipment and the pixel block 200 is changed from the first pixel block 5001 to the second pixel block 5002, the external system will output a selection signal to the selector 4103 of the control block 400 responsible for that pixel block 200, which selects the set exposure value from the shift register 4102.

[0320] Furthermore, for the second pixel block 5002 and the third pixel block 5003, whose number of defective pixels is known at the time of shipment, offset data is set in the autonomous exposure processor 411 of the control block 400. For the pixel block 200 to which offset data has been given, the external system outputs a selection signal to the selector 4103 that selects the exposure value obtained by the autonomous exposure processor 411.

[0321] Here, the offset data is a parameter for correcting the exposure value in that pixel block 200, and is the position of a defective pixel in the case of the second pixel block 5002. This allows the autonomous exposure processor 411 to calculate the maximum or average value of the digital pixel signal, excluding the defective pixel in the pre-processing section.

[0322] For the third pixel block 5003, the offset data is the position and weight of the AF pixel. Because part of the light-receiving area of ​​the AF pixel is shaded, if the shaded area is half the original light-receiving area of ​​the AF pixel, the digital pixel signal from the AF pixel needs to be doubled, so the weight is 2.

[0323] Similarly, if the light-blocking area is one-third of the original light-receiving area of ​​the AF pixel, the digital pixel signal from the AF pixel needs to be tripled, so the weight is 3. In this way, the weight is the light-receiving area of ​​pixel 201 / the light-blocking area of ​​the AF pixel. Also, for the third pixel block 5003, as with the second pixel block 5002, the offset data may be the position of the AF pixel. Then, the autonomous exposure processor 411 may calculate the maximum or average value of the digital pixel signal values, excluding the AF pixel, in the pre-processing unit 2311.

[0324] In addition, for a pixel block 200 in which a defective pixel is identified after shipment and the pixel block 200 is changed from a first pixel block 5001 to a second pixel block 5002, the external system may set offset data for the defective pixel in the autonomous exposure processing unit 411 of the control block 400 responsible for that pixel block 200.

[0325] In this way, depending on the degree of pixel loss within the pixel block 200, it is possible to set whether to apply autonomous exposure control within the control block 400 or exposure control by an external system, thereby optimizing the exposure for each pixel block 200.

[0326] <Method of reading exposure value for each control block 400> Next, a method for reading the exposure value for each control block 400 will be described. When generating an image by outputting the exposure value for each pixel block 200 to an external system, the external system outside the image sensor 100 needs to demodulate (gain) the digital image signal of each pixel 201 in the pixel block 200 based on the exposure value for each pixel block 200. In this case, the image sensor 100 sets additional information including the image block ID and exposure value in the digital image signal of each pixel 201 from the pixel block 200 (hereinafter referred to as the image signal of the pixel block 200), and outputs the signal to the external system.

[0327] When additional information is set in the image signal of the pixel block 200, the amount of data transmitted to the external system increases by the amount of additional information, resulting in a decrease in communication speed and an increase in power consumption. Furthermore, as the size of the pixel block 200 becomes smaller due to finer exposure control (as the number of pixels in one pixel block 200 decreases), the effects of a decrease in communication speed and an increase in power consumption become greater. Below, we will explain a method for reading the exposure value for each control block 400 to suppress a decrease in communication speed and an increase in power consumption.

[0328] 51 is an explanatory diagram showing Example 1 of reading the exposure value for each control block 400. The pixel section 101 of the first semiconductor substrate 110 has an effective pixel area 5111 that receives subject light, and an optical black pixel area 5112 formed around the effective pixel area 5111. The effective pixel area 5111 is made up of the multiple pixel blocks 200 described above.

[0329] The optical black pixel region 5112 is a collection of optical black pixels. An optical black pixel is a pixel 201 in which the light receiving region in which the photoelectric conversion unit 300 can receive light is shielded. Since no light is incident on an optical black pixel, the exposure time of the optical black pixel is determined uniquely by the incident time, not by the amount of incident light. Furthermore, like the effective pixel region 5111, the optical black pixel region 5112 is also made up of multiple pixel blocks 200. The pixel blocks 200 in the optical black pixel region 5112 are referred to as OB pixel blocks 5120.

[0330] An exposure value corresponding to an exposure time (for example, 1 ms, 2 ms, 4 ms, ..., 100 ms) is set as a set exposure value in the shift register 4102 of the exposure control unit 412 of the control block 400 (hereinafter referred to as the OB control block 5140) that corresponds to one or more of all the OB pixel blocks 5120. The OB control block 5140 is connected to the control block 400 so as to be able to communicate with it.

[0331] Furthermore, one or more reference pixels 5101 are provided in at least one pixel block 200 out of all pixel blocks 200 in the effective pixel area 5111. Similar to optical black pixels, the reference pixels 5101 are pixels 201 in which the light receiving area in which the photoelectric conversion unit 300 can receive light is shielded. Similarly to optical black pixels, no light is incident on the reference pixels 5101, and therefore the exposure time of the optical black pixels is determined uniquely by the incident time, not by the amount of incident light.

[0332] In the pixel block 200, each pixel 201 outputs a pixel signal to the control block 400. The pre-processing unit 2311 of the control block 400 calculates a statistical value (for example, the average value, median value, maximum value, or minimum value; referred to as the reference pixel pre-processing result) of the pixel signal of the reference pixel 5101 and outputs it to the exposure value calculation unit 2313.

[0333] In each OB pixel block 5120, each optical black pixel also outputs a pixel signal to the OB control block 5140. The pre-processing unit 2311 of each OB control block 5140 calculates a statistical value of the pixel signal of each optical black pixel (hereinafter referred to as the black pixel pre-processing result).

[0334] The exposure value calculation unit 2313 of the control block 400 obtains the black pixel preprocessing results from the preprocessing units 2311 of each OB control block 5140. The exposure value calculation unit 2313 of the control block 400 then compares the reference pixel calculation result with each black pixel preprocessing result. The exposure value calculation unit 2313 of the control block 400 identifies the black pixel preprocessing result that has the smallest difference from the reference pixel calculation result.

[0335] The exposure value calculation unit 2313 of the control block 400 then acquires the exposure value held by the OB control block 5140 from which the identified black pixel preprocessing result was calculated. The exposure value calculation unit 2313 of the control block 400 outputs the acquired exposure value to the exposure control unit 412.

[0336] In this way, by comparing the pixel signals from the reference pixel 5101 and the optically black pixel for each control block 400, it is possible to read an exposure value that is uniquely determined by the incident time, regardless of the amount of incident light. The control block 400 also includes the exposure value thus read in the digital pixel signal of each pixel 201 in the corresponding pixel block 200, and outputs this to an external system. This makes it possible to prevent a decrease in communication speed and an increase in power consumption.

[0337] Furthermore, by arranging multiple reference pixels 5101 in one pixel block 200, even if a reference pixel 5101 has a pixel defect, it can be complemented by another reference pixel 5101. The multiple reference pixels 5101 may also be arranged in different rows or different columns. This makes it possible to prevent pixel defects in multiple reference pixels 5101 arranged in the same row or column due to a line defect within the pixel block 200. The multiple reference pixels 5101 may also be arranged at intervals. This makes it possible to complement a reference pixel 5101 with the digital pixel signals of its surrounding pixels.

[0338] 52 is an explanatory diagram showing a second example of reading exposure values ​​for each control block 400. Reading example 2 differs from reading example 1 shown in FIG.

[0339] The pixel block 200 has one or more reference pixels 5202. When multiple reference pixels 5202 are arranged, a different exposure value (for example, Tv0 to Tv8) is set for each reference pixel 5202. In reading example 2, the exposure value of the pixel region 5200 excluding the reference pixel 5202 in the pixel block 200 is determined by the exposure value obtained for the reference pixel 5202. Note that the reference pixel 5202 is not shaded like the reference pixel 5101 shown in FIG. 51.

[0340] In the control block 400, the autonomous exposure processor 411 acquires digital pixel signal values ​​S0 to S8 from the reference pixel 5202 and a digital pixel signal value SP of the target pixel region 5200. The digital pixel signal value SP of the target pixel region 5200 is, for example, a statistical value of the digital pixel signals of all pixels 201 in the target pixel region 5200 excluding the reference pixel 5202.

[0341] Fig. 53 is a block diagram showing a detailed example of the block configuration of control block 400 in Example 2 of Reading Exposure Values ​​for Each Control Block 400. In Fig. 53, control block 400A is used as an example for explanation, but control block 400B can also be implemented because a configuration similar to that of signal processing unit 402 can be arranged in signal processing unit 1602. Control block 400A has a setting unit 5300 in addition to signal processing unit 402 (signal input unit 421, signal conversion unit 422, signal output unit 423), autonomous exposure processing unit 411, exposure control unit 412, and pixel driving unit 413.

[0342] The setting unit 5300 generates and outputs a reset signal (TX2) that starts exposure at different reset timings for each of the reference pixels 5202. Each of the reference pixels 5202 starts (or may end) exposure (accumulation in the photoelectric conversion unit 300) at the timing when the reset signal from the setting unit 5300 is input.

[0343] The autonomous exposure processor 411 identifies the digital pixel signal value of the reference pixel 5202 from among S0 to S8 that has the smallest difference from the digital pixel signal value SP of the target pixel region 5200. The autonomous exposure processor 411 sets the exposure value of the target pixel region 5200 to the exposure value (for example, Tv0 to Tv8) that was set for the reference pixel 5202 that output the digital pixel signal of the identified value.

[0344] As described above, each pixel 201 in the target pixel region 5200 starts reset driving, for example, exposure, in accordance with the exposure value set by the autonomous exposure processing unit 411.

[0345] In this way, by reading the exposure value for each control block 400, the exposure value can be included in the digital pixel signal of each pixel 201 in the corresponding pixel block 200 and output to an external system, thereby suppressing a decrease in communication speed and an increase in power consumption.

[0346] Furthermore, multiple reference pixels 5202 set to the same exposure value may be arranged in one pixel block 200. This allows a pixel defect in a reference pixel 5202 to be accommodated by other reference pixels 5202. Furthermore, multiple reference pixels 5202 may be arranged in different rows or columns. This makes it possible to prevent pixel defects in multiple reference pixels 5202 arranged in the same row or column due to a line defect within the pixel block 200.

[0347] <Reduction of color shift in autonomous exposure control for each control block 400> In the image sensor 100, if any of the R, G, or B pixels becomes saturated, color shifts will occur when the image is converted into a color image after demosaicing. For example, even if the average value of the digital pixel signals of all pixels 201 in a pixel block 200 is not saturated, the average value of one of the RGB colors may be saturated. On the other hand, detecting saturation separately for each RGB color increases the circuit size.

[0348] The image sensor 100 performs autonomous exposure control for each pixel block 200, but it is necessary to avoid image quality problems such as color shift. Here, we will explain an example of reducing color shift using the image sensor 100, which sets an appropriate exposure time so that each RGB color does not become saturated for each pixel block 200.

[0349] [Color registration reduction example 1] 54 is a block diagram showing an example of the internal configuration of the pre-processing unit 2311 in color shift reduction example 1. The pre-processing unit 2311 has a comparator 5401 and a latch circuit 5402. The comparator 5401 receives as input a digital pixel signal from the pixel block 200 (hereinafter referred to as a first pixel signal) and a digital pixel signal latched by the latch circuit 5402 (hereinafter referred to as a second pixel signal), without distinguishing between R pixels, G pixels, and B pixels.

[0350] The comparator 5401 compares the first pixel signal with the second pixel signal, and outputs the pixel signal with the larger value to the latch circuit 5402 .

[0351] The latch circuit 5402 resets itself in response to a reset pulse from the controller 2312, and then starts overwriting and saving the digital pixel signal from the comparator 5401. Before the next reset pulse is input, the latch circuit 5402 receives a timing signal from the controller 2312 indicating when all of the digital pixel signals for one pixel block (200 pixels) have been input, and finally outputs the held digital pixel signal to the exposure value calculation unit 2313.

[0352] The digital pixel signal output to the exposure value calculation unit 2313 is the digital pixel signal that takes the maximum value in the pixel block 200 for each frame. This allows the control block 400 to calculate an appropriate exposure value for the pixel block 200 it is responsible for, so that each RGB color does not become saturated for each frame. Therefore, color shifts in the output image data from the image sensor 100 can be suppressed for each pixel block 200.

[0353] [Color registration reduction example 2] Color shift reduction example 2 is an example in which one or more white pixels are arranged in the pixel block 200. The white pixels are pixels 201 that have a transparent filter instead of the color filter 703.

[0354] FIG. 55 is an explanatory diagram showing an example of a pixel block 200 in color shift reduction example 2. In FIG. 55, R in pixel 201 indicates an R (red) pixel, B indicates a B (blue) pixel, Ga and Gb indicate G (green) pixels, and W indicates a white pixel. A pixel 201 whose left half is black is an AF pixel. Since the letter within the AF pixel is W, that pixel 201 is both an AF pixel and a white pixel. There are also pixel blocks 200 that do not have AF pixels.

[0355] The preprocessing unit 2311 discards the digital pixel signals of the R, B, Ga, and Gb pixels. If only one white pixel is arranged in the pixel block 200, the preprocessing unit 2311 outputs the digital pixel signal of the white pixel to the exposure value calculation unit 2313. If two or more white pixels are arranged in the pixel block 200, the preprocessing unit 2311 calculates the maximum or average value of the digital pixel signals of the two or more white pixels and outputs it to the exposure value calculation unit 2313.

[0356] Since white pixels are not affected by color like R pixels, B pixels, Ga pixels, and Gb pixels, saturation of the pixel block 200 in single RGB colors can be suppressed by using the digital pixel signal of the white pixels for exposure control.

[0357] Furthermore, if the pixel block 200 includes an AF pixel, the AF pixel can also serve as a white pixel, thereby reducing the number of RGB pixels replaced with white pixels. Furthermore, multiple white pixels may be discretely arranged in the pixel block 200. In this case, the multiple white pixels may be arranged in different rows or columns. This prevents pixel defects in multiple white pixels arranged in the same row or column due to a line defect within the pixel block 200. Furthermore, the multiple white pixels may be arranged spaced apart. This allows white pixels to be complemented by the digital pixel signals of their surrounding pixels.

[0358] Furthermore, the multiple white pixels may be pixels 201 with sensitivity adjusted in multiple stages. Specifically, for example, an ND filter or a light-shielding metal may be used for the white pixels. When adjusting sensitivity using a light-shielding metal, it may be set as an AF pixel. In this case, the width of the light-shielding metal in the row direction may be set wider as the principal ray angle of the lens increases. This improves the phase difference detection accuracy of the AF pixel.

[0359] [Color registration reduction example 3] Because defective pixels in the pixel block 200 are saturated, if the preprocessing unit 2311 performs preprocessing using the digital pixel signals of the defective pixels, the exposure time will be set to a short time. Therefore, in color shift reduction example 3, an example will be described in which the preprocessing unit 2311 removes the digital pixel signals of the defective pixels.

[0360] Fig. 56 is a block diagram showing an example of the internal configuration of pre-processing unit 2311 in color shift reduction example 3. If the number of defective pixels expected at the time of shipment is d (d is an integer greater than or equal to 1), pre-processing unit 2311 has (d+1) data holding units connected in series to hold digital pixel signals of defective pixels. Fig. 56 shows an example where d=2, and has three stages of data holding units 5601, 5602, and 5603.

[0361] The data holding units 5601, 5602, and 5603 have comparators 5611, 5621, and 5631 and latch circuits 5612, 5622, and 5632.

[0362] In the data holding unit 5601, a comparator 5611 inputs a digital pixel signal (hereinafter referred to as a first pixel signal) from the pixel block 200 and a digital pixel signal (hereinafter referred to as a second pixel signal) latched by a latch circuit 5612, without distinguishing between R pixels, G pixels, and B pixels.

[0363] The comparator 5611 compares the first pixel signal with the second pixel signal and outputs the value of the larger pixel signal to the latch circuit 5612. The latch circuit 5612 resets its interior with a reset pulse from the controller 2312 and then starts overwriting and saving the digital pixel signal from the comparator 5611. Before the next reset pulse is input, the latch circuit 5402 inputs a timing signal from the controller 2312 indicating when all of the digital pixel signals for one pixel block (200) have been input, and finally outputs the held digital pixel signal to the exposure value calculation unit 2313.

[0364] That is, for a certain frame, when the digital pixel signals of all pixels 201 in the pixel block 200 are input to the comparator 5611 as the first pixel signal, the digital pixel signal with the maximum value among the digital pixel signals of all pixels 201 is held in the latch circuit 5612.

[0365] In the data holding unit 5602 , a comparator 5621 and a latch circuit 5622 perform the same operations as the comparator 5611 and the latch circuit 5612 for the digital pixel signals not held in the latch circuit 5612 .

[0366] As a result, for a certain frame, when a digital pixel signal that is not held in latch circuit 5612 in pixel block 200 is input to comparator 5621 as a first pixel signal, the digital pixel signal with the maximum value among the digital pixel signals that are not held in latch circuit 5612 will be held in latch circuit 5622.

[0367] In the data holding unit 5603 , the comparator 5631 and the latch circuit 5632 perform the same operations as the comparator 5611 and the latch circuit 5612 for the digital pixel signals not held in the latch circuits 5612 and 5622 .

[0368] As a result, for a certain frame, when a digital pixel signal that is not held in latch circuits 5612 and 5622 in pixel block 200 is input to comparator 5631 as a first pixel signal, the digital pixel signal with the maximum value among the digital pixel signals that are not held in latch circuits 5612 and 5622 will be held in latch circuit 5632.

[0369] For a given frame, of the digital pixel signal values ​​of all pixels 201 in pixel block 200, the maximum value is held in latch circuit 5612, the second largest value is held in latch circuit 5622, and the third largest value is held in latch circuit 5632.

[0370] Therefore, when the preprocessing unit 2311 wants to output the maximum value excluding d (=2) defective pixels, it outputs the value of the digital pixel signal held in the latch circuit 5632 to the exposure value calculation unit 2313.

[0371] Furthermore, the output terminal of comparator 5621 is switchably connected to the input / output terminal of comparator 5631 and average value calculation unit 5600 via switch 5610. Switching of switch 5610 is controlled by controller 2312. When comparators 5621 and 5631 are connected by switch 5610, the value of the digital pixel signal held in latch circuit 5632 is output to exposure value calculation unit 2313 as described above.

[0372] When the switch 5610 connects the comparator 5621 to the average value calculation unit 5600, the average value calculation unit 5600 calculates the average value of the digital pixel signal values ​​not held in the latch circuits 5612, 5622, and 5632, and outputs the calculated average value to the exposure value calculation unit 2313.

[0373] This enables preprocessing that takes the number of defective pixels d into consideration, and digital pixel signals of defective pixels can be removed, thereby suppressing color shifts in the output image data from the image sensor 100 for each pixel block 200.

[0374] [Color registration reduction example 4] Color shift reduction example 4 is a modified example of color shift reduction example 3. In color shift reduction example 3, the circuit configuration of pre-processing unit 2311 takes into account the number of defective pixels d at the time of shipment, but color shift reduction example 4 is a configuration example in which the number of defective pixels d is taken into account not only at the time of shipment but also during calibration during use.

[0375] Fig. 57 is a block diagram showing an example of the internal configuration of the image sensor 100 in color shift reduction example 4. In Fig. 57, a control block 400a controls a pixel block 200a, a control block 400b controls a pixel block 200b, and a control block 400c controls a pixel block 200c. The control blocks 400a, 400b, and 400c are connected to each other on the second semiconductor substrate 120 so as to be able to communicate with each other.

[0376] The control blocks 400a, 400b, and 400c include autonomous exposure processing units 411a, 411b, and 411c, exposure control units 412a, 412b, and 412c, and storage units 5700a, 5700b, and 5700c, respectively.

[0377] Here, pixel blocks 200a and 200c have a number of defective pixels equal to or less than the allowable number t (t is an integer greater than or equal to 0), and pixel block 200b has a number of defective pixels that exceeds the allowable number. The allowable number t is a preset value. Memory units 5700a, 5700b, and 5700c store the number of defective pixels for pixel blocks 200a, 200b, and 200c. The initial value of the number of defective pixels is the value at the time of shipment and is set for each pixel block 200a, 200b, and 200c, but can be updated by calibration during use.

[0378] Because pixel block 200b contains defective pixels that exceed the allowable number t, control block 400b does not calculate an exposure value from the digital pixel signals from pixel block 200b, but instead obtains the exposure value calculated by the control block 400 of one of adjacent pixel blocks 200a, 200c. For example, control block 400b obtains the exposure value calculated by the control block 400 that controls the adjacent pixel block 200 with the fewer defective pixels. In this way, by using the exposure value of adjacent pixel blocks 200a, 200c whose number of defective pixels is equal to or less than the allowable number, color fringing in pixel block 200b can be suppressed.

[0379] 57, the adjacent pixel blocks 200 refer to the pixel blocks 200a and 200c on the left and right of the pixel block 200b, but may also include the pixel blocks 200a and 200c above and below the pixel block 200b (not shown). Alternatively, the adjacent pixel blocks 200 may refer to the eight pixel blocks surrounding the pixel block 200b.

[0380] Furthermore, if the number of defective pixels in both adjacent pixel blocks 200 exceeds the allowable number t, the control block 400b simply acquires the exposure value calculated by the control block 400 that controls the closest pixel block 200 from among the group of pixel blocks that are two or more pixel blocks away and whose number of defective pixels is less than or equal to the allowable number t.

[0381] <Failure analysis of the bonding portion 610 between semiconductor substrates> Next, we will explain the defect analysis of bonding pads between semiconductor substrates. One way to avoid yield reduction due to bonding defects at bonding portions 610 between semiconductor substrates is to provide multiple bonding portions 610 for one signal path that passes between semiconductor substrates. However, it is difficult to detect the quality of the bonding at each bonding portion 610.

[0382] In this example, a control switch is provided for each bonding portion 610 that bonds semiconductor substrates together, and the control switch can be switched to check the operation, thereby realizing defect analysis of the bonding portion 610 between semiconductor substrates.

[0383] [Example of failure analysis of bonding pad 714 between semiconductor substrates in pixel drive signal lines] 58 is a circuit diagram showing an example of defect analysis of a bonding pad 714 between semiconductor substrates in a pixel drive signal line. A plurality of pixels 201 in the row direction of the first semiconductor substrate 110 and the pixel drive unit 413 of the second semiconductor substrate 120 are connected by a pixel drive signal line 5803. A plurality of bonding portions 610A and 610B are provided at an interface 720 between the first semiconductor substrate 110 and the second semiconductor substrate 120.

[0384] Each of the junctions 610A and 610B is formed by a pair of junction pads 714a and 714b. The junction pad 714a is provided on the first semiconductor substrate 110, and the junction pad 714b is provided on the second semiconductor substrate 120. The pixel drive signal line 5803 has a signal path that passes through the junction 610A and a signal path that passes through the junction 610B.

[0385] A test circuit 5800 is provided on the second semiconductor substrate 120 between the two bond pads 714b and the pixel driving unit 413. The test circuit 5800 has two switches 5801A and 5801B. Because the pixel control signal from the pixel driving unit 413 has a large amplitude, the switches 5801A and 5801B are configured as CMOS switches. Furthermore, because the first semiconductor substrate 110 is configured using a pixel-dedicated process that uses only NMOS, the switches 5801A and 5801B, which are configured as CMOS switches, are provided on the second semiconductor substrate 120.

[0386] Switch 5801A is provided between pixel driver 413 and junction 610A and connected by pixel drive signal line 5803. Switch 5801B is provided between pixel driver 413 and junction 610B and connected by pixel drive signal line 5803. In addition, gate terminals of switches 5801A and 5801B are each connected to pixel driver 413 by switch control line 5802.

[0387] When a control signal is input from pixel driver 413 to the gate terminal of switch 5801A, switch 5801A outputs the pixel drive signal from pixel driver 413 to junction 610A. When a control signal is input from pixel driver 413 to the gate terminal of switch 5801B, switch 5801B outputs the pixel drive signal from pixel driver 413 to junction 610B.

[0388] In an operation check before shipping, a control signal is applied from pixel driving unit 413 to only the gate terminal of switch 5801A of switches 5801A and 5801B via switch control line 5802, and it is confirmed whether the pixel drive signal from pixel driving unit 413 passes through junction 610A and reaches multiple pixels 201 in the row direction. Similarly, a control signal is applied from pixel driving unit 413 to only the gate terminal of switch 5801B via switch control line 5802, and it is confirmed whether the pixel drive signal from pixel driving unit 413 passes through junction 610B and reaches multiple pixels 201 in the row direction.

[0389] If conduction is detected in at least one of the two signal paths passing through the junctions 610A, 610B of the pixel drive signal line 5803, the junction between the pixel drive unit 413 and the multiple pixels 201 in the row direction is determined to be good.

[0390] [Example of failure analysis of bonding pad 714 between semiconductor substrates in signal line 202] 59 is a circuit diagram showing a first example of defect analysis of a bonding pad 714 between semiconductor substrates in a signal line 202. The pixel 201 of the first semiconductor substrate 110 and the pixel driving unit 413 of the second semiconductor substrate 120 are connected by the signal line 202. The signal line 202 is shared by m pixels 201 in the column direction.

[0391] 58, a plurality of junctions 610A, 610B are provided at an interface 720 between the first semiconductor substrate 110 and the second semiconductor substrate 120. Each of the junctions 610A, 610B is composed of a pair of junction pads 714a, 714b. The junction pad 714a is provided on the first semiconductor substrate 110, and the junction pad 714b is provided on the second semiconductor substrate 120. The signal line 202 has a signal path that passes through the junction 610A and a signal path that passes through the junction 610B.

[0392] The test circuit 5800 is provided, for example, in the signal input unit 421. Considering the symmetry of the pixel structure and the number of transistors, it is preferable to provide the test circuit 5800 on the second semiconductor substrate 120. That is, if the test circuit 5800 is provided on the first semiconductor substrate 110, the pixel 201 closest to the second semiconductor substrate 120 among the multiple pixels 201 in the column direction will have different pixel structure layouts and different numbers of transistors than the other pixels 201, resulting in a decrease in manufacturing yield.

[0393] Switch 5801A is provided between pixel driver 413 and junction 610A, and is connected by signal line 202. Switch 5801B is provided between pixel driver 413 and junction 610B, and is connected by signal line 202. In addition, gate terminals of switches 5801A and 5801B are each connected to pixel driver 413 by switch control line 5802.

[0394] When a control signal is input from pixel driving unit 413 to the gate terminal of switch 5801A, switch 5801A outputs the analog pixel signal from pixel 201 to signal conversion unit 422 via junction 610A. When a control signal is input from pixel driving unit 413 to the gate terminal of switch 5801B, switch 5801B outputs the analog pixel signal from pixel 201 to signal conversion unit 422 via junction 610B.

[0395] In an operation check before shipping, a control signal is applied from the pixel driving unit 413 to only the gate terminal of switch 5801A of switches 5801A and 5801B via switch control line 5802 to check whether the analog pixel signal from pixel 201 passes through junction 610A and reaches signal conversion unit 422. Similarly, a control signal is applied from the pixel driving unit 413 to only the gate terminal of switch 5801B via switch control line 5802 to check whether the analog pixel signal from pixel 201 passes through junction 610B and reaches signal conversion unit 422.

[0396] If conduction is detected in at least one of the two signal paths passing through the junctions 610A and 610B of the signal line 202, the connection between the pixel 201 and the signal conversion unit 422 is determined to be good.

[0397] FIG. 60 is a circuit diagram showing Failure Analysis Example 2-1 of a bonding pad 714 between semiconductor substrates in a signal line 202. In Failure Analysis Example 1 of FIG. 59, the test circuit 5800 is provided on the second semiconductor substrate 120, but in Failure Analysis Example 2-1 of FIG. 60, the test circuit 5800 is provided on the first semiconductor substrate 110. This is effective when the circuit scale of the second semiconductor substrate 120 increases. Specifically, for example, the first semiconductor substrate 110 has an FD-sharing pixel group 6000. In the FD-sharing pixel group 6000, the FD 303 and pixel output unit 305 are shared by multiple (four in FIG. 60) photoelectric conversion units 300.

[0398] The pixel output unit 305 has an amplifier unit 351 and selectors 352A and 352B, which constitute a test circuit 5800. The selectors 352A and 352B serve as switches in the test circuit 5800. The junction 610A connects the selector 352A and the signal input unit 421. The junction 610B connects the selector 352B and the signal input unit 421.

[0399] When the selection control signal φSEL is input to the gate terminal of the selection unit 352A, the selection unit 352A outputs the analog pixel signal from the FD-shared pixel group 6000 to the signal conversion unit 422 via the junction 610A. When the selection control signal φSEL is input to the gate terminal of the selection unit 352B, the selection unit 352B outputs the analog pixel signal from the FD-shared pixel group 6000 to the signal conversion unit 422 via the junction 610B.

[0400] In an operation check before shipping, the selection control signal φSEL is applied only to the gate terminal of the selection unit 352A of the selection units 352A and 352B, and it is confirmed whether the analog pixel signal from the FD-shared pixel group 6000 passes through the junction 610A and reaches the signal conversion unit 422. Similarly, the selection control signal φSEL is applied only to the gate terminal of the selection unit 352B, and it is confirmed whether the analog pixel signal from the FD-shared pixel group 6000 passes through the junction 610B and reaches the signal conversion unit 422.

[0401] If conduction is detected in at least one of the two signal paths passing through the junctions 610A and 610B of the signal line 202, the junction between the FD-sharing pixel group 6000 and the signal conversion unit 422 is determined to be good.

[0402] Fig. 61 is a circuit diagram showing Failure Analysis Example 2-2 of a bonding pad 714 between semiconductor substrates in a signal line 202. While Failure Analysis Example 2-1 in Fig. 60 describes the case of an FD-sharing pixel group 6000, Failure Analysis Example 2-2 in Fig. 61 is an example where an ADC 500 is provided for each pixel 201. In this case as well, if conduction is detected in at least one of the two signal paths passing through bonding portions 610A, 610B of the signal line 202, the bonding between the pixel 201 and the signal conversion unit 422 is determined to be good.

[0403] [Example of failure analysis of bonding pads between semiconductor substrates when multiple circuits share a signal path] Fig. 62 is a circuit diagram showing an example of failure analysis of a bonding pad between semiconductor substrates when a signal path is shared between multiple circuits. Fig. 62 shows an example of failure analysis of a bonding pad between semiconductor substrates 6200A and 6200B. If the semiconductor substrate 6200A is the first semiconductor substrate 110, the semiconductor substrate 6200B is the second semiconductor substrate 120, and if the semiconductor substrate 6200A is the second semiconductor substrate 120, the semiconductor substrate 6200B is the third semiconductor substrate 130.

[0404] The semiconductor substrate 6200A has circuits A1 and A2. If the semiconductor substrate 6200A is the first semiconductor substrate 110, the circuits A1 and A2 are, for example, pixels 201. If the semiconductor substrate 6200A is the second semiconductor substrate 120, the circuits A1 and A2 are, for example, ADCs 500.

[0405] The semiconductor substrate 6200B has circuits B1 and B2. If the semiconductor substrate 6200B is the first semiconductor substrate 110, the circuits B1 and B2 are, for example, the ADC 500. If the semiconductor substrate 6200B is the third semiconductor substrate 130, the circuits B1 and B2 are, for example, digital circuits in the data processing unit 103.

[0406] Bonds 6201P, 6201Q, 6202P, and 6202Q are provided at the interface 6210 between the first semiconductor substrate 110 and the second semiconductor substrate 120. Each of the bonds 6201P, 6201Q, 6202P, and 6202Q is composed of a pair of bond pads 714a and 714b. Bond pad 714a is provided on the semiconductor substrate 6200A, and bond pad 714b is provided on the semiconductor substrate 6200B.

[0407] A test circuit 6220 is provided between semiconductor substrates 6200A and 6200B across interface 6210. The test circuit 6220 has a first test circuit 6221 that performs a defect analysis of a pair of bonding pads 714a and 714b between circuits A1 and B1, a second test circuit 6222 that performs a defect analysis of a pair of bonding pads 714a and 714b between circuits A2 and B2, and connection wiring 6223 that connects the first test circuit 6221 and the second test circuit 6222.

[0408] The first test circuit 6221 is a circuit in which switches SW1A1 and SW1B1 are connected in series between circuits A1 and B1 via junction 6201P, and switches SW1A2 and SW1B2 are connected in series between circuits A1 and B1 via junction 6201Q, connected in parallel.

[0409] The second test circuit 6222 is a circuit in which switches SW2A1 and SW2B1 are connected in series between circuits A2 and B2 via junction 6202P, and switches SW2A2 and SW2B2 are connected in series between circuits A2 and B2 via junction 6202Q, connected in parallel.

[0410] The connection wiring 6223 connects the switch SW1A2 of the first test circuit 6221 and the switch SW2A1 of the second test circuit 6222 on the semiconductor substrate 6200A, and connects the switch SW1B2 of the first test circuit 6221 and the switch SW2B1 of the second test circuit 6222 on the semiconductor substrate 6200B.

[0411] 62 and 63, the path that passes through circuit A1, switch SW1A1, junction 6201P, switch SW1B1, and circuit B1 is referred to as the first wiring. The path that passes through circuit A1, switch SW1A1, junction 6201Q, switch SW1B1, and circuit B1 is referred to as the second wiring. The path that passes through circuit A2, switch SW2A1, junction 6202P, switch SW2B1, and circuit B2 is referred to as the third wiring. The path that passes through circuit A2, switch SW2A2, junction 6202Q, switch SW2B2, and circuit B2 is referred to as the fourth wiring.

[0412] In the first test circuit 6221, the gates of the switches SW1A1 and SW1B1 are turned ON and the gates of the switches SW1A2 and SW1B2 are turned OFF, thereby performing a defect analysis of the junction 6201P to determine whether or not there is conduction between the circuits A1 and B1 of the first wiring.

[0413] Similarly, by turning on the gates of the switches SW1A2 and SW1B2 and turning off the gates of the switches SW1A1 and SW1B1, a failure analysis of the junction 6201Q is performed to determine whether or not there is conduction between the circuits A1 and B1 of the second wiring.

[0414] In the second test circuit 6222, the gates of the switches SW2A1 and SW2B1 are turned ON and the gates of the switches SW2A2 and SW2B2 are turned OFF, thereby performing a defect analysis of the junction 6202P to determine whether or not there is conduction between the circuits A2 and B2 of the third wiring.

[0415] Similarly, by turning on the gates of the switches SW2A2 and SW2B2 and turning off the gates of the switches SW2A1 and SW2B1, a failure analysis of the junction 6202Q is performed to determine whether or not there is conduction between the circuits A2 and B2 of the fourth wiring.

[0416] 63 is a circuit diagram showing an example of settings after failure analysis of bonding pads between semiconductor substrates when a signal path is shared between multiple circuits. Assume that the failure analysis in FIG. 62 detects bonding defects, for example, at bonding points 6202P and 6202Q. In this case, signal transmission between circuits A2 and B2 is not possible via the third and fourth wiring in the second test circuit 6222. Therefore, in the first test circuit 6221, switches SW1A1 and SW1B1 are turned on to enable transmission between circuits A1 and B1 via the first wiring 6301.

[0417] Furthermore, the first test circuit 6221 turns off the switches SW1A2 and SW1B2, the second test circuit 6222 turns on the switches SW2A1 and SW2B1 and turns off the switches SW2A2 and SW2B2, and the connection wiring 6223 turns on the switches SW3A and SW3B. This enables transmission between the circuits A2 and B2 via the detour path 6302 that passes the junction 6001Q that passed the failure analysis. In this way, by reusing the path of an adjacent circuit, it is possible to avoid poor conductivity when the bonding pad 714 is defective.

[0418] [Example of failure analysis of bonding pads between semiconductor substrates when the bonding area is shared between multiple circuits] Fig. 64 is a circuit diagram showing Example 1 of failure analysis of a bonding pad between semiconductor substrates when a bonding portion is shared between multiple circuits, and Fig. 65 is a circuit diagram showing Example 2 of failure analysis of a bonding pad between semiconductor substrates when a bonding portion is shared between multiple circuits. Figs. 64 and 65 have the same circuit configuration, but the bonding portions detected as defective are different. First, the circuit configurations of Figs. 64 and 65 will be described.

[0419] The test circuit 6400 has switches SW1, SW2, and SW3 on a semiconductor substrate 6200 A and switches SW4, SW5, and SW6 on a semiconductor substrate 6200 B. Bonding portions 6401 to 6403 are provided on the boundary surface 6210 .

[0420] Switch SW1 switches between the connection between circuit A1 and bonding pad 714a of bonding portion 6401 and the connection between another circuit (not shown) and bonding pad 714a of bonding portion 6401.

[0421] Switch SW2 switches between connecting circuit A1 to bond pad 714a of junction 6403 and connecting circuit A2 to bond pad 714a of junction 6403.

[0422] Switch SW3 switches between the connection between circuit A2 and bonding pad 714a of junction 6402 and the connection between another circuit (not shown) and bonding pad 714a of junction 6402. do.

[0423] Switch SW4 switches between the connection between circuit B1 and bonding pad 714a of bonding portion 6401 and the connection between another circuit (not shown) and bonding pad 714b of bonding portion 6401.

[0424] Switch SW5 switches between connecting circuit B1 to bond pad 714b of junction 6403 and connecting circuit B2 to bond pad 714b of junction 6403.

[0425] Switch SW6 switches between the connection between circuit B2 and bond pad 714b of junction 6402 and the connection between another circuit (not shown) and bond pad 714b of junction 6402.

[0426] 64 and 65, the path that passes through circuit A1, switch SW1, junction 6401, switch SW4, and circuit B1 is referred to as the first wiring, and the path that passes through circuit A2, switch SW3, junction 6402, switch SW6, and circuit B2 is referred to as the second wiring.

[0427] The path that passes through circuit A1, switch SW2, junction 6403, switch SW5, and circuit B1 is referred to as a third wiring, and the path that passes through circuit A1, switch SW2, junction 6403, switch SW5, and circuit B2 is referred to as a fourth wiring.

[0428] The path that passes through circuit A2, switch SW2, junction 6403, switch SW5, and circuit B1 is referred to as fifth wiring. The path that passes through circuit A2, switch SW2, junction 6403, switch SW5, and circuit B2 is referred to as sixth wiring.

[0429] 64, assume that a bond failure is detected at bond 6401 through failure analysis by test circuit 6400. In this case, switches SW1 and SW4 are disconnected, switch SW2 connects circuit A1 to bond pad 714a of bond 6403, and switch SW5 connects circuit B1 to bond pad 714b of bond 6403, thereby forming a third wiring.

[0430] Furthermore, the switch SW3 connects the circuit A2 to the bonding pad 714a of the bonding portion 6402, and the switch SW6 connects the circuit B2 to the bonding pad 714b of the bonding portion 6402, thereby forming a second wiring.

[0431] As a result, signals are transmitted between the circuits A1 and B1 via the third wiring through the junction 6403, and signals are transmitted between the circuits A2 and B2 via the second wiring through the junction 6402.

[0432] 65, assume that a bond failure is detected at bond 6403 through failure analysis by test circuit 6400. In this case, switches SW2 and SW5 are disconnected, switch SW1 connects circuit A1 to bond pad 714a of bond 6401, and switch SW4 connects circuit B1 to bond pad 714b of bond 6401, thereby forming a first wiring.

[0433] Furthermore, the switch SW3 connects the circuit A2 to the bonding pad 714a of the bonding portion 6402, and the switch SW6 connects the circuit B2 to the bonding pad 714b of the bonding portion 6402, thereby forming a second wiring.

[0434] As a result, signals are transmitted between the circuits A1 and B1 via the first wiring through the junction 6401, and signals are transmitted between the circuits A2 and B2 via the second wiring through the junction 6403.

[0435] In this way, defective connections at the joints 6401 to 6403 between the semiconductor substrates 6200A and 6200B can be detected, and signal transmission can be performed using the acceptable joints.

[0436] 66 is a block diagram showing an example of the configuration of an image pickup device 6600 according to an embodiment. The image pickup device 6600 includes an image pickup element 100, a system control unit 6601, a drive unit 6602, a photometry unit 6603, a work memory 6604, a recording unit 6605, a display unit 6606, an operation unit 6608, a drive unit 6614, and a photographing lens 6620.

[0437] The photographing lens 6620 guides the subject light beam incident along the optical axis OA to the image sensor 100. The photographing lens 6620 is composed of a group of multiple optical lenses, and focuses the subject light beam from the scene near its focal plane. The photographing lens 6620 may be an interchangeable lens that can be attached to and detached from the image capturing device 6600. Note that in FIG. 66, the photographing lens 6620 is represented by a virtual single lens placed near the pupil.

[0438] The driver 6614 drives the photographing lens 6620. For example, the driver 6614 changes the focus position by moving the optical lens group of the photographing lens 6620. The driver 6614 may also drive an iris diaphragm in the photographing lens 6620 to control the amount of subject light entering the image sensor 100.

[0439] The drive unit 6602 has a control circuit that executes charge accumulation control such as timing control and area control of the image sensor 100 in accordance with instructions from the system control unit 6601. In addition, the operation unit 6608 receives instructions from the photographer using a release button or the like.

[0440] The image sensor 100 passes pixel signals to an image processing unit 6611 in the system control unit 6601. The image processing unit 6611 generates image data by performing various image processes using a work memory 6604 as a workspace. For example, when generating image data in JPEG file format, a color video signal is generated from a signal obtained using the Bayer array, and then compression processing is performed. The generated image data is recorded in a recording unit 6605 and converted into a display signal, which is displayed on a display unit 6606 for a preset time.

[0441] The photometry unit 6603 detects the luminance distribution of a scene prior to a series of shooting sequences for generating image data. The photometry unit 6603 includes, for example, an AE sensor with approximately one million pixels. The calculation unit 6612 of the system control unit 6601 receives the output of the photometry unit 6603 and calculates the luminance of each region of the scene.

[0442] The calculation unit 6612 determines the shutter speed, aperture value, and ISO sensitivity in accordance with the calculated luminance distribution. The image sensor 100 may also serve as the photometry unit 6603. The calculation unit 6612 also executes various calculations for operating the image capture device 6600. Part or all of the drive unit 6602 may be mounted on the image sensor 100. Part of the system control unit 6601 may be mounted on the image sensor 100.

[0443] The present invention is not limited to the above-described contents, and may be implemented by any combination thereof. Furthermore, other embodiments conceivable within the scope of the technical concept of the present invention are also included in the scope of the present invention. [Explanation of symbols]

[0444] 100, 100A, 100B imaging element, 101 pixel unit, 102 control circuit unit, 103 data processing unit, 110 first semiconductor substrate, 120 second semiconductor substrate, 121 peripheral circuit unit, 130 third semiconductor substrate, 200 pixel block, 201 pixel, 202 signal line, 210 pixel group, 300 photoelectric conversion unit, 301 transfer unit, 302 discharge unit, 304 reset unit, 305 pixel output unit, 306 load current source, 310 readout unit, 351 amplifier unit, 352 selection unit, 400, 400A, 400B control block, 401 pixel control unit, 402 signal transfer unit, 411 autonomous exposure processing unit, 412 exposure control unit, 413 pixel drive unit, 421 signal input unit, 422 signal processing unit, 423 signal output unit< / m>

Claims

[Claim 1] a first semiconductor substrate having a pixel portion including a first pixel including a first photoelectric conversion unit that converts light into an electric charge and a second pixel including a second photoelectric conversion unit that converts light into an electric charge; a second semiconductor substrate that is stacked together with the first semiconductor substrate, the second semiconductor substrate having a first circuit unit including a first processing unit that performs an operation using signals read out from the first pixels, a first control unit that controls an accumulation time for accumulating charges converted by the first photoelectric conversion unit, a second processing unit that performs an operation using signals read out from the second pixels, and a second control unit that controls an accumulation time for accumulating charges converted by the second photoelectric conversion unit; and a second circuit unit that includes a third processing unit that performs an operation using signals read out from the first pixels, and a fourth processing unit that performs an operation using signals read out from the second pixels, the first control unit controls an accumulation time for accumulating the electric charge converted by the first photoelectric conversion unit based on a first calculation result calculated by at least one of the first processing unit and the third processing unit; the second control unit controls an accumulation time for accumulating the electric charges converted by the second photoelectric conversion unit based on a second calculation result calculated by at least one of the second processing unit and the fourth processing unit. Image sensor.

Images