Image pickup element and image pickup device
By adopting the structure of the photoelectric conversion unit, the comparison unit and the storage unit in the imaging element, combined with the switch control of the readout control unit, the problem of low efficiency of multiple pixel signal reading processing in the prior art is solved, and faster signal reading and higher frame rates are achieved.
Patent Information
- Application Number
- CN202080031798.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2019-03-29
- Filing Date
- 2020-03-27
- Publication Date
- 2025-04-29
- Estimated Expiration
- 2040-03-27
AI Technical Summary
In the signal processing and horizontal transmission control, the conventional imaging element has the problem of storing digital values corresponding to the pixel light receiving amount, especially in the reading process of multiple pixel signals, and there are problems of time delay and low efficiency.
Using an imaging element structure including the first and second photoelectric conversion sections, a comparison section and a storage section, a signal that generates charges through photoelectric conversion is compared with a reference signal, a first signal and a second signal are generated, and these signals are stored in the corresponding storage section. The readout control unit controls the switches SW1 and SW2, and different readout methods (individual readout, additive readout, etc.) are realized to improve signal readout efficiency.
The readout time of pixel signals is shortened, the frame rate during imaging is increased, and the area of the imaging element is avoided.
Smart Images

Figure CN113748670B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to an imaging element and an imaging device. Background Art
[0002] Conventionally, there is known an imaging element including a storage unit for storing a digital value corresponding to the amount of light received by a pixel and a storage unit for temporarily storing the digital value for signal processing or horizontal transfer control (for example, Patent Document 1).
[0003] Prior art literature
[0004] Patent Literature
[0005] Patent Document 1: International Publication No. 2017 / 18215 Summary of the invention
[0006] According to the first aspect of the invention, an imaging element comprises: a first photoelectric conversion unit and a second photoelectric conversion unit that generate electric charges by photoelectric conversion; a first comparison unit that outputs a first signal based on a first comparison result, wherein the first comparison result is a result obtained by comparing a signal based on the electric charges generated by the first photoelectric conversion unit with a reference signal; a first storage unit that receives the first signal output from the first comparison unit and stores a signal based on the first signal; a second comparison unit that outputs a second signal based on a second comparison result, wherein the second comparison result is a result obtained by comparing a signal based on the electric charges generated by the second photoelectric conversion unit with the reference signal; a second storage unit that receives the second signal output from the second comparison unit and stores a signal based on the second signal; and a first connection unit that is capable of connecting or disconnecting the first comparison unit and the second storage unit.
[0007] According to a second aspect of the invention, an imaging device comprises: an imaging element according to the first aspect; and a generating unit that generates image data based on a signal output from the imaging element. BRIEF DESCRIPTION OF THE DRAWINGS
[0008] Figure 1 It is a diagram showing a configuration example of the imaging device according to the first embodiment.
[0009] Figure 2 This is a block diagram showing a configuration example of an image pickup element according to the first embodiment.
[0010] Figure 3 This is a circuit diagram showing a configuration example of a part of the image pickup element according to the first embodiment.
[0011] Figure 4 It is a diagram for explaining the readout processing of the imaging element according to the first embodiment.
[0012] Figure 5 This is a diagram for explaining an example of a method of adding signals of pixels in the image sensor according to the first embodiment.
[0013] Figure 6 It is a diagram for explaining another readout process of the image pickup element according to the first embodiment.
[0014] Figure 7 It is a diagram for explaining another readout process of the image pickup element according to the first embodiment.
[0015] Figure 8 It is a diagram for explaining another readout process of the image pickup element according to the first embodiment.
[0016] Fig. 9 It is a diagram for explaining another readout process of the image pickup element according to the first embodiment.
[0017] Fig.10 It is a diagram comparing the readout processing of the imaging element according to the first embodiment. DETAILED DESCRIPTION
[0018] (First Embodiment)
[0019] Figure 1 1 is a diagram showing a configuration example of a camera 1, which is an example of an imaging device according to the first embodiment. The camera 1 includes a photographic optical system (imaging optical system) 2, an imaging element 3, a control unit 4, a memory 5, a display unit 6, and an operation unit 7. The photographic optical system 2 includes a plurality of lenses including a focus adjustment lens (focus lens) and an aperture, and forms an image of a subject on the imaging element 3. In addition, the photographic optical system 2 may be detachable from the camera 1.
[0020] The imaging element 3 is an imaging element such as a CMOS image sensor or a CCD image sensor. The imaging element 3 receives the light beam passing through the photographic optical system 2 and captures the subject image formed by the photographic optical system 2. In the imaging element 3, a plurality of pixels having a photoelectric conversion unit are arranged two-dimensionally (in the row direction and the column direction). The photoelectric conversion element is composed of a photodiode (PD). The imaging element 3 performs photoelectric conversion on the received light to generate a signal, and outputs the generated signal to the control unit 4.
[0021] The memory 5 is a recording medium such as a memory card. Image data, control programs, etc. are recorded in the memory 5. Writing of data to the memory 5 and reading of data from the memory 5 are controlled by the control unit 4. The display unit 6 displays an image based on the image data, information related to photography such as shutter speed and aperture value, and a menu screen, etc. The operation unit 7 includes various setting switches such as a release button, a power switch, and switches for switching various modes, and outputs signals based on the respective operations to the control unit 4.
[0022] The control unit 4 is composed of a processor such as a CPU, FPGA, and ASIC, and a memory such as a ROM and RAM, and controls each part of the camera 1 based on a control program. The control unit 4 supplies a signal for controlling the imaging element 3 to the imaging element 3 to control the operation of the imaging element 3. In addition, the control unit 4 performs various image processing on the signal output from the imaging element 3 to generate image data. The control unit 4 is also an image generation unit that generates image data, and generates still image data and dynamic image data based on the signal output from the imaging element 3. Image processing includes image processing such as grayscale conversion processing and color interpolation.
[0023] The control unit 4 performs a process of individually reading the signals of all pixels of the imaging element 3 and a process of mixing (adding) the signals of a plurality of pixels and reading them out. The control unit 4 controls the imaging element 3 and selects (sets) a method of reading the signals of the pixels. For example, when the display unit 6 displays a real-time display image (live view image) of the subject, the control unit 4 performs a process of mixing and reading the signals of a plurality of pixels when performing a moving image shooting. In addition, when performing a high-resolution still image shooting, the control unit 4 performs a process of individually reading the signals of all pixels.
[0024] Figure 2 1 is a block diagram showing an example of the configuration of an imaging element according to the first embodiment. The imaging element 3 is configured by stacking a first substrate 111 on which a plurality of pixels 10 are formed, and a second substrate 112 on which a plurality of analog / digital conversion units (AD conversion units) 40 are formed. The first substrate 111 and the second substrate 112 are each configured using a semiconductor substrate. The circuit provided on the first substrate 111 and the circuit provided on the second substrate 112 are electrically connected via bumps, electrodes, and the like.
[0025] The first substrate 111 has a plurality of pixels 10 arranged two-dimensionally. The pixels 10 output a photoelectric conversion signal and a dark signal to be described later to the second substrate 112. Figure 2 , the upper left pixel 10 is set as the pixel 10 (1, 1) in the 1st row and 1st column, and the lower right pixel 10 is set as the pixel 10 (4, 4) in the 4th row and 4th column, and 16 pixels 10 are shown in the figure, 4 pixels in the row direction and 4 pixels in the column direction. In addition, the number and arrangement of pixels arranged in the imaging element are not limited to the example shown in the figure.
[0026] The second substrate 112 has a plurality of AD converters 40. In the present embodiment, the AD converter 40 is provided for each pixel 10. Figure 2, 16 AD converters 40, i.e., AD converters 40 (1, 1) to 40 (4, 4), are shown. The AD converters 40 include a comparison unit and a storage unit, and convert the input photoelectric conversion signal and dark signal into digital signals of a predetermined number of bits, which will be described later.
[0027] Figure 3 1 is a circuit diagram showing a configuration example of a part of the image sensor according to the first embodiment. The image sensor 3 includes a plurality of pixels 10 , a plurality of AD converters 40 , a readout control unit 60 , a signal processing unit 70 , and an input / output unit 80 .
[0028] The pixel 10 includes a photoelectric conversion unit 11, a transfer unit 12, a reset unit 13, a floating diffusion (FD) 14, an amplifier unit 15, and a current source 16. The photoelectric conversion unit 11 is a photodiode PD, which converts incident light into electric charge and accumulates the electric charge obtained after the photoelectric conversion. The transfer unit 12 is composed of a transistor M1 controlled by a signal TX, and transfers the electric charge obtained after the photoelectric conversion by the photoelectric conversion unit 11 to FD14. The transistor M1 is a transfer transistor. FD14 accumulates (holds) the electric charge transferred to FD14. The current source 16 generates a current for reading a signal from the pixel 10, and supplies the generated current to the signal line 18 and the amplifier unit 15.
[0029] The amplifier 15 is composed of a transistor M3 whose gate (terminal) is connected to FD14, and amplifies a signal based on the charge accumulated in FD14 and outputs it to the signal line 18. The transistor M3 is an amplifier transistor. The reset unit 13 is composed of a transistor M2 controlled by a signal RST, and discharges the charge accumulated in FD14 to reset the voltage of FD14. The transistor M2 is a reset transistor.
[0030] The pixel 10 sequentially outputs a signal (dark signal) when resetting the voltage of the FD 14 and a signal (photoelectric conversion signal) corresponding to the charge transferred from the photoelectric conversion unit 11 to the FD 14 by the transfer unit 12 to the signal line 18. The dark signal becomes an analog signal representing a reference level relative to the photoelectric conversion signal. In addition, the photoelectric conversion signal is an analog signal generated based on the charge obtained after photoelectric conversion by the photoelectric conversion unit 11. The dark signal and the photoelectric conversion signal sequentially output from the pixel 10 are input to the AD conversion unit 40 via the signal line 18 and the bump, etc.
[0031] The AD conversion unit 40 includes a comparison unit 20, a switch SW1, a storage unit 25, and a selection unit 30. The comparison unit 20 is configured to include a comparator circuit. A ramp signal ramp, which is a reference signal and changes with time, is input from a signal generation circuit (not shown) to a first terminal 21 of the comparison unit 20. A signal (photoelectric conversion signal, dark signal) output from the pixel 10 to the signal line 18 is directly input to a second terminal 22 of the comparison unit 20 or is input after being amplified by an amplifier circuit (not shown). The comparison unit 20 compares the signal input from the pixel 10 with the reference signal, and outputs an output signal as a comparison result from an output terminal 23.
[0032] The comparison unit 20 is connected to the storage unit 25 via the switch SW1. The switch SW1 is composed of a transistor, and electrically connects or disconnects the comparison unit 20 and the storage unit 25. When the switch SW1 is in the on state, the output signal of the comparison unit 20 is output to the storage unit 25.
[0033] The storage unit 25 is composed of a plurality of latch circuits corresponding to the number of bits of the stored digital signal. An output signal representing the comparison result based on the comparison unit 20 is input to one input terminal (G terminal) of each latch circuit via the switch SW1. A clock signal representing the count value is input to the other input terminal (D terminal) of each latch circuit from a counter circuit (not shown). Figure 3 In the example shown, cnt<0> to cnt<n> indicating count values are input to the other input terminals (D terminals) of the latch circuits, and the AD converter 40 becomes an n-bit AD converter circuit.
[0034] The storage unit 25 stores the count value corresponding to the elapsed time from the start of comparison by the comparison unit 20 to the inversion of the comparison result as a digital signal based on the output signal of the comparison unit 20 and the clock signal from the counter circuit. In other words, the storage unit 25 stores the count value corresponding to the time until the magnitude relationship between the level of the signal output from the pixel 10 and the level of the reference signal changes (inverts) as a digital signal based on the signal output from the comparison unit 20.
[0035] When the dark signal of the pixel 10 is input to the comparison unit 20, the comparison unit 20 compares the dark signal with the reference signal and outputs the comparison result to the storage unit 25. The storage unit 25 stores the count value corresponding to the elapsed time from the start of the comparison by the comparison unit 20 to the time when the comparison result is reversed as a digital signal based on the dark signal based on the comparison result and the clock signal of the comparison unit 20. In addition, when the photoelectric conversion signal of the pixel 10 is input to the comparison unit 20, the comparison unit 20 compares the photoelectric conversion signal with the reference signal and outputs the comparison result to the storage unit 25. The storage unit 25 stores the count value corresponding to the elapsed time from the start of the comparison by the comparison unit 20 to the time when the comparison result is reversed as a digital signal based on the photoelectric conversion signal based on the comparison result and the clock signal of the comparison unit 20. In this way, the AD conversion unit 40 converts the photoelectric conversion signal, which is an analog signal, into a digital signal of a predetermined number of bits, and converts the dark signal, which is an analog signal, into a digital signal of a predetermined number of bits.
[0036] The selection unit 30 is composed of a multiplexer controlled by a signal SEL, and inputs a pixel signal converted into a digital signal from the storage unit 25 (in Figure 3 The selection unit 30 outputs the pixel signal input from the storage unit 25 to the signal line 50 (hereinafter referred to as the data line). The data line 50 is composed of a plurality of signal lines corresponding to the number of bits of the digital signal output from the AD conversion unit 40. In the imaging element 3, a data line 50 (in the vertical direction) is provided for each column of the plurality of AD conversion units 40 arranged in the longitudinal direction, that is, the column direction (vertical direction). Figure 3 There are n signal lines in the figure).
[0037] The signal processing unit 70 includes an amplifier circuit and a decoding circuit. The pixel signal converted into a digital signal (a digital signal based on a dark signal, a digital signal based on a photoelectric conversion signal) is input to the signal processing unit 70 via the data line 50. The processing unit 70 performs signal processing such as correlated double sampling and transcoding on the signal input from the AD conversion unit 40 via the data line 50, and outputs it to the input-output unit 80. The input-output unit 80 has an input-output circuit corresponding to a high-speed interface such as SLVS and LVDS. The input-output unit 80 outputs (transmits) the signal input from the signal processing unit 70 to the control unit 4 of the camera 1 at high speed.
[0038] The readout control section 60 is provided in common with the plurality of pixels 10 and the plurality of AD conversion sections 40. The readout control section 60 is composed of a plurality of circuits including a timing generator, and is disposed separately on the first substrate 111 and the second substrate 112. In addition, the readout control section 60 may be disposed on either the first substrate 111 or the second substrate 112, or the first substrate 112 and the second substrate 112 may be disposed on different substrates.
[0039] The readout control unit 60 is controlled by the control unit 4 of the camera 1, and supplies the above-mentioned signal TX, signal RST and other signals to each pixel 10 to control the operation of each pixel 10. The readout control unit 60 supplies a signal to the gate of each transistor of the pixel 10 to set the transistor to a conducting state (connected state, conducting state, short-circuited state) or a closed state (disconnected state, non-conducting state, open state, blocked state).
[0040] The readout control section 60 supplies the signal SEL to the selection section 30 of each AD conversion section 40, and controls the selection section 30 of each AD conversion section 40. When the selection section 30 is set to an enabled state (conduction state) by the readout control section 60, the pixel signal converted into a digital signal input from the storage section 25 is output to the signal processing section 70 via the data line 50. The readout control section 60 sequentially sets the selection section 30 of each AD conversion section 40 to the conduction state, and outputs the pixel signal stored in the storage section 25 connected to the selection section 30 set to the conduction state to the data line 50. It can also be said that the readout control section 60 sequentially selects a plurality of AD conversion sections 40, and reads the pixel signal converted into a digital signal from the selected AD conversion section 40. For each data line 50, the pixel signal of n bits converted into a digital signal is input to the signal processing section 70.
[0041] Figure 4 The image sensor 3 is provided with a switch SW2 (in the case of the image sensor 3) for connecting or disconnecting the comparison unit 20 of the AD conversion unit 40 and the storage unit 25 of the AD conversion unit 40 different from the AD conversion unit 40. Figure 4 In the present embodiment, the switch SW2 connects the output terminal 23 of the comparison unit 20 of one AD conversion unit 40 and the input terminal (G terminal) of the storage unit 25 of the other AD conversion unit 40, of two AD conversion units 40 adjacent to each other in the row direction.
[0042] exist Figure 4 In the example shown, switches SW2 are provided between the comparison units 20 of the AD conversion units 40 in the odd columns and the storage units 25 of the AD conversion units 40 in the even columns. The switches SW2 are formed of transistors. For example, the switch SW2a is a connection unit 2A that connects the comparison unit 20 of the AD conversion unit 40 (1, 1) in the AD conversion unit 40 in the first row and the storage unit 25 of the AD conversion unit 40 (1, 2). The switch SW2e is a connection unit 2e that connects the comparison unit 20 of the AD conversion unit 40 (3, 1) in the AD conversion unit 40 in the third row and the storage unit 25 of the AD conversion unit 40 (3, 2). The readout control unit 60 (refer to Figure 3) supplies signals to each switch SW2a to SW2h to control the on / off of each switch.
[0043] The readout control unit 60 performs a process of individually reading out the signal of each pixel of the imaging element 3 (individual readout process) and a process of adding and reading out the signals of a plurality of pixels (addition readout process). In the individual readout process, the readout control unit 60 reads out the signals of each pixel in units of rows. Figure 4 The AD converters 40 of the image sensor 3 are selected sequentially from the first row to the fourth row, and pixel signals are read from the selected AD converters 40 .
[0044] In the addition readout process, the readout control unit 60 performs Figure 5 As shown in (a) of FIG. 1 , the plurality of switches SW are controlled to connect the FDs 14 of the plurality of pixels 10 to each other, thereby adding the signals of the plurality of pixels. Figure 5 As shown in (b), the plurality of switches SW are controlled to connect the amplifiers 15 of the plurality of pixels 10 to the same signal line 18, thereby adding the signals of the plurality of pixels. The readout control unit 60 performs the following processing, that is, selects a part of the AD converters 40 (hereinafter referred to as the first AD converter) among the plurality of AD converters 40 of the imaging element 3 to which a signal generated by adding the signals of the plurality of pixels is inputted, according to one or more rows, to read out the signals of the pixels.
[0045] In this embodiment, the addition readout process has a first readout method, a second readout method, and a third readout method. The first readout method is a method of sequentially selecting the first AD conversion unit 40 for each row and reading out the signal of the pixel converted into a digital signal. The first AD conversion unit 40 is an AD conversion unit 40 selected by thinning out the AD conversion units 40 of a specific row or column among all the AD conversion units 40. The first AD conversion unit 40 receives the signal of the pixel obtained by addition and converts the signal of the pixel obtained by addition into a digital signal.
[0046] The second readout method is a method of sequentially selecting the first AD conversion section 40 for each plurality of rows and reading out the pixel signals converted into digital signals.
[0047] The third readout method is a method of simultaneously (in parallel) performing AD conversion of a pixel signal (e.g., a photoelectric conversion signal) and reading out the pixel signal converted into a digital signal (e.g., a digital signal based on a dark signal). The control unit 4 of the camera 1 controls the readout control unit 60 to switch the pixel signal readout method.
[0048] (Individual read processing)
[0049] In the individual readout process, the readout control unit 60 turns on the switches SW1 of the plurality of AD converters 40 of the image sensor 3, and causes each AD converter 40 to perform AD conversion. The readout control unit 60 sequentially selects the plurality of AD converters 40 in units of one row, and sequentially outputs the pixel signals converted into digital signals from the selected AD converters 40 to the data lines 50.
[0050] (First Reading Method of Addition Reading Process)
[0051] In the first read mode, the read control section 60 turns on the switches SW1 of the plurality of first AD converters 40, and performs AD conversion in each of the plurality of first AD converters 40. The read control section 60 sequentially selects the plurality of first AD converters 40 in units of one row, and outputs the pixel signals converted into digital signals from the selected first AD converters 40 to the data lines 50. In this way, in the case of the first read mode, the read control section 60 uses only the first AD converters 40 among all the AD converters 40. The other AD converters 40 (hereinafter referred to as second AD converters) different from the first AD converters 40 and the data lines 50 connected to the second AD converters 40 are not used in the first read mode and are in a dormant state.
[0052] (Second Reading Method of Addition Reading Process)
[0053] In the second read mode, the read control unit 60 controls the switch SW1 and the switch SW2, thereby using the storage unit 25 and the selection unit 30 of the second AD conversion unit 40 and the data line 50 connected to the second AD conversion unit 40 in addition to the first AD conversion unit 40. In the second read mode, by using the data lines 50 provided for different columns, the signals of the pixels converted into digital signals can be read out simultaneously from the AD conversion units 40 of multiple rows. When the image sensor 3 selects the first AD conversion unit 40 in units of one row and sequentially reads the signals of the pixels to the data lines 50, the signals of the pixels can also be read out in a short time.
[0054] (Third Reading Method of Addition Reading Process)
[0055] In the case of the third read mode, the read control section 60 uses the storage section 25 and the selection section 30 of the second AD conversion section 40, and the data line 50 connected to the second AD conversion section 40 in addition to the first AD conversion section 40. The read control section 60 controls the switch SW1 and the switch SW2 to control whether the output signal of the comparison section 20 of the first AD conversion section 40 is output to the storage section 25 of the first AD conversion section 40 or the storage section 25 of the second AD conversion section 40. It can be said that the read control section 60 switches the storage section 25 to which the comparison result based on the comparison section 20 of the first AD conversion section 40 is output.
[0056] In the third read mode, the read control section 60 switches the connection destination of the comparison section 20 of the first AD converter 40 to the storage section 25 of the first AD converter 40 or the storage section 25 of the second AD converter 40 when a dark signal is input to the comparison section 20 of the first AD converter 40 and when a photoelectric conversion signal is input to the comparison section 20 of the first AD converter 40. For example, when a dark signal is input to the comparison section 20 of the first AD converter 40, the read control section 60 connects the comparison section 20 of the first AD converter 40 to the storage section 25 of the first AD converter 40. The comparison section 20 of the first AD converter 40 outputs an output signal indicating a comparison result between the dark signal and the reference signal to the storage section 25 of the first AD converter 40 via the switch SW1. The storage section 25 of the first AD converter 40 stores a digital signal based on the dark signal based on the output signal of the comparison section 20.
[0057] After the AD conversion of the dark signal is completed, the readout control section 60 starts to read out the digital signal based on the dark signal from the storage section 25 of the first AD converter 40 to the data line 50. In addition, the readout control section 60 connects the comparison section 20 of the first AD converter 40 and the storage section 25 of the second AD converter 40. At this time, if the photoelectric conversion signal is input to the comparison section 20 of the first AD converter 40, the comparison section 20 of the first AD converter 40 outputs an output signal indicating the comparison result of the photoelectric conversion signal and the reference signal to the storage section 25 of the second AD converter 40 via the switch SW2. The storage section 25 of the second AD converter 40 stores the digital signal based on the photoelectric conversion signal based on the output signal of the comparison section 20 of the first AD converter 40.
[0058] As described above, in the third readout method, different storage units 25 are used to perform AD conversion when performing AD conversion of dark signals and when performing AD conversion of photoelectric conversion signals. As a result, the readout of digital signals based on dark signals and the AD conversion of photoelectric conversion signals can be performed in parallel. In addition, similarly, the readout of digital signals based on photoelectric conversion signals and the AD conversion of dark signals can be performed in parallel. Therefore, the imaging element 3 does not need to wait for the completion of the readout process of the data line 50 of the pixel signal before starting the next AD conversion process, and can read the pixel signal in a short time. Referring to FIG. Figures 4 to 10 , further describing the first to third reading methods of the individual reading process and the addition reading process.
[0059] (Individual read processing)
[0060] When the control unit 4 instructs the individual readout process, the readout control unit 60 performs the following operations: Figure 4 As shown, each switch SW1 of the AD converter 40 ( 1 , 1 ) to the AD converter 40 ( 4 , 4 ) is turned on, and the switches SW2 a to SW2 h are turned off.
[0061] The readout control unit 60 sets the reset unit 13 of the pixel 10 (1, 1) to the pixel 10 (4, 4) to the conductive state. As a result, the voltage of the respective FD 14 is reset in each pixel 10. The respective dark signals of the pixel 10 (1, 1) to the pixel 10 (4, 4) are output to the AD conversion unit 40 (1, 1) to the AD conversion unit 40 (4, 4) via the signal line 18 connected to each pixel 10. The AD conversion unit 40 (1, 1) to the AD conversion unit 40 (4, 4) convert the input dark signals into digital signals. The digital signals based on the dark signals of the pixel 10 (1, 1) to the pixel 10 (4, 4) are stored in the respective storage units 25 of the AD conversion unit 40 (1, 1) to the AD conversion unit 40 (4, 4).
[0062] The readout control unit 60 turns on the selectors 30 of the AD converters 40 (1, 1) to 40 (1, 4) of the AD converters 40 of the first row, and turns off the selectors 30 of the AD converters 40 of the rows other than the first row. Thus, digital signals based on the dark signals of the AD converters 40 (1, 1) to 40 (1, 4) are output to the data lines 50a to 50d via the selectors 30 of the AD converters 40.
[0063] After reading out the digital signals based on the dark signals from the AD converters 40 of the first row, the readout control unit 60 sets the selectors 30 of the AD converters 40 (2, 1) to 40 (2, 4) of the AD converters 40 of the second row to the on state, and sets the selectors 30 of the AD converters 40 of the rows other than the second row to the off state. Thus, the digital signals based on the dark signals of the AD converters 40 (2, 1) to 40 (2, 4) are output to the data lines 50a to 50d via the selectors 30 of the AD converters 40. Similarly, the readout control unit 60 selects the AD converters 40 of the third row and after one row at a time in the order of the third row, the fourth row, and the fifth row, and reads out the digital signals based on the dark signals from the selected AD converters 40.
[0064] The readout control unit 60 sets the transfer units 12 of the pixels 10 (1, 1) to 10 (4, 4) to the on state. As a result, in each pixel 10, the charge obtained by photoelectric conversion by each PD 11 is transferred to the FD 14. The photoelectric conversion signals of the pixels 10 (1, 1) to 10 (4, 4) are output to the AD conversion units 40 (1, 1) to 40 (4, 4) via the signal lines 18 connected to the pixels 10. The AD conversion units 40 (1, 1) to 40 (4, 4) convert the input photoelectric conversion signals into digital signals. The digital signals based on the photoelectric conversion signals of the pixels 10 (1, 1) to 10 (4, 4) are stored in the storage units 25 of the AD conversion units 40 (1, 1) to 40 (4, 4).
[0065] The readout control unit 60 selects rows one by one in the order of the 1st row, the 2nd row, the 3rd row, the 4th row, and the 5th row in the same manner as the case where the digital signal based on the dark signal is read out from each AD conversion unit 40, and reads out the digital signal based on the photoelectric conversion signal from each selected AD conversion unit 40.
[0066] Thus, in the individual readout process, the readout control unit 60 individually reads out the signals of the pixels of the image pickup element 3. The digital signals based on the dark signals and the digital signals based on the photoelectric conversion signals sequentially output to the data lines 50a to 50d are processed by the signal processing unit 70 (see Figure 3 ) After signal processing such as correlated double sampling is implemented, it is output to the control unit 4 via the input and output unit 80.
[0067] (First to Third Reading Methods of Addition Reading Process)
[0068] In the first to third readout methods of the addition readout processing, the readout control unit 60 adds the signals of the plurality of pixels for each plurality of pixels. In addition, an example of adding the signals of the four pixels for each four pixels of 2 pixels × 2 pixels is described below. The signal obtained by adding the signal of the pixel 10 (1, 1), the signal of the pixel 10 (1, 2), the signal of the pixel 10 (2, 1), and the signal of the pixel 10 (2, 2) is input to the AD conversion unit 40 (1, 1). The signal obtained by adding the signals of the pixel 10 (1, 3), the pixel 10 (1, 4), the pixel 10 (2, 3), and the pixel 10 (2, 4) is input to the AD conversion unit 40 (1, 3). In addition, a signal obtained by adding the signals of pixel 10 (3, 1), pixel 10 (3, 2), pixel 10 (4, 1), and pixel 10 (4, 2) is input to AD conversion unit 40 (3, 1), and a signal obtained by adding the signals of pixel 10 (3, 3), pixel 10 (3, 4), pixel 10 (4, 3), and pixel 10 (4, 4) is input to AD conversion unit 40 (3, 3).
[0069] The AD converter 40 (1, 1), the AD converter 40 (1, 3), the AD converter 40 (3, 1), and the AD converter 40 (3, 3) function as the first AD converter. Figure 6 In FIG. 4 , the AD conversion units 40 enclosed in bold are examples of AD conversion units used in the case of the first readout method. Figure 7 The AD conversion unit 40 outlined in bold is an example of an AD conversion unit used in the second readout mode. Figure 8 as well as Fig. 9 The AD converter 40 outlined in bold is an example of an AD converter used in the third readout method.
[0070] (First Reading Method of Addition Reading Process)
[0071] When the control unit 4 instructs the readout control unit 60 to use the first readout mode, Figure 6As shown, the switches SW1 of the AD converter 40 (1, 1), the AD converter 40 (1, 3), the AD converter 40 (3, 1), and the AD converter 40 (3, 3) are turned on, and the switches SW2a to SW2h are turned off. When the AD converter 40 (1, 1), the AD converter 40 (1, 3), the AD converter 40 (3, 1), and the AD converter 40 (3, 3) receive the added dark signal, they convert the dark signal into a digital signal. The digital signals based on the added dark signal are stored in the storage units 25 of the AD converter 40 (1, 1), the AD converter 40 (1, 3), the AD converter 40 (3, 1), and the AD converter 40 (3, 3).
[0072] The readout control unit 60 turns on the selectors 30 of the AD converters 40 (1, 1) and 40 (1, 3) of the first row, and turns off the selectors 30 of the other AD converters 40 different from the AD converters 40 (1, 1) and 40 (1, 3). As a result, a digital signal based on the added dark signal of the AD converter 40 (1, 1) is output to the data line 50a via the selector 30 of the AD converter 40 (1, 1). In addition, a digital signal based on the added dark signal of the AD converter 40 (1, 3) is output to the data line 50c via the selector 30 of the AD converter 40 (1, 3).
[0073] After reading out the digital signal based on the dark signal from the AD converter 40 (1, 1) and the AD converter 40 (1, 3) of the first row, the readout control unit 60 turns on the AD converter 40 (3, 1) and the selector 30 of the AD converter 40 (3, 3) of the third row. In addition, the readout control unit 60 turns off the selectors 30 of the other AD converters 40 different from the AD converter 40 (3, 1) and the AD converter 40 (3, 3). As a result, the digital signal based on the dark signal after the addition of the AD converter 40 (3, 1) is output to the data line 50a via the selector 30 of the AD converter 40 (3, 1). In addition, the digital signal based on the dark signal after the addition of the AD converter 40 (3, 3) is output to the data line 50c via the selector 30 of the AD converter 40 (3, 3). Similarly, thereafter, the readout control unit 60 sequentially selects the AD converters 40 for every other row, and reads out digital signals based on the dark signal from the selected AD converters 40 .
[0074] When the AD converter 40 (1, 1), the AD converter 40 (1, 3), the AD converter 40 (3, 1), and the AD converter 40 (3, 3) receive the added photoelectric conversion signal, they convert the photoelectric conversion signal into a digital signal. In each storage unit 25 of the AD converter 40 (1, 1), the AD converter 40 (1, 3), the AD converter 40 (3, 1), and the AD converter 40 (3, 3), a digital signal based on the added photoelectric conversion signal is stored. The readout control unit 60 selects the AD converter 40 in turn for every other row, and reads out a digital signal based on the photoelectric conversion signal from each selected AD converter 40, similarly to the case of reading out a digital signal based on a dark signal from each AD converter 40.
[0075] As described above, in the first readout mode, the readout control unit 60 sequentially selects a portion of the AD converters 40 of all the AD converters 40 of the image sensor 3 row by row, and reads out the signals of the pixels converted into digital signals. The digital signals based on the dark signals and the digital signals based on the photoelectric conversion signals sequentially output to the data lines 50a and 50c are subjected to signal processing by the signal processing unit 70, and then output to the control unit 4 through the input / output unit 80.
[0076] (Second Reading Method of Addition Reading Process)
[0077] When the control unit 4 indicates the second reading mode, the reading control unit 60 Figure 7 As shown, the switches SW1 of the AD converter 40 (1, 1) and the AD converter 40 (1, 3) are turned on. In addition, the readout control unit 60 turns on the switches SW2e and SW2f. By turning on the switch SW2e, the comparison unit 20 of the AD converter 40 (3, 1) and the storage unit 25 of the AD converter 40 (3, 2) are electrically connected. In addition, by turning on the switch SW2f, the comparison unit 20 of the AD converter 40 (3, 3) and the storage unit 25 of the AD converter 40 (3, 4) are electrically connected. The AD converter 40 (3, 2) and the AD converter 40 (3, 4) function as the second AD converter.
[0078] When the AD converter 40 (1, 1) and the AD converter 40 (1, 3) receive the added dark signal, they convert the dark signal into a digital signal. The storage units 25 of the AD converter 40 (1, 1) and the AD converter 40 (1, 3) store digital signals based on the added dark signal.
[0079] When the added dark signal is input to the comparison unit 20 of the AD converter 40 (3, 1), the output signal indicating the comparison result between the dark signal and the reference signal is output to the storage unit 25 of the AD converter 40 (3, 2) via the switch SW2e. The storage unit 25 of the AD converter 40 (3, 2) stores a digital signal based on the added dark signal based on the output signal of the comparison unit 20 of the AD converter 40 (3, 1). In this way, the added dark signal input to the comparison unit 20 of the AD converter 40 (3, 1) is converted into a digital signal by the comparison unit 20 of the AD converter 40 (3, 1) and the storage unit 25 of the AD converter 40 (3, 2).
[0080] When the added dark signal is input to the comparison unit 20 of the AD converter 40 (3, 3), the output signal indicating the comparison result between the dark signal and the reference signal is output to the storage unit 25 of the AD converter 40 (3, 4) via the switch SW2f. The storage unit 25 of the AD converter 40 (3, 4) stores a digital signal based on the added dark signal based on the output signal of the comparison unit 20 of the AD converter 40 (3, 3). In this way, the added dark signal input to the comparison unit 20 of the AD converter 40 (3, 3) is converted into a digital signal by the comparison unit 20 of the AD converter 40 (3, 3) and the storage unit 25 of the AD converter 40 (3, 4).
[0081] The readout control section 60 turns on the selectors 30 of the AD converters 40 (1, 1) and 40 (1, 3) in the first row and the selectors 30 of the AD converters 40 (3, 2) and 40 (3, 4) in the third row. The readout control section 60 turns off the selectors 30 of the AD converters 40 (1, 1), 40 (1, 3), 40 (3, 2), and 40 (3, 4).
[0082] The added dark signal input to the comparison unit 20 of the AD conversion unit 40 (1, 1) is converted into a digital signal by the AD conversion unit 40 (1, 1) as schematically indicated by an arrow 90a, and then output to the data line 50a via the selection unit 30 of the AD conversion unit 40 (1, 1). In addition, the added dark signal input to the comparison unit 20 of the AD conversion unit 40 (3, 1) is converted into a digital signal by the comparison unit 20 of the AD conversion unit 40 (3, 1) and the storage unit 25 of the AD conversion unit 40 (3, 2) as schematically indicated by an arrow 90b, and then output to the data line 50b via the selection unit 30 of the AD conversion unit 40 (3, 2).
[0083] The added dark signal input to the comparison unit 20 of the AD conversion unit 40 (1, 3) is converted into a digital signal by the AD conversion unit 40 (1, 3) as schematically indicated by an arrow 90c, and then output to the data line 50c via the selection unit 30 of the AD conversion unit 40 (1, 3). In addition, the added dark signal input to the comparison unit 20 of the AD conversion unit 40 (3, 3) is converted into a digital signal by the comparison unit 20 of the AD conversion unit 40 (3, 3) and the storage unit 25 of the AD conversion unit 40 (3, 4) as schematically indicated by an arrow 90d, and then output to the data line 50d via the selection unit 30 of the AD conversion unit 40 (3, 4). Similarly, the readout control unit 60 selects the AD conversion units 40 in order of two rows, and reads out digital signals based on the dark signals from each selected AD conversion unit 40.
[0084] When the AD converter 40 (1, 1) and the AD converter 40 (1, 3) are input with the added photoelectric conversion signal, the photoelectric conversion signal is converted into a digital signal. The digital signals based on the added photoelectric conversion signal are stored in the respective storage units 25 of the AD converter 40 (1, 1) and the AD converter 40 (1, 3). The added photoelectric conversion signal input to the comparison unit 20 of the AD converter 40 (3, 1) is converted into a digital signal by the comparison unit 20 of the AD converter 40 (3, 1) and the storage unit 25 of the AD converter 40 (3, 2), and is stored in the storage unit 25 of the AD converter 40 (3, 2). In addition, the added photoelectric conversion signal input to the comparison unit 20 of the AD converter 40 (3, 3) is converted into a digital signal by the comparison unit 20 of the AD converter 40 (3, 3) and the storage unit 25 of the AD converter 40 (3, 4), and is stored in the storage unit 25 of the AD converter 40 (3, 4).
[0085] The readout control unit 60 sequentially selects the AD converters 40 two by two rows in the same manner as in the case of reading out digital signals based on dark signals from each AD converter 40 , and reads out digital signals based on photoelectric conversion signals from each selected AD converter 40 .
[0086] As described above, in the second readout mode, the readout control unit 60 controls the switch SW1 and the switch SW2 to use the AD converter 40 and the data lines 50b and 50d connected to the AD converter 40, which are in the idle state in the first readout mode. Therefore, the readout control unit 60 can select the AD converter 40 in sequence two by two rows and read the pixel signals converted into digital signals. As a result, the pixel signals can be read out in a shorter time than when the AD converter 40 is selected in sequence one by one row and the pixel signals are read out. The digital signals based on the dark signal and the digital signals based on the photoelectric conversion signal sequentially output to the data lines 50a to 50d are output to the control unit 4 by the input / output unit 80 after the signal processing is performed by the signal processing unit 70.
[0087] (Third Reading Method of Addition Reading Process)
[0088] Figure 8 as well as Fig. 9 2 is a diagram for explaining the readout processing of the imaging element when the third readout method is instructed by the control unit 4. Figure 8 , the connection state of the switch SW1 and the switch SW2 is shown when the dark signal added by the comparison unit 20 of the AD conversion unit 40 is input. Fig. 9 , the connection state of the switch SW1 and the switch SW2 is shown when the photoelectric conversion signal added by the comparison unit 20 of the AD conversion unit 40 is input. Figure 8 as well as Fig. 9 In the illustrated example, the AD converter 40 ( 1 , 2 ), the AD converter 40 ( 1 , 4 ), the AD converter 40 ( 3 , 2 ), and the AD converter 40 ( 3 , 4 ) function as the second AD converter.
[0089] When the dark signal added by the comparison unit 20 of the AD conversion unit 40 is input, the readout control unit 60 Figure 8 As shown, the switches SW1 of the AD converter 40 (1, 1), the AD converter 40 (1, 3), the AD converter 40 (3, 1), and the AD converter 40 (3, 3) are turned on. The readout control unit 60 turns the switches SW2a to SW2h off.
[0090] The readout control unit 60 causes each of the AD converter 40 (1, 1), the AD converter 40 (1, 3), the AD converter 40 (3, 1), and the AD converter 40 (3, 3) to perform AD conversion on the added dark signal. For example, the added dark signal input to the comparison unit 20 of the AD converter 40 (1, 1) is converted into a digital signal by the AD converter 40 (1, 1) as schematically indicated by an arrow 91a, and stored in the storage unit 25 of the AD converter 40 (1, 1). In addition, the added dark signal input to the comparison unit 20 of the AD converter 40 (1, 3) is converted into a digital signal by the AD converter 40 (1, 3) as schematically indicated by an arrow 91c, and stored in the storage unit 25 of the AD converter 40 (1, 3).
[0091] Simultaneously with the AD conversion of the dark signal, the readout control unit 60 reads out the digital signal based on the photoelectric conversion signal stored when the photoelectric conversion signal was last AD-converted from the AD conversion unit 40 (1, 2), the AD conversion unit 40 (1, 4), the AD conversion unit 40 (3, 2), and each storage unit 25 of the AD conversion unit 40 (3, 4). For example, as schematically shown by arrow 92b, the digital signal based on the photoelectric conversion signal after addition is output from the storage unit 25 of the AD conversion unit 40 (1, 2) to the data line 50b. In addition, as schematically shown by arrow 92d, the digital signal based on the photoelectric conversion signal after addition is output from the storage unit 25 of the AD conversion unit 40 (1, 4) to the data line 50d. It is assumed that the readout control unit 60 selects the AD conversion unit 40 in turn for every other row, and reads out the digital signal based on the photoelectric conversion signal from each selected AD conversion unit 40.
[0092] When the added photoelectric conversion signal is input to the comparison unit 20 of the AD conversion unit 40, the readout control unit 60 Fig. 9 As shown, the switches SW1 of the AD converter 40 (1, 1), the AD converter 40 (1, 3), the AD converter 40 (3, 1), and the AD converter 40 (3, 3) are turned off. In addition, the readout control unit 60 turns on the switches SW2a, SW2b, SW2e, and SW2f.
[0093] The readout control unit 60 causes the comparison unit 20 of the AD converter 40 (1, 1) and the storage unit 25 of the AD converter 40 (1, 2), the comparison unit 20 of the AD converter 40 (1, 3) and the storage unit 25 of the AD converter 40 (1, 4), the comparison unit 20 of the AD converter 40 (3, 1) and the storage unit 25 of the AD converter 40 (3, 2), and the comparison unit 20 of the AD converter 40 (3, 3) and the storage unit 25 of the AD converter 40 (3, 4) to perform AD conversion on the added photoelectric conversion signal. For example, the added photoelectric conversion signal input to the comparison unit 20 of the AD converter 40 (1, 1) is converted into a digital signal by the comparison unit 20 of the AD converter 40 (1, 1) and the storage unit 25 of the AD converter 40 (1, 2), as schematically shown by arrow 91b, and is stored in the storage unit 25 of the AD converter 40 (1, 2). In addition, the added photoelectric conversion signal input to the comparison unit 20 of the AD conversion unit 40 (1, 3) is converted into a digital signal by the comparison unit 20 of the AD conversion unit 40 (1, 3) and the storage unit 25 of the AD conversion unit 40 (1, 4), as schematically shown by arrow 91d, and is stored in the storage unit 25 of the AD conversion unit 40 (1, 4).
[0094] Simultaneously with the AD conversion of the photoelectric conversion signal, the readout control unit 60 reads out the digital signal based on the dark signal stored when the dark signal was last AD-converted from the AD conversion unit 40 (1, 1), the AD conversion unit 40 (1, 3), the AD conversion unit 40 (3, 1), and each storage unit 25 of the AD conversion unit 40 (3, 3). For example, as schematically shown by arrow 92a, the digital signal based on the added dark signal is output from the storage unit 25 of the AD conversion unit 40 (1, 1) to the data line 50a. In addition, as schematically shown by arrow 92c, the digital signal based on the added dark signal is output from the storage unit 25 of the AD conversion unit 40 (1, 3) to the data line 50c. Thereafter, similarly, the readout control unit 60 sequentially selects the AD conversion unit 40 for every other row, and reads out the digital signal based on the photoelectric conversion signal from each selected AD conversion unit 40.
[0095] As described above, in the third readout mode, the readout control unit 60 controls the switch SW1 and the switch SW2, thereby performing AD conversion using different storage units 25 when performing AD conversion of dark signals and when performing AD conversion of photoelectric conversion signals. As a result, the image sensor 3 can perform AD conversion of pixel signals and read out the pixel signals converted into digital signals to the data line 50 in parallel. Therefore, the pixel signals can be read out in a short time.
[0096] (Comparison of the First to Third Reading Methods of Addition Reading Processing)
[0097] Fig.10 It is a diagram comparing the first to third readout modes of the addition readout process of the image sensor according to the first embodiment. Fig.10 (a) shows the processing of the case of the first reading mode, Fig.10 (b) shows the processing of the second reading mode. Fig.10 (c) shows the processing of the third reading method. Fig.10 (a)~ Fig.10 In (c), on the same time axis, the readout processing of the dark signal from the pixel 10, the AD conversion processing of the dark signal, the readout processing of the digital signal based on the dark signal, the readout processing of the photoelectric conversion signal from the pixel 10, the AD conversion processing of the photoelectric conversion signal, and the readout processing of the digital signal based on the photoelectric conversion signal are shown side by side.
[0098] exist Fig.10 In the case of the second readout method (b), the readout control unit 60 selects the AD conversion unit 40 in sequence two rows by two rows as described above, and reads out the digital signal based on the dark signal and the digital signal based on the photoelectric conversion signal. Fig.10 Compared with the first readout method (a), a digital signal based on a dark signal can be read out from each AD conversion unit 40 in about 1 / 2 of the time, and a digital signal based on a photoelectric conversion signal can be read out from each AD conversion unit 40 in about 1 / 2 of the time. Thus, the image sensor 3 can increase the frame rate during shooting.
[0099] exist Fig.10 In the case of the third readout method (c), the readout control unit 60 performs AD conversion of the dark signal (or photoelectric conversion signal) read out from the pixel and reads out the photoelectric conversion signal (or dark signal) converted into a digital signal in parallel as described above. Fig.10 Compared with the second readout method (b), the frame rate during photography can be further improved.
[0100] In addition, it is also conceivable to provide a storage unit for AD conversion and a storage unit for signal reading to the data line 50 for each pixel 10, but in this case, the area of the imaging element will increase. In this embodiment, it is not necessary to provide a storage unit for AD conversion and a storage unit for signal reading to the data line 50 separately, which can prevent the area of the imaging element from increasing.
[0101] According to the above-described embodiment, the following effects can be obtained.
[0102] (1) The imaging element 3 includes: a first photoelectric conversion section 11 and a second photoelectric conversion section 11 for generating charges by photoelectric conversion; a first comparing section 20 for outputting a first signal based on a first comparison result, the first comparison result being a result of comparing a signal based on the charges generated by the first photoelectric conversion section 11 with a reference signal; a first storage section 25 to which the first signal is outputted from the first comparing section 20 and to which a signal based on the first signal is stored; a second comparing section 20 for outputting a second signal based on a second comparison result, the second comparison result being a result of comparing a signal based on the charges generated by the second photoelectric conversion section 11 with the reference signal; a second storage section 25 to which the second comparing section 20 is outputted from and to which a signal based on the second signal is stored; a first connecting section (switch SW2) capable of connecting or disconnecting the first comparing section 20 and the second storage section 25; and a control section (readout control section) for controlling the first connecting section and controlling whether the first signal is outputted to the first storage section or to the second storage section. With such a setting, the readout control unit 60 of the present embodiment controls the switch SW2 to perform a pixel signal readout process, thereby being able to shorten the pixel signal readout time.
[0103] (2) In this embodiment, the imaging element controls the switch SW1 and the switch SW2 to perform the second readout mode and the third readout mode. This allows the pixel signal to be read out at high speed. In addition, the frame rate during imaging can be increased.
[0104] The following modifications also fall within the scope of the present invention, and one or more of the modifications may be combined with the above-described embodiment.
[0105] (Variant 1)
[0106] In the above embodiment, an example is described in which the readout control unit 60 adds the signals of a plurality of pixels to perform the addition readout process. The readout control unit 60 may also perform a process of thinning out the pixels of a specific row or column among all the pixels and reading out the signals (thinning readout process). In the case of the thinning readout process, the readout control unit 60 may also perform the same readout method as the first to third readout methods described above.
[0107] (Variant 2)
[0108] In the above embodiment, an example has been described in which the image sensor 3 is configured by laminating the first substrate 111 and the second substrate 112. However, the first substrate 111 and the second substrate 112 may not be laminated.
[0109] (Variant 3)
[0110] In the above embodiment, an example is described in which the data line 50 is formed by a plurality of signal lines corresponding to the number of bits of the digital signal output from the AD converter 40. The data line 50 may be one signal line or may be any number of signal lines.
[0111] (Variant 4)
[0112] In the above-mentioned embodiment and modification, an example in which a photodiode is used as a photoelectric conversion unit is described. However, a photoelectric conversion film (organic photoelectric film) may be used as a photoelectric conversion unit.
[0113] (Variant 5)
[0114] The imaging elements and imaging devices described in the above-mentioned embodiments and variations can be applied to cameras, cameras built into smartphones, tablet computers, PCs, vehicle-mounted cameras, cameras mounted on unmanned aircraft (drones, radio-controlled aircraft, etc.), etc.
[0115] Various embodiments and modifications have been described above, but the present invention is not limited to these contents. Other aspects that can be considered within the scope of the technical concept of the present invention are also included in the scope of the present invention.
[0116] The disclosures of the following priority basic applications are incorporated herein by reference.
[0117] Japan Special Application No. 2019-69145 (applied on March 29, 2019)
[0118] Description of Reference Numerals
[0119] 1 imaging device, 3 imaging element, 4 control unit, 10 pixel, 11 photoelectric conversion unit, 20 comparison unit, 25 storage unit, 40 AD conversion unit, 60 readout control unit.
Claims
1. An imaging element, characterized in that: have: a first photoelectric conversion unit that converts light into electric charges; a second photoelectric conversion unit that converts light into electric charges; a first comparing section that outputs a first signal based on a first comparison result obtained by comparing a signal based on the charge converted by the first photoelectric conversion section with a reference signal; a first storage unit that receives the first signal output from the first comparison unit and stores a signal based on the first signal; a second comparing section that outputs a second signal based on a second comparison result obtained by comparing a signal based on the charge converted by the second photoelectric conversion section with the reference signal; a second storage unit which receives the second signal output from the second comparing unit and stores a signal based on the second signal; as well as a first connecting portion capable of electrically connecting or disconnecting the first comparing portion and the second storing portion, The second storage unit stores a signal based on the first signal when being electrically connected to the first comparison unit via the first connection unit.
2. The imaging element according to claim 1, wherein: A control unit is provided that controls the first connection unit to control whether the first signal is output to the first storage unit or to the second storage unit.
3. The imaging element according to claim 2, wherein: The control unit connects the first comparison unit and the second storage unit via the first connection unit, and outputs the first signal to the second storage unit.
4. The imaging element according to claim 2 or 3, characterized in that: have: a second connection unit capable of connecting or disconnecting the first comparison unit and the first storage unit; as well as a third connection unit capable of connecting or disconnecting the second comparison unit and the second storage unit, The control unit controls the second connection unit and the third connection unit.
5. The imaging element according to claim 4, wherein: While the first comparing unit and the second storage unit are connected by the first connecting unit, the controlling unit disconnects the first comparing unit and the first storage unit by the second connecting unit, and disconnects the second comparing unit and the second storage unit by the third connecting unit.
6. The imaging element according to claim 4, wherein: The control unit connects the first comparing unit to the first storage unit using the second connecting unit and connects the second comparing unit to the second storage unit using the third connecting unit while the first connecting unit disconnects the first comparing unit from the second storage unit.
7. The imaging element according to claim 2, wherein: have: a first signal line to which the signal stored in the first storage unit is output; and a second signal line to which the signal stored in the second storage unit is output, When the first comparing section and the second storage section are connected to each other via the first connecting section, the signal based on the first signal stored in the second storage section is output to the second signal line.
8. The imaging element according to claim 7, wherein: The control unit connects the first comparison unit and the second storage unit using the first connection unit when outputting the signal based on the first signal using the second signal line.
9. The imaging element according to claim 7 or 8, wherein: When the first comparing unit and the second storage unit are disconnected by the first connecting unit, the signal based on the first signal stored in the first storage unit is output to the first signal line, and the signal based on the second signal stored in the second storage unit is output to the second signal line.
10. The imaging element according to claim 7 or 8, characterized in that: When the control unit outputs a signal based on the first signal using the first signal line and outputs a signal based on the second signal using the second signal line, the control unit disconnects the first comparing unit and the second storing unit using the first connecting unit.
11. The imaging element according to claim 7 or 8, wherein: have: a third photoelectric conversion unit that generates charges by photoelectric conversion; a third comparing section that outputs a third signal based on a third comparison result obtained by comparing a signal based on the charge generated by the third photoelectric conversion section with a reference signal; as well as a third storage unit which receives the third signal output from the third comparison unit and stores a signal based on the third signal, When the control unit outputs a signal based on the third signal using the first signal line, the control unit connects the first comparison unit and the second storage unit using the first connection unit, and outputs a signal based on the first signal using the second signal line.
12. The imaging element according to claim 11, wherein: When the control unit outputs the signal based on the third signal stored in the third storage unit to the first signal line, the control unit connects the first comparison unit and the second storage unit using the first connection unit, and outputs the signal based on the first signal stored in the second storage unit to the second signal line.
13. The imaging element according to claim 2, wherein: have: a storage unit that stores the charge generated by the first photoelectric conversion unit; and a reset section for resetting the charge accumulated in the accumulation section, The first comparison unit outputs a fourth signal based on a fourth comparison result, wherein the fourth comparison result is a result of comparing a signal obtained by resetting the charge accumulated in the accumulation unit with the reference signal. The control unit controls the first connection unit to control whether the fourth signal is output to the first storage unit or to the second storage unit.
14. The imaging element according to claim 13, wherein: When the control unit outputs the first signal to the first storage unit, the control unit connects the first comparison unit and the second storage unit using the first connection unit, and outputs the fourth signal to the second storage unit.
15. The imaging element according to claim 14, wherein: When the fourth signal is output to the second storage unit, the second storage unit stores a signal based on the fourth signal.
16. The imaging element according to any one of claims 13 to 15, wherein: When the control unit outputs the fourth signal to the first storage unit, the control unit connects the first comparison unit and the second storage unit using the first connection unit, and outputs the first signal to the second storage unit.
17. The imaging element according to claim 16, wherein: When the fourth signal is output to the first storage unit, the first storage unit stores a signal based on the fourth signal.
18. The imaging device according to any one of claims 1 to 3, 5 to 8, 12 to 15, and 17, characterized in that: have: A first substrate having the first photoelectric conversion unit and the second photoelectric conversion unit; and The second substrate is stacked on the first substrate and is provided with the first storage unit and the second storage unit.
19. A camera device, characterized in that: have: The imaging element according to any one of claims 1 to 18; and A generating unit generates image data based on a signal output from the imaging element.
Citation Information
Patent Citations
Medical image processing apparatus and medical image processing system
JP2019069145A
Solid-state imaging device, control method therefor, and electronic apparatus
WO2017018215A1
Solid state imaging device, method of controlling solid state imaging device, and program for controlling solid state imaging device
US20130075588A1