Imaging element and imaging apparatus

Abstract

To desire a high speed of an operation in an imaging element.SOLUTION: An imaging element includes a pixel part 30A in which a plurality of pixels having a first photoelectric conversion part D1 that converts a light into an electric charge and a second photoelectric conversion part D2 that converts the light into the electric charge, and executes a first mode that reads a signal based on the electric charge converted in the second photoelectric conversion part D2 of a first pixel and a signal based on the electric charge converted in the second photoelectric conversion part D2 of a second pixel sequentially when an accumulation of the electric charging converted by the first photoelectric conversion part D1 of the first pixel of the plurality of pixels and an accumulation of the electric charging converted by the first photoelectric conversion part D1 of the second pixel of the plurality of pixels are performed.SELECTED DRAWING: Figure 3

Description

[Technical field]

[0001] The present disclosure relates to an imaging element and an imaging device. [Background technology]

[0002] 2. Description of the Related Art Image capture devices having a live view display function are known (for example, see Patent Document 1). Conventionally, there has been a problem in that periods during which live view display is not performed, that is, blackout periods, occur. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2013-50630 A Summary of the Invention

[0004] The imaging element includes a pixel section in which a plurality of pixels, each having a first photoelectric conversion section that converts light into an electric charge and a second photoelectric conversion section that converts light into an electric charge, are arranged in a column direction, and a control section that executes a first mode in which, when accumulation of electric charge converted by the first photoelectric conversion section of a first pixel among the plurality of pixels and accumulation of electric charge converted by the first photoelectric conversion section of a second pixel among the plurality of pixels are being performed, a signal based on the electric charge converted by the second photoelectric conversion section of the first pixel and a signal based on the electric charge converted by the second photoelectric conversion section of the second pixel are being performed. [Brief description of the drawings]

[0005] [Figure 1] 1 is a block diagram showing a configuration of an imaging apparatus according to an embodiment. [Diagram 2] 1 is a block diagram showing a configuration of an imaging element according to an embodiment; [Diagram 3] FIG. 2 is an electrical circuit diagram showing a pixel according to the embodiment. [Figure 4] FIG. 2 is a circuit layout diagram showing a pixel according to the embodiment. [Diagram 5]11 is a chart showing a signal read operation according to the embodiment. [Figure 6] 4 is a sequence chart showing an operation of the imaging element according to the embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0006] [Imaging device 10] As shown in FIG. 1, the imaging device 10 includes a lens unit 11, a lens driving unit 12, an imaging element 20, an image processing unit 13, a display unit 14, a recording unit 15, a control unit 70, and an operation unit 16.

[0007] The lens unit 11 includes an optical system including one optical lens or a plurality of optical lenses. The lens driving unit 12 drives the lens unit 11 so as to form an image of the subject light flux in the vicinity of the focal plane of the image sensor 20.

[0008] The imaging element 20 captures an image of a subject. The image data of the subject captured by the imaging element 20 is output to the image processing unit 13. The image processing unit 13 performs various image processing on the image data output from the imaging element 20. The display unit 14 displays an image of the image data subjected to image processing by the image processing unit 13. The recording unit 15 records the image data subjected to image processing by the image processing unit 13. The control unit 70 controls the lens driving unit 12, the imaging element 20, the image processing unit 13, the display unit 14, the recording unit 15, etc. The operation unit 16 outputs an instruction signal based on an operation received from a user to the control unit 70.

[0009] The operation unit 16 includes a live view button and a high dynamic range button. When the live view button is pressed, the control unit 70 causes the imaging element 20 to perform a rolling shutter operation, and through image processing by the image processing unit 13, causes the display unit 14 to display a live view image, which is a real-time image.

[0010] When the high dynamic range button is pressed, the control unit 70 causes the imaging element 20 to perform a global shutter operation, and through image processing by the image processing unit 13, causes the display unit 14 to display an HDR image, which is an image with a high dynamic range.

[0011] [Image sensor 20] Fig. 2 shows a circuit configuration of the image sensor 20. As shown in Fig. 2, the image sensor 20 includes a pixel section 30A, a vertical drive circuit 40, a horizontal drive circuit 50, a signal processing section 55, a storage section 56, an output section 57, and a drive control section 60.

[0012] The pixel section 30A includes a plurality of pixels 30, a plurality of vertical signal lines 51, a plurality of first transfer control lines 41, a plurality of second transfer control lines 42, a plurality of storage control lines 43, a plurality of discharge control lines 44, a plurality of power supply lines 45, and a plurality of selection control lines 46.

[0013] The plurality of pixels 30 include X The X and Y directions are aligned. X The X direction and the Y direction intersect with each other. X The Y direction is the row direction, which is the first direction. The Y direction is the column direction, which is the second direction. Each pixel 30 generates an electric charge based on the subject light beam. Each pixel 30 outputs a signal based on the generated electric charge.

[0014] Each pixel 30 is connected to a vertical signal line 51. The pixels 30 in one column arranged in the column direction are connected to one vertical signal line 51 that is common to the pixels 30 in that column. Each vertical signal line 51 is connected to a load current source 52. Each load current source 52 supplies a current to the vertical signal line 51 to which the load current source 52 is connected.

[0015] Each pixel 30 is connected to a first transfer control line 41, a second transfer control line 42, an accumulation control line 43, a discharge control line 44, a power supply line 45, and a selection control line 46. The pixels 30 in each row arranged in the row direction are connected to one first transfer control line 41 common to the pixels 30 in that row. The pixels 30 in each row arranged in the row direction are connected to one second transfer control line 42 common to the pixels 30 in that row. The pixels 30 in each row arranged in the row direction are connected to one accumulation control line 43 common to the pixels 30 in that row. The pixels 30 in each row arranged in the row direction are connected to one discharge control line 44 common to the pixels 30 in that row. The pixels 30 in each row arranged in the row direction are connected to one power supply line 45 common to the pixels 30 in that row. The pixels 30 in each row arranged in the row direction are connected to one selection control line 46 common to the pixels 30 in that row.

[0016] The vertical drive circuit 40 is composed of, for example, a shift register, an address decoder, etc. The vertical drive circuit 40 inputs a transfer signal TX1 to each first transfer control line 41 separately or simultaneously. The vertical drive circuit 40 inputs a transfer signal TX2 to each second transfer control line 42 separately or simultaneously. The vertical drive circuit 40 inputs a transfer signal MTX to each storage control line 43 separately or simultaneously.

[0017] The vertical drive circuit 40 inputs a reset signal RST to each discharge control line 44 separately or all at once. The vertical drive circuit 40 supplies a power supply voltage to each power supply line 45. The vertical drive circuit 40 inputs a selection signal SEL to each selection control line 46 separately or all at once.

[0018] As a result, the vertical drive circuit 40 performs a rolling shutter operation and a global shutter operation. The rolling shutter operation sequentially accumulates charge for each pixel 30 arranged in each row. The global shutter operation simultaneously accumulates charge for each pixel 30.

[0019] The signal processing unit 55 performs signal processing on the signals read out from the pixels 30. The signal processing unit 55 performs noise removal processing on the signals read out from the pixels 30. The signal processing unit 55 also performs A / D conversion processing on the signals read out from the pixels 30. The storage unit 56 stores the signals that have been subjected to signal processing by the signal processing unit 55.

[0020] The horizontal drive circuit 50 is composed of, for example, a shift register, an address decoder, and the like. The horizontal drive circuit 50 sequentially outputs signals stored in the storage unit 56 to the output unit 57. The horizontal drive circuit 50 selects signals stored in the storage unit 56, for example, column by column in the order of column numbers from the first column to the last column. The horizontal drive circuit 50 outputs signals stored in the storage unit 56 to the output unit 57 in the order in which they were selected, for example. The output unit 57 outputs the signal from the storage unit 56 to the outside.

[0021] The drive control unit 60 controls the driving of the vertical drive circuit 40, the signal processing unit 55, and the horizontal drive circuit 50. The drive control unit 60 includes, for example, a decoder for decoding commands from the control unit 70, an encoder for encoding input rows of the transfer signals TX1, TX2, MTX and the reset signal RST, and a timing generator for generating various timing signals. The drive control unit 60 controls the driving of the vertical drive circuit 40, the signal processing unit 55, and the horizontal drive circuit 50 using the timing signals generated by the timing generator so as to execute commands from the control unit 70.

[0022] [Circuit configuration of pixel 30] 3 shows a circuit configuration of two pixels 30 arranged adjacent to each other in the column direction. Of the two pixels 30, one is an example of a first pixel, and the other is an example of a second pixel.

[0023] As shown in FIG. 3, the pixel 30 includes a first photoelectric conversion unit D1, a second photoelectric conversion unit D2, a first transfer unit 31, a second transfer unit 32, a common transfer unit 33, a holding unit MEM, a reset unit 34, an amplifier unit 35, a diffusion unit FD, and a selection unit 36.

[0024] The first photoelectric conversion unit D1 is, for example, configured with a photodiode and receives a subject light flux. The first photoelectric conversion unit D1 converts the received light into an electric charge. The first photoelectric conversion unit D1 is connected to the first transfer unit 31.

[0025] The first transfer unit 31 is composed of, for example, a transistor, and a gate of the first transfer unit 31 is connected to a first transfer control line 41. The first transfer unit 31 is connected to a holding unit MEM. The first transfer control line 41 is supplied with a transfer signal TX1 from the vertical drive circuit 40. The transfer signal TX1 of the first transfer control line 41 turns on the first transfer unit 31. The turned-on first transfer unit 31 transfers the charges converted by the first photoelectric conversion unit D1 to the holding unit MEM.

[0026] The second photoelectric conversion unit D2 is, for example, a photodiode, and receives a subject light flux. The second photoelectric conversion unit D2 converts the received light into an electric charge. The second photoelectric conversion unit D2 is connected to the second transfer unit 32.

[0027] The second transfer unit 32 is composed of, for example, a transistor, and a gate of the second transfer unit 32 is connected to a second transfer control line 42. The second transfer unit 32 is connected to a holding unit MEM. A transfer signal TX2 is supplied to the second transfer control line 42 from the vertical drive circuit 40. The transfer signal TX2 of the second transfer control line 42 turns on the second transfer unit 32. The turned-on second transfer unit 32 transfers the charges converted by the second photoelectric conversion unit D2 to the holding unit MEM.

[0028] The first photoelectric conversion unit D1 has a different sensitivity from the second photoelectric conversion unit D2. The sensitivity is a ratio of the amount of charge to the amount of light received from the subject light flux. The first photoelectric conversion unit D1 may have a different light receiving area for receiving incident light from the second photoelectric conversion unit D2, for example, and the first photoelectric conversion unit D1 may receive light from a color filter having a different thickness from the second photoelectric conversion unit D2, for example. Furthermore, the first photoelectric conversion unit D1 may receive light from an on-chip lens having a different curvature from the second photoelectric conversion unit D2, for example. Furthermore, the first photoelectric conversion unit D1 and the second photoelectric conversion unit D2 may receive different amounts of light, for example, by using a light-shielding film.

[0029] The holding unit MEM is connected to a common transfer unit 33 constituted by, for example, a transistor. The holding unit MEM holds the charge transferred from the first photoelectric conversion unit D1 via the first transfer unit 31. The holding unit MEM holds the charge transferred from the second photoelectric conversion unit D2 via the second transfer unit 32.

[0030] The gate of the common transfer unit 33 is connected to an accumulation control line 43. The common transfer unit 33 is connected to the diffusion unit FD. The accumulation control line 43 is supplied with a transfer signal MTX from the vertical drive circuit 40. The transfer signal MTX of the accumulation control line 43 turns on the common transfer unit 33. The turned-on common transfer unit 33 transfers the charges accumulated in the holding unit MEM to the diffusion unit FD.

[0031] The diffusion unit FD is connected to the common transfer unit 33 and, for example, the gate of the amplifier unit 35 composed of a transistor. The diffusion unit FD converts the charge transferred from the common transfer unit 33 into a voltage. The voltage converted in the diffusion unit FD is applied to the gate of the amplifier unit 35.

[0032] The reset unit 34 is composed of, for example, a transistor. The gate of the reset unit 34 is connected to a discharge control line 44. The reset unit 34 controls the electrical connection between a power line 45 and the diffusion unit FD. The power line 45 is supplied with a power supply voltage from the vertical drive circuit 40. The discharge control line 44 is supplied with a reset signal RST from the vertical drive circuit 40. The reset signal RST turns on the reset unit 34. The turned-on reset unit 34 discharges electric charge from the diffusion unit FD.

[0033] The amplifier unit 35 is connected to a power supply line 45 and a selection unit 36 ​​formed of, for example, a transistor. A gate of the selection unit 36 ​​is connected to a selection control line 46. The selection unit 36 ​​controls the electrical connection between the amplifier unit 35 and a vertical signal line 51.

[0034] The amplifier 35, the selector 36, and the vertical signal line 51 connected to the load current source 52 form a source follower circuit. The source of the amplifier 35 is an input part of the source follower circuit for reading out a voltage signal of the diffusion unit FD.

[0035] The selection control line 46 receives a selection signal SEL from the vertical drive circuit 40. The selection signal SEL on the selection control line 46 turns on the selection unit 36. The turned-on selection unit 36 ​​enables the signal from the amplification unit 35 to be read out from the vertical signal line 51.

[0036] The amplifier 35 and the selector 36 constitute a pixel output section 37 . [Circuit layout of pixel 30] Fig. 4 is a plan view of two pixels 30 arranged adjacent to each other in the Y direction. Fig. 4 shows the circuit layout of the pixels 30 and the positions of contacts electrically connected to the vertical signal line 51, the first transfer control line 41, etc. The black circles in Fig. 4 represent the contacts.

[0037] 4, the first photoelectric conversion unit D1 and the second photoelectric conversion unit D2 have a rectangular shape. The holding unit MEM and the diffusion unit FD also have a rectangular shape. The first photoelectric conversion unit D1 and the second photoelectric conversion unit D2 have different areas.

[0038] 4 is connected to the holding unit MEM by the first transfer unit 31. The first transfer unit 31 that is turned on transfers the electric charges converted by the first photoelectric conversion unit D1 to the holding unit MEM.

[0039] 4 is connected to the holding unit MEM by the second transfer unit 32. The second transfer unit 32 that is turned on transfers the charges converted by the second photoelectric conversion unit D2 to the holding unit MEM.

[0040] 4, the upper part of the holding part MEM is connected to the diffusion part FD by the common transfer part 33. When the common transfer part 33 is turned on, it transfers the charge stored in the holding part MEM to the diffusion part FD.

[0041] Between the first photoelectric conversion unit D1 and the diffusion unit FD, the reset unit 34 is disposed. When the reset unit 34 is turned on, it discharges electric charge from the diffusion unit FD to the power supply line 45 through the contact.

[0042] 4 of the diffusion unit FD is connected to the amplifier unit 35. The drain of the amplifier unit 35 is connected to the drain of the selection unit 36 ​​via a contact. [Reset action] Fig. 5 is a timing chart showing the reset operation and signal readout operation of the first photoelectric conversion unit D1 executed by the image sensor 20. Note that Fig. 5 shows the reset operation and signal readout operation of the first photoelectric conversion unit D1 in each pixel 30 in the first row.

[0043] The reset operation of the first photoelectric conversion unit D1 depletes the charge of the first photoelectric conversion unit D1. The reset operation of the first photoelectric conversion unit D1 is an operation for starting exposure of the first photoelectric conversion unit D1. The reset operation and signal readout operation of the second photoelectric conversion unit D2 change the transfer signal TX1 in the reset operation and signal readout operation of the first photoelectric conversion unit D1 to a transfer signal TX2. The reset operation of the second photoelectric conversion unit D2 depletes the charge of the second photoelectric conversion unit D2. The reset operation of the second photoelectric conversion unit D2 is an operation for starting exposure of the second photoelectric conversion unit D2.

[0044] 5, the image sensor 20 periodically raises the control signal HD. The image sensor 20 supplies a reset signal RST from the vertical drive circuit 40 for a predetermined period with the first transfer unit 31, the second transfer unit 32, the common transfer unit 33, the reset unit 34, and the selection unit 36 ​​turned off (timing T1). This causes the image sensor 20 to discharge electric charges from the diffusion units FD in the pixels 30 in the first row.

[0045] Next, with the reset unit 34 turned on, the image sensor 20 supplies a transfer signal TX1 to the vertical drive circuit 40 to turn on the first transfer unit 31, and transfers the charge remaining in the first photoelectric conversion unit D1 from the first photoelectric conversion unit D1 to the holding unit MEM (timing T2). The image sensor 20 supplies a transfer signal MTX to the vertical drive circuit 40 to turn on the common transfer unit 33, and transfers and discharges the charge remaining in the first photoelectric conversion unit D1 from the holding unit MEM to the diffusion unit FD (timing T3). This causes the image sensor 20 to start the reset operation of the first photoelectric conversion unit D1 in each pixel 30 in the first row.

[0046] Next, the image sensor 20 stops the supply of the transfer signal TX1 to the vertical drive circuit 40, turns off the first transfer unit 31, and ends the reset operation of the first photoelectric conversion unit D1. Then, the image sensor 20 starts exposure of each of the first photoelectric conversion units D1 in the first row (timing T4). The exposure of the first photoelectric conversion units D1 continues until the first transfer unit 31 is turned on again (timing T8). The period from timing T4 to timing T8 is the exposure period of the first photoelectric conversion unit D1. Note that the image sensor 20 stops the supply of the transfer signal MTX to the vertical drive circuit 40, and turns off the common transfer unit 33 (timing T5).

[0047] During the rolling shutter operation, the image sensor 20 performs a reset operation on the first photoelectric conversion units D1 in each row in order from the first row to the last row. During the rolling shutter operation, the image sensor 20 performs a reset operation on the second photoelectric conversion units D2 in each row in order from the first row to the last row.

[0048] In the image sensor 20, during the global shutter operation, when the image sensor 20 performs a reset operation on the first photoelectric conversion units D1 in one row, the image sensor 20 performs a reset operation on the first photoelectric conversion units D1 in the other rows. In the image sensor 20, during the global shutter operation, when the second photoelectric conversion unit D2 in one row is reset, the second photoelectric conversion unit D2 in the other rows is reset.

[0049] [Signal readout operation] 5, after completing the reset operation and starting exposure, the image sensor 20 supplies a reset signal RST from the vertical drive circuit 40 (timing T6), which causes the image sensor 20 to discharge electric charges from the diffusion portions FD of the pixels 30 in the first row.

[0050] Next, the image sensor 20 supplies a selection signal SEL from the vertical drive circuit 40 to turn on the selection unit 36. The image sensor 20 also generates a start signal SHP for starting to read out the reset voltage (timing T7). This causes the image sensor 20 to read out the reset voltage of each pixel 30 in the first row as a sampling operation for that pixel 30. The reset voltage is a voltage based on the voltage in the diffusion unit FD when the charge is discharged. The reset voltage is used for correlated double sampling processing.

[0051] Next, the image sensor 20 supplies a transfer signal TX1 to the vertical drive circuit 40 to turn on the first transfer unit 31. This causes the image sensor 20 to cause each of the first photoelectric conversion units D1 in the first row to finish exposure (timing T8). Then, the image sensor 20 transfers the charges converted by the first photoelectric conversion units D1 from the first photoelectric conversion units D1 to the holding unit MEM.

[0052] Next, the image sensor 20 supplies a transfer signal MTX to the vertical drive circuit 40 to turn on the common transfer unit 33, and transfers the charge accumulated in the first photoelectric conversion unit D1 from the holding unit MEM to the diffusion unit FD (timing T9). The image sensor 20 also generates a start signal SHD for starting signal readout (timing T10). This causes the image sensor 20 to read out signals from the pixels 30 in the first row as a signal readout operation.

[0053] During the rolling shutter operation, the image sensor 20 performs a signal readout operation on the first photoelectric conversion units D1 in order from the first row to the last row. During the rolling shutter operation, the image sensor 20 performs a signal readout operation on the second photoelectric conversion units D2 in order from the first row to the last row.

[0054] In the global shutter operation, when the image sensor 20 performs a signal readout operation on the first photoelectric conversion unit D1 in one row, it also performs a signal readout operation on the first photoelectric conversion unit D1 in another row.

[0055] During the global shutter operation, the image sensor 20 performs a signal readout operation on the second photoelectric conversion units D2 in one row while performing a signal readout operation on the second photoelectric conversion units D2 in another row.

[0056] [Global shutter operation interrupt] Fig. 6 shows the flow of the reset operation and signal readout operation in the pixel unit 30A. Fig. 6 shows the flow when the high dynamic range button on the operation unit 16 is pressed while a live view image is being displayed.

[0057] 6, the control unit 70 periodically raises the control signal VD. The period during which the control signal VD rises is the frame period during which one image is displayed on the display unit 14. The control unit 70 displays a live view image F1 on a live view screen VW1 of the display unit 14 in the frame period.

[0058] First, the image sensor 20 performs a reset operation RST1 (solid line in FIG. 6) and a signal read operation RD1 (dashed line in FIG. 6) in order from the first photoelectric conversion unit D11 in the first row to the first photoelectric conversion unit D1n in the last row (timing T11).

[0059] Next, the image sensor 20 similarly performs the reset operation RST1 and the signal readout operation RD1 on the first photoelectric conversion unit D11 in the first row to the first photoelectric conversion unit D1n in the last row at timing T12. At this time, the control unit 70 displays the image generated by the previous signal readout operation on the display unit 14 as a live view image F1.

[0060] In this manner, the imaging element 20 repeatedly displays a live view image F1 by performing the reset operation RST1 and the signal readout operation RD1 in order from the first photoelectric conversion unit D1 in the first row to the first photoelectric conversion unit D1n in the last row.

[0061] Here, it is assumed that the high dynamic range button of the operation unit 16 is pressed between timing T12 and timing T13. Then, the image sensor 20 executes the first mode. That is, the image sensor 20 performs the reset operation RST2 and the signal read operation RD2 in order from the second photoelectric conversion unit D21 in the first row to the second photoelectric conversion unit D2n in the last row (timing T13).

[0062] Then, in order to avoid interruption of the image on the live view screen VW1, the control unit 70 displays a live view image F2 based on the signal readout operation RD2 of the second photoelectric conversion unit D2 following the display of a live view image F1 based on the signal readout operation RD1 of the first photoelectric conversion unit D1.

[0063] During this time, while the image sensor 20 performs the reset operation RST1 on the first photoelectric conversion unit D11 in one row, it also performs the reset operation RST1 on the first photoelectric conversion unit D1n in another row (timing T13). Next, after the first exposure period EXP1G has elapsed, the image sensor 20 performs the signal readout operation RD1 in order from the first photoelectric conversion unit D11 in the first row to the first photoelectric conversion unit D1n in the last row (timing T14).

[0064] The reset operation RST1 of the multiple first photoelectric conversion units D1 may be performed by interrupting the reset operation RST2 of the second photoelectric conversion units D2 in sequence from the first row to the last row.

[0065] As a result, the control unit 70 generates an image F1G in the first exposure period EXP1G for generating an HDR image (timing T15). Then, following the display of the live view image F2 by the signal readout operation RD2 of the second photoelectric conversion unit D2, the control unit 70 displays the image F1G of the first exposure period EXP1G on the live view screen VW1 so as not to interrupt the image on the live view screen VW1. The image F1G is an example of the second image.

[0066] During this time, the image sensor 20 executes the second mode after the first mode. That is, when the image sensor 20 performs the reset operation RST1 of the second photoelectric conversion unit D21 in one row, it performs the reset operation RST2 of the second photoelectric conversion unit D2n in another row (timing T14). Next, after the second exposure period EXP2G has elapsed, the image sensor 20 performs the signal readout operation RD2 in the order of row numbers from the second photoelectric conversion unit D21 in the first row to the second photoelectric conversion unit D2n in the last row (timing T15).

[0067] As a result, the control unit 70 generates an image F2G in the second exposure period EXP2G for generating an HDR image. Then, the control unit 70 displays the image F2G of the second exposure period EXP2G on the live view screen VW1 following the image F1G of the first exposure period EXP1G so as not to interrupt the image on the live view screen VW1 (timing T16). The image F2G is an example of the first image.

[0068] Furthermore, the control unit 70 again performs the reset operation RST1 and the signal read operation RD1 on the first photoelectric conversion unit D1 in the first row to the first photoelectric conversion unit D1n in the last row in order (timing T16).

[0069] As a result, the control unit 70 repeats display of the live view image F1 again following the image F2G of the second exposure period EXP2G so as not to interrupt the image on the live view screen VW1.

[0070] Furthermore, the image processing unit 13 generates a composite image from the first image data generated using the signal based on the charge converted by the first photoelectric conversion unit D1 of each row and the second image data generated using the signal based on the charge converted by the second photoelectric conversion unit D2 of each row. For example, the control unit 70 composites two images F1G and F2G with different exposure periods so that an image taken in a backlit environment becomes a clear image without backlight and an image taken in a dark place becomes a clear image, and displays the HDR image FHD on the HDR screen VW2.

[0071] According to the above embodiment, the following effects can be obtained. (1) The image sensor 20 executes the first mode. That is, while the charge converted by the first photoelectric conversion unit D1 of the first pixel and the charge converted by the first photoelectric conversion unit D1 of the second pixel are being accumulated, a signal based on the charge converted by the second photoelectric conversion unit D2 of the first pixel and a signal based on the charge converted by the second photoelectric conversion unit D2 of the second pixel are read out in sequence (timings T13 to T14).

[0072] (2) The image sensor 20 executes the second mode after the first mode. That is, while the charge converted by the second photoelectric conversion unit D2 of the first pixel and the charge converted by the second photoelectric conversion unit D2 of the second pixel are being accumulated, a signal based on the charge converted by the first photoelectric conversion unit D1 of the first pixel and a signal based on the charge converted by the first photoelectric conversion unit D1 of the second pixel are read out in sequence (timings T14 to T15).

[0073] According to the above (1), the image sensor 20 can proceed with exposure by global shutter operation in the first photoelectric conversion unit D1 while proceeding with signal readout for generating the live view image F2 in the second photoelectric conversion unit D2.

[0074] According to the above (2), the image sensor 20 can proceed with exposure by global shutter operation in the second photoelectric conversion unit D2 while proceeding with signal readout for generating an HDR image FHD in the first photoelectric conversion unit D1.

[0075] (3) The control unit 70 displays the image F1G of the first exposure period EXP1G on the live view screen VW1. Also, the control unit 70 displays the image F2G of the second exposure period EXP2G on the live view screen VW1.

[0076] Therefore, even if simultaneous exposure of multiple first photoelectric conversion units D1 uses one frame period and the signal readout operation of the multiple first photoelectric conversion units D1 further uses one frame period, the control unit 70 does not cause the image to be interrupted on the live view screen VW1.

[0077] The above embodiment can be modified as follows. The first photoelectric conversion unit D1 may have the same light receiving area as the second photoelectric conversion unit D2, or may have a different shape from the second photoelectric conversion unit D2. The first photoelectric conversion unit D1 may have the same color filter as the second photoelectric conversion unit D2, may be covered by an on-chip lens with the same curvature as the second photoelectric conversion unit D2, or may have the same light shielding film as the second photoelectric conversion unit D2. The first photoelectric conversion unit D1 may have the same sensitivity as the second photoelectric conversion unit D2.

[0078] The image sensor 20 may switch the target of the rolling shutter operation from the first photoelectric conversion unit D1 to the second photoelectric conversion unit D2, and perform a global shutter operation using the first photoelectric conversion unit D1 during the switching period. Conversely, the image sensor 20 may switch the target of the rolling shutter operation from the second photoelectric conversion unit D2 to the first photoelectric conversion unit D1, and perform a global shutter operation using the second photoelectric conversion unit D2 during the switching period.

[0079] The imaging element 20 may perform the global shutter operation using the first photoelectric conversion unit D1 and the global shutter operation using the second photoelectric conversion unit D2 consecutively or with a predetermined frame period therebetween.

[0080] The first photoelectric conversion unit D1 and the second photoelectric conversion unit D2 of the imaging element 20 may be configured to generate photoelectric charges from infrared light or ultraviolet light in addition to generating photoelectric charges from visible light. The imaging element 20 may be mounted in a photographing device such as a camera or a mobile device with a camera function. [Explanation of symbols]

[0081] D1: First photoelectric conversion section D2: Second photoelectric conversion section 20...Image sensor 30…pixels 30A…Pixel section 31…First transfer section 32…Second transfer section 33…Common transfer section 34…Reset section 35…Amplification section 36…Selection section 40...Vertical drive circuit 50...Horizontal drive circuit 60...Drive control unit

Claims

1. a pixel section in which a plurality of pixels, each having a first photoelectric conversion unit that converts light into an electric charge and a second photoelectric conversion unit that converts light into an electric charge, are arranged in a column direction; an image sensor comprising: a control unit that executes a first mode in which, when accumulation of charge converted by the first photoelectric conversion unit of a first pixel among the plurality of pixels and accumulation of charge converted by the first photoelectric conversion unit of a second pixel among the plurality of pixels are being performed, a signal based on charge converted by the second photoelectric conversion unit of the first pixel and a signal based on charge converted by the second photoelectric conversion unit of the second pixel are read out in sequence.

2. 2. The image sensor according to claim 1, wherein the control unit executes a second mode, which is executed after the first mode, and which sequentially reads out a signal based on the charge converted by the first photoelectric conversion unit of the first pixel and a signal based on the charge converted by the first photoelectric conversion unit of the second pixel when accumulation of the charge converted by the second photoelectric conversion unit of the first pixel and accumulation of the charge converted by the second photoelectric conversion unit of the second pixel are being performed.

3. 3. The imaging element according to claim 2, wherein in the first mode, the control unit reads out a signal based on the charge converted by the first photoelectric conversion unit of the first pixel and a signal based on the charge converted by the first photoelectric conversion unit of the second pixel by a global shutter operation.

4. 4. The imaging element according to claim 3, wherein in the second mode, the control unit reads out a signal based on the charge converted by the second photoelectric conversion unit of the first pixel and a signal based on the charge converted by the second photoelectric conversion unit of the second pixel by a global shutter operation.

5. 5. The imaging element according to claim 1, wherein each of the pixels has a holding unit that holds the electric charge converted by the first photoelectric conversion unit and the electric charge converted by the second photoelectric conversion unit.

6. The image sensor according to claim 1 , wherein the second photoelectric conversion unit has a different sensitivity from the first photoelectric conversion unit.

7. The image sensor according to claim 6 , wherein the second photoelectric conversion portion has a light receiving area for receiving incident light that is different from that of the first photoelectric conversion portion.

8. The imaging element according to claim 1 , a display unit on which a first image is displayed, the first image being generated using a signal based on the charge converted by the second photoelectric conversion unit of the first pixel and a signal based on the charge converted by the second photoelectric conversion unit of the second pixel; An imaging device in which the first image is generated using signals respectively read out in the first mode.

9. 9. The imaging device according to claim 8, wherein the display unit displays a second image generated using a signal based on the charge converted by the first photoelectric conversion unit of the first pixel and a signal based on the charge converted by the first photoelectric conversion unit of the second pixel.

10. The imaging element according to any one of claims 2 to 4, an image processing unit that generates a composite image from first image data generated using a signal based on the charges converted by the first photoelectric conversion unit of the first pixel and a signal based on the charges converted by the first photoelectric conversion unit of the second pixel, and second image data generated using a signal based on the charges converted by the second photoelectric conversion unit of the first pixel and a signal based on the charges converted by the second photoelectric conversion unit of the second pixel, the first image data is generated using signals read out in the first mode, The second image data is generated using signals read out in the second mode.

Images