Imaging device, driving method of imaging device, and program

Abstract

To provide an imaging apparatus which makes an exposure time of a phase difference pixel equal to or longer than a frame period and enables a signal to be read out of the phase difference pixel for each frame period, a driving method, and a program.SOLUTION: An imaging element comprises: a first phase difference pixel region and a second phase difference pixel region each including a plurality of phase difference pixels; and an imaging pixel region located between the first phase difference pixel region and the second phase difference pixel region in a first direction. A processor executes first read-out processing for causing the imaging element to perform imaging in a frame period and reading a signal out of the first phase difference pixel region during a first frame period, and second read-out processing for reading a signal out of the second phase difference pixel region during a second frame period which is continued to the first frame period. A first exposure time in which the first phase difference pixel region is exposed and a second exposure time in which the second phase difference pixel region is exposed are different from an exposure time of the imaging pixel region.SELECTED DRAWING: Figure 10

Description

Technical Field

[0001] The technology of the present disclosure relates to an imaging device, a driving method of the imaging device, and a program.

Background Art

[0002] The imaging device described in Patent Document 1 is an image sensor in which a plurality of pixels are two-dimensionally arranged, and includes an imaging pixel that photoelectrically converts a subject image formed by a photographing lens to generate a signal for image generation, and a plurality of imaging pixels. Pixel for focus detection that is discretely arranged between the pixels, divides the pupil region of the photographing lens, and photoelectrically converts the subject image from the divided pupil region to generate a signal for phase difference detection; and all pixels of the plurality of pixels A switching unit that switches between a full pixel readout mode for reading out signals and a thinning readout mode for thinning and reading out signals of a plurality of pixels; and when switched to the thinning readout mode by the switching unit, an imaging row used for image generation and a focus detection row having focus detection pixels, and a control unit that independently performs charge accumulation control.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

[0004] One embodiment of the technology according to the present disclosure provides an imaging device, a driving method, and a program that enable the exposure time of phase difference pixels to be equal to or longer than a frame period and enable signals to be read out from the phase difference pixels every frame period.

Means for Solving the Problems

[0005] To achieve the above object, the imaging device of the present disclosure includes a processor, column signal lines that read out signals extending in a first direction, and an image sensor including a plurality of phase difference pixels arranged in a second direction intersecting the first direction. The image sensor has a first phase difference pixel region and a second phase difference pixel region each including a plurality of phase difference pixels, and an imaging pixel region between the first phase difference pixel region and the second phase difference pixel region in the first direction. The processor is configured to cause the image sensor to perform imaging at a frame period, and during a first frame period, execute a first readout process of reading out signals from the first phase difference pixel region, and during a second frame period following the first frame period, execute a second readout process of reading out signals from the second phase difference pixel region. The first exposure time during which the first phase difference pixel region is exposed and the second exposure time during which the second phase difference pixel region is exposed are different from the exposure time of the imaging pixel region.

[0006] Preferably, the first exposure time and the second exposure time each exceed the frame period.

[0007] Preferably, the first exposure time and the second exposure time are different from each other.

[0008] Preferably, the processor can execute a first mode in which the first readout process and the second readout process are alternately executed, and the first exposure time and the second exposure time are each less than twice the frame period.

[0009] When K is an integer of 2 or more, preferably, the processor can execute a second mode in which the second exposure time is equal to or greater than K times and less than K + 1 times the frame period, the first readout process is executed K times during the exposure period of the second phase difference pixel region, and the second readout process is executed once each time the first readout process is executed K times.

[0010] In the second mode, preferably, the first exposure time is less than the frame period.

[0011] Preferably, the processor switches between the first mode and the second mode according to the brightness of the subject.

[0012] The processor preferably enables execution of a third mode in which it repeats only the first read process without performing the second read process.

[0013] The processor preferably switches between the first mode and the third mode according to the moving speed of the subject.

[0014] When N is an integer of 3 or more, the imaging device has N phase difference pixel regions from the first phase difference pixel region arranged in the second direction to the Nth phase difference pixel region, and the processor preferably selects each of the phase difference pixel regions every frame period to read a signal, and sets the exposure time of the phase difference pixel region to less than N times the frame period.

[0015] The imaging device includes a plurality of row selection lines extending in the second direction. The first phase difference pixel region includes a pair of first phase difference pixels as a plurality of phase difference pixels. The second phase difference pixel region includes a pair of second phase difference pixels as a plurality of phase difference pixels. The pair of first phase difference pixels is selected by the same row selection line, and the pair of second phase difference pixels is selected by the same row selection line. It is preferable that the first phase difference pixel region and the second phase difference pixel region are alternately arranged in the first direction with the imaging pixel region therebetween.

[0016] The imaging device includes a plurality of row selection lines extending in the second direction. The first phase difference pixel region includes a pair of first phase difference pixels as a plurality of phase difference pixels. The second phase difference pixel region includes a pair of second phase difference pixels as a plurality of phase difference pixels. The pair of first phase difference pixels is respectively selected by a plurality of row selection lines arranged in the first direction, and the pair of second phase difference pixels is respectively selected by a plurality of row selection lines arranged in the first direction. It is preferable that the first phase difference pixel region and the second phase difference pixel region are alternately arranged in the first direction with the imaging pixel region therebetween.

[0017] The plurality of phase difference pixels included in the first phase difference pixel region and the second phase difference pixel region, and the imaging pixels in the imaging pixel region each have a pair of photoelectric conversion elements. The processor reads out the signal of one of the pair of photoelectric conversion elements in the plurality of phase difference pixels, reads out the signals from both of the pair of photoelectric conversion elements from the imaging pixels, and the first phase difference pixel region and the second phase difference pixel region are preferably alternately arranged in the first direction with the imaging pixel region interposed therebetween.

[0018] The driving method of the imaging device of the present disclosure includes an imaging element including a column signal line that reads out a signal extending in the first direction and a plurality of phase difference pixels arranged in a second direction intersecting the first direction. The imaging element has a first phase difference pixel region and a second phase difference pixel region each including a plurality of phase difference pixels, and an imaging pixel region located between the first phase difference pixel region and the second phase difference pixel region in the first direction. The driving method of the imaging device is to cause the imaging element to perform imaging in a frame period, and during a first frame period, execute a first readout process of reading out a signal from the first phase difference pixel region, and during a second frame period following the first frame period, execute a second readout process of reading out a signal from the second phase difference pixel region. The first exposure time during which the first phase difference pixel region is exposed and the second exposure time during which the second phase difference pixel region is exposed are different from the exposure time of the imaging pixel region.

[0019] The program of the present disclosure is a program for operating an imaging device including an imaging element including a column signal line that reads out a signal extending in the first direction and a plurality of phase difference pixels arranged in a second direction intersecting the first direction. The imaging element has a first phase difference pixel region and a second phase difference pixel region each including a plurality of phase difference pixels, and an imaging pixel region located between the first phase difference pixel region and the second phase difference pixel region in the first direction. The program causes the imaging element to perform imaging in a frame period, and during a first frame period, execute a first readout process of reading out a signal from the first phase difference pixel region, and during a second frame period following the first frame period, execute a second readout process of reading out a signal from the second phase difference pixel region. The first exposure time during which the first phase difference pixel region is exposed and the second exposure time during which the second phase difference pixel region is exposed are different from the exposure time of the imaging pixel region.

Brief Description of the Drawings

[0020]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Figure 9

Figure 10

Figure 11

Figure 12

Figure 13

Figure 14

Figure 15

Figure 16

Figure 17

Figure 18

Figure 19

Figure 20

Figure 21

Mode for Carrying Out the Invention

[0021] An example of an embodiment according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0022] First, the terms used in the following description will be explained.

[0023] In the following description, "IC" is an abbreviation for "Integrated Circuit". "CPU" is an abbreviation for "Central Processing Unit". "ROM" is an abbreviation for "Read Only Memory". "RAM" is an abbreviation for "Random Access Memory". "CMOS" is an abbreviation for "Complementary Metal Oxide Semiconductor". EEPROM is an abbreviation for "Electrically Erasable Programmable Read-Only Memory".

[0024] "FPGA" is an abbreviation for "Field-Programmable Gate Array". "PLD" is an abbreviation for "Programmable Logic Device". "ASIC" is an abbreviation for "Application Specific Integrated Circuit". "JPEG" is an abbreviation for "Joint Photographic Experts Group".

[0025] In the present disclosure, "equal" includes not only being completely equal but also being substantially equal including errors generally acceptable in the technical field to which the technology of the present disclosure belongs.

[0026] [First Embodiment] As a first embodiment of the imaging device, the technology of the present disclosure will be described by taking an interchangeable-lens digital camera as an example. Note that the technology of the present disclosure is not limited to interchangeable-lens types and is also applicable to digital cameras with an integrated lens.

[0027] (Configuration of Imaging Device) FIG. 1 shows an example of the front side of the imaging device 10. As shown in FIG. 1, the imaging device 10 is an interchangeable-lens digital camera. The imaging device 10 includes a main body 11 and an imaging lens 12 that is detachably attached to the main body 11. The imaging lens 12 is attached to the front surface 11C side of the main body 11 via a camera-side mount 11A and a lens-side mount 12A (see FIG. 3). The imaging lens 12 is an example of a lens according to the technology of the present disclosure.

[0028] A dial 13 and a release button 14 are provided on the upper surface of the main body 11. The dial 13 is operated when setting the operation mode or the like. As the operation modes of the imaging device 10, for example, a still image shooting mode, a moving image shooting mode, and an image display mode are included. The release button 14 is operated by the user to start still image shooting or moving image shooting.

[0029] FIG. 2 shows an example of the back side of the imaging device 10. As shown in FIG. 2, a display 15, an instruction key 16, and a finder eyepiece portion 18 of a finder (not shown) are provided on the back surface 11D of the main body 11. An optical viewfinder or an electronic viewfinder can be adopted as the finder. An image based on an image signal obtained by imaging and various menu screens are displayed on the display 15. The instruction key 16 receives various instructions.

[0030] FIG. 3 shows an example of the internal configuration of the imaging device 10. The main body 11 and the imaging lens 12 are electrically connected by contact between an electrical contact 11B provided on the camera-side mount 11A and an electrical contact 12B provided on the lens-side mount 12A.

[0031] The imaging lens 12 includes an objective lens 30, a focus lens 31, a rear-end lens 32, and a diaphragm 33. Each member is arranged in the order of the objective lens 30, the diaphragm 33, the focus lens 31, and the rear-end lens 32 from the object side along the optical axis LA of the imaging lens 12. The objective lens 30, the focus lens 31, and the rear-end lens 32 constitute an imaging optical system. The type, number, and arrangement order of the lenses constituting the imaging optical system are not limited to the example shown in FIG. 3.

[0032] In addition, the imaging lens 12 has a lens drive control unit 34. The lens drive control unit 34 is constituted by, for example, a CPU, a RAM, a ROM, etc. The ROM also includes a rewritable EEPROM, a flash memory, etc. The lens drive control unit 34 is electrically connected to the processor 40 in the main body 11 via the electrical contact 12B and the electrical contact 11B.

[0033] The lens drive control unit 34 drives the focus lens 31 and the diaphragm 33 based on a control signal transmitted from the processor 40. The lens drive control unit 34 performs drive control of the focus lens 31 based on a control signal for focus adjustment transmitted from the processor 40 in order to perform focus adjustment of the imaging lens 12. The processor 40 performs phase difference type focus adjustment.

[0034] The main body 11 is provided with an imaging sensor 20, a processor 40, an operation unit 42, a memory 45, and a display 15. The operations of the imaging sensor 20, the memory 45, and the display 15 are controlled by the processor 40. The processor 40 is constituted by, for example, a CPU, a RAM, a ROM, etc. In this case, the processor 40 executes various processes based on the program 45A stored in the memory 45. Note that the processor 40 may be constituted by an aggregate of a plurality of IC chips. Also, the imaging sensor 20 is, for example, a CMOS type image sensor. The imaging sensor 20 is an example of the "imaging element" according to the technology of the present disclosure.

[0035] The display 15 displays an image based on the image data generated by the image processing unit 52 (see FIG. 4). The image includes a still image, a moving image, and a live view image. The live view image is an image that is real-time displayed on the display 15 by sequentially outputting the image data generated by the image processing unit 52 to the display 15.

[0036] The image data generated by the image processing unit 52 can be stored in an internal memory (not shown) built into the main body 11 or a storage medium (e.g., a memory card) detachable from the main body 11.

[0037] The operation unit 42 includes the aforementioned dial 13, release button 14, and instruction keys 16 (see FIGS. 1 and 2). The processor 40 controls each part within the main body 11 and the lens drive control unit 34 within the imaging lens 12 according to the operations of the operation unit 42.

[0038] (Configuration of the Processor) FIG. 4 shows an example of the functional configuration of the processor 40. The processor 40 realizes various functional units by executing processing according to a program 45A stored in the memory 45. As shown in FIG. 4, for example, a main control unit 50, an imaging control unit 51, and an image processing unit 52 are realized in the processor 40.

[0039] The main control unit 50 comprehensively controls the operation of the imaging device 10 based on an instruction signal input from the operation unit 42. The imaging control unit 51 executes imaging processing that causes the imaging sensor 20 to perform an imaging operation by controlling the imaging sensor 20. The imaging control unit 51 drives the imaging sensor 20 in a still image imaging mode or a moving image imaging mode.

[0040] The user can select between a still image imaging mode and a moving image imaging mode using the operation unit 42. Also, the user can set exposure values including the shutter speed and aperture value by operating the operation unit 42.

[0041] In addition, the user can select the automatic exposure mode by operating the operation unit 42. When the automatic exposure mode is selected, the main control unit 50 obtains the optimum values of the shutter speed and the aperture value by performing an operation using the luminance of the image signal obtained by the imaging sensor 20 and the program diagram.

[0042] The image processing unit 52 generates image data in a predetermined file format (for example, JPEG format, etc.) by performing various image processes on the image signal.

[0043] (Configuration of Imaging Sensor) FIG. 5 shows an example of the configuration of the imaging sensor 20. The imaging sensor 20 shown in FIG. 5 is a CMOS image sensor. The imaging sensor 20 includes an imaging area 21, a vertical scanning circuit 22, a line memory 23, a horizontal scanning circuit 24, and an output amplifier 25.

[0044] In the imaging area 21, a plurality of pixels 26 are arranged in a two-dimensional matrix along the X direction and the Y direction. In addition, in the imaging area 21, a plurality of row selection lines L1 and a plurality of row reset lines L2 are wired along the X direction, and a plurality of column signal lines L3 are wired along the Y direction.

[0045] The column signal lines L3 extend in the Y direction. The row selection lines L1 and the row reset lines L2 extend in the X direction intersecting the Y direction. The Y direction is an example of the "first direction" according to the technology of the present disclosure. The X direction is an example of the "second direction" according to the technology of the present disclosure.

[0046] The pixel 26 is connected to the row selection line L1, the row reset line L2, and the column signal line L3. Hereinafter, a plurality of pixels 26 arranged in the X direction may be simply referred to as "rows". Although details will be described later, some of the plurality of pixels 26 are phase difference pixels for performing focus adjustment.

[0047] Pixel 26 includes a photodiode D1, an amplifier transistor M1, a pixel selection transistor M2, and a reset transistor M3. The photodiode D1 generates a signal charge corresponding to the incident light amount by photoelectrically converting the incident light, and accumulates the generated signal charge. The amplifier transistor M1 generates a voltage (hereinafter referred to as pixel signal S) corresponding to the charge amount of the signal charge accumulated in the photodiode D1.

[0048] The pixel selection transistor M2 is controlled by the vertical scanning circuit 22 via the row selection line L1, and outputs the pixel signal S generated by the amplifier transistor M1 to the column signal line L3. The reset transistor M3 is controlled by the vertical scanning circuit 22 via the row reset line L2, and discards the signal charge accumulated in the photodiode D1 to the power supply line. Hereinafter, discarding the signal charge from the photodiode D1 is referred to as resetting the pixel 26.

[0049] The vertical scanning circuit 22 generates a row selection signal SEL and a reset signal RST based on the vertical synchronization signal input from the imaging control unit 51. During the signal readout operation, the vertical scanning circuit 22 outputs the pixel signal S from the pixel 26 connected to the row selection line L1 to the column signal line L3 by applying the row selection signal SEL to the row selection line L1.

[0050] Also, during the reset operation, the vertical scanning circuit 22 resets the pixel 26 connected to the row reset line L2 by applying the reset signal RST to the row reset line L2. For example, the reset of the pixel 26 connected to the row reset line L2 of the n-th row is performed while the pixel signal S is being read out from the pixel 26 connected to the row selection line L1 of the (n + 1)-th row.

[0051] The line memory 23 stores the pixel signal S output from the pixels 26 for one line. The line memory 23 is composed of a capacitor or the like. The line memory 23 is connected to the horizontal output line 24A via a transistor 29 as a switch. The output amplifier 25 is connected to the end of the horizontal output line 24A. The horizontal scanning circuit 24 performs horizontal scanning to sequentially select the transistor 29, thereby sequentially outputting the pixel signals S for one line stored in the line memory 23 to the horizontal output line 24A. The pixel signal S output to the horizontal output line 24A is output as an image signal to an external image processing unit 52 via the output amplifier 25.

[0052] The operations of the vertical scanning circuit 22, the line memory 23, and the horizontal scanning circuit 24 are controlled by an imaging control unit 51 (see FIG. 4). The imaging control unit 51 controls the vertical scanning circuit 22 to output the pixel signal S while sequentially selecting the row selection line L1 one row at a time. Further, the imaging control unit 51 controls the vertical scanning circuit 22 to reset the pixels 26 while sequentially selecting the row reset line L2 one row at a time.

[0053] In the moving image shooting mode, the imaging control unit 51 drives the imaging sensor 20 at a frame period T (see FIG. 10). The imaging control unit 51 repeatedly executes the operations of reading out and resetting the image signal to the imaging sensor 20 at a frame period corresponding to the frame rate.

[0054] Note that the configuration of the imaging sensor 20 is not limited to the configuration shown in FIG. 5. For example, an A / D converter may be provided in the imaging sensor 20.

[0055] (Configuration of Pixels) The plurality of pixels 26 arranged in the imaging region 21 include imaging pixels N for imaging and phase difference pixels P1, P2. FIG. 6 shows an example of the configuration of the imaging pixel N. FIG. 7 shows an example of the configuration of the phase difference pixels P1, P2. The phase difference pixels P1, P2 receive one of the light fluxes divided in the X direction around the principal ray, respectively.

[0056] As shown in Fig. 6, the imaging pixel N is composed of a photodiode D1 as a photoelectric conversion element, a color filter CF, and a microlens ML. The color filter CF is disposed between the photodiode D1 and the microlens ML.

[0057] The color filter CF is a filter that transmits light of any one of R (red), G (green), and B (blue). The microlens ML condenses the light beam LF incident from the exit pupil EP of the imaging lens 12 substantially at the center of the photodiode D1 via the color filter CF.

[0058] As shown in Fig. 7, the phase difference pixels P1 and P2 are each composed of a photodiode D1, a light shielding layer SF, and a microlens ML. The microlens ML condenses the light beam LF incident from the exit pupil EP of the imaging lens 12 substantially at the center of the photodiode D1, similar to the imaging pixel N.

[0059] The light shielding layer SF is formed of a metal film or the like and is disposed between the photodiode D1 and the microlens ML. The light shielding layer SF shields a part of the light beam LF incident on the photodiode D1 via the microlens ML.

[0060] In the phase difference pixel P1, the light shielding layer SF shields the negative side (first side) with respect to the X direction with reference to the center of the photodiode D1. That is, in the phase difference pixel P1, the light shielding layer SF allows the light beam LF from the exit pupil EP1 on the first side to be incident on the photodiode D1 and shields the light beam LF from the exit pupil EP2 on the positive side (second side) with respect to the X direction.

[0061] In the phase difference pixel P2, the light shielding layer SF shields the positive side (second side) with respect to the X direction with reference to the center of the photodiode D1. That is, in the phase difference pixel P2, the light shielding layer SF allows the light beam LF from the exit pupil EP2 on the second side to be incident on the photodiode D1 and shields the light beam LF from the exit pupil EP1 on the negative side (first side) with respect to the X direction.

[0062] (Pixel Array) FIG. 8 shows an example of the pixel array of the imaging sensor 20. The color arrangement of the color filter CF shown in FIG. 8 is a so-called Bayer array. The Bayer array is a color arrangement in which out of four 2×2 pixels, G color filters CF are arranged in two diagonal pixels, and R and B color filters CF are arranged in the other two pixels. In FIG. 8, “R” represents an imaging pixel N provided with an R color filter CF. “G” represents an imaging pixel N provided with a G color filter CF. “B” represents an imaging pixel N provided with a B color filter CF. Note that the color arrangement of the color filter CF is not limited to the Bayer array, and other color arrangements may be used.

[0063] The phase difference pixels P1 and P2 are arranged in the imaging region 21 by replacing some of the imaging pixels N in the Bayer array. The phase difference pixels P1 and P2 are arranged in the X direction. For example, the phase difference pixels P1 and P2 are arranged such that one of them is arranged every three pixels (i.e., every other pixel) in the X direction. That is, two imaging pixels N (B and G) are arranged between the phase difference pixel P1 and the phase difference pixel P2.

[0064] The phase difference pixels P1 and P2 are arranged every 18 pixels in the Y direction. A plurality of imaging pixels N (R and G) are arranged between the phase difference pixels P1 arranged in the Y direction. A plurality of imaging pixels N (B and G) are arranged between the phase difference pixels P2 arranged in the Y direction.

[0065] Note that the arrangement pattern of the phase difference pixels P1 and P2 is not limited to the example shown in FIG. 8. For example, the phase difference pixels P1 and P2 may be arranged adjacent to each other in the X direction.

[0066] Reference numeral R1 represents a first phase difference pixel region in which a plurality of phase difference pixels P1 and P2 are arranged in the X direction. Similarly, reference numeral R2 represents a first phase difference pixel region in which a plurality of phase difference pixels P1 and P2 are arranged in the X direction. The first phase difference pixel region R1 and the second phase difference pixel region R2 are arranged in the Y direction with an imaging pixel region RA including only imaging pixels N therebetween.

[0067] The first phase difference pixel region R1 and the second phase difference pixel region R2 have the same pixel configuration. In the video imaging mode, the scanning timings of the first phase difference pixel region R1 and the second phase difference pixel region R2 by the vertical scanning circuit 22 are different, and signals are not read within the same frame period (see FIG. 10). That is, the first phase difference pixel region R1 and the second phase difference pixel region R2 are in an interlaced readout method, and signals are read alternately every frame period.

[0068] FIG. 9 shows the pixels from which signals are read in the video imaging mode. The first phase difference pixel region R1 and the second phase difference pixel region R2 are alternately arranged in the Y direction with the imaging pixel region RA interposed therebetween. In the video imaging mode, for the imaging pixel region RA, the first phase difference pixel region R1, and the second phase difference pixel region R2, resetting and signal readout are performed independently of each other.

[0069] In this embodiment, pixel decimation readout is performed for the imaging pixel region RA. For the imaging pixel region RA, pixels are decimated every three rows. The pixels hatched in FIG. 9 are the pixels for which signal readout is not performed.

[0070] (Imaging Timing) FIG. 10 shows an example of the imaging timing of the imaging sensor 20 in the video imaging mode. The frame period T of video imaging is defined by the vertical synchronization signal VD supplied from the imaging control unit 51 to the vertical scanning circuit 22. Based on the vertical synchronization signal VD, the vertical scanning circuit 22 supplies a row selection signal SEL and a reset signal RST to the imaging pixel region RA, the first phase difference pixel region R1, and the second phase difference pixel region R2 independently.

[0071] The vertical scanning circuit 22 supplies the row selection signal SEL to the imaging pixel region RA, the first phase difference pixel region R1, and the second phase difference pixel region R2 in synchronization with the vertical synchronization signal VD. The vertical scanning circuit 22 supplies the row selection signal SEL to the imaging pixel region RA every frame period T. The vertical scanning circuit 22 supplies the row selection signal SEL to the first phase difference pixel region R1 and the second phase difference pixel region R2 at a period twice that of the frame period T (a period twice that of the frame period T). Note that the phase of the row selection signal SEL supplied to the first phase difference pixel region R1 is shifted from the phase of the row selection signal SEL supplied to the second phase difference pixel region R2 by one frame period T.

[0072] The vertical scanning circuit 22 supplies the reset signal RST according to the exposure time of each of the imaging pixel region RA, the first phase difference pixel region R1, and the second phase difference pixel region R2. The exposure time is the time from when the reset signal RST is input until the row selection signal SEL is input in each row (i.e., the charge accumulation time). The exposure period is shifted for each row. That is, the imaging sensor 20 performs exposure with an electronic shutter of the focal plane method. Note that the hatched period in FIG. 10 is the light shielding period. Reset may be repeatedly executed during the light shielding period.

[0073] Signal reading is performed for the imaging pixel region RA every frame period T. Therefore, the exposure time of the imaging pixel region RA (hereinafter referred to as the imaging exposure time) E RA is set to be less than the frame period T (i.e., E RA < T). For example, the imaging exposure time E RA corresponds to the shutter speed set by the operation of the operation unit 42. Also, the imaging exposure time E RA corresponds to the shutter speed determined by the automatic exposure mode.

[0074] Signal reading is performed for the first phase difference pixel region R1 at a period twice that of the frame period T. Therefore, the exposure time of the first phase difference pixel region R1 (hereinafter referred to as the first exposure time) E R1 is set to be less than twice the frame period T (i.e., E R1It is set to <2T). For example, the first exposure time E R1 is a fixed value. Note that the first exposure time E R1 may be a value that changes in conjunction with the imaging exposure time E RA . The first exposure time E R1 is different from the imaging exposure time E RA , and for example, E RA < E R1 < 2T, and is set to a value that satisfies this relationship.

[0075] Similar to the first phase difference pixel region R1, the second phase difference pixel region R2 has signal readout performed at a period that is twice the frame period T. Therefore, the exposure time of the second phase difference pixel region R2 (hereinafter referred to as the second exposure time) E R2 is set to less than twice the frame period T (i.e., E R2 < 2T). For example, the second exposure time E R2 is a fixed value. Note that the second exposure time E R2 may be a value that changes in conjunction with the imaging exposure time E RA . The second exposure time E R2 is different from the imaging exposure time E RA , and for example, E RA < E R2 < 2T, and is set to a value that satisfies this relationship.

[0076] In this embodiment, the first exposure time E R1 is equal to the second exposure time E R2 (i.e., E R1 = E R2 ). Also, the first exposure time E R1 and the second exposure time E R2 each exceed the frame period T (i.e., T ≤ E R1 , T ≤ E R2 ). Note that the first exposure time E R1 and the second exposure time E R2 may be different from each other.

[0077] As shown in FIG. 10, the period for reading a signal from the first phase difference pixel region R1 is defined as the first frame period, and the period for reading a signal from the second phase difference pixel region R2 is defined as the second frame period. The signal reading from the imaging pixel region RA is performed in any one of the first frame period and the second frame period. In the present embodiment, immediately after the signal reading from the imaging pixel region RA is completed in the first frame period, the signal reading from the second phase difference pixel region R2 in the second frame period is started. Also, immediately after the signal reading from the imaging pixel region RA is completed in the second frame period, the signal reading from the first phase difference pixel region R1 in the first frame period is started.

[0078] (Focus adjustment control) Next, the focus adjustment control in the video imaging mode will be described with reference to the flowchart shown in FIG. 11. First, the main control unit 50 determines whether there is an instruction to start video imaging by an operation of the operation unit 42 (step S10).

[0079] When the main control unit 50 determines that there is an instruction to start video imaging (step S10: YES), it controls the imaging control unit 51 to cause the imaging sensor 20 to perform an imaging operation at a frame period T and execute the first reading process (step S11). The first reading process is a process of reading a signal from the first phase difference pixel region R1 during the first frame period.

[0080] When the first reading process is completed, the main control unit 50 performs phase difference method focus adjustment based on the signals output from the phase difference pixels P1 and P2 included in the first phase difference pixel region R1 (step S12). Specifically, the main control unit 50 adjusts the position of the focus lens 31 so that the phase difference between the image based on the signal output from the phase difference pixel P1 and the image based on the signal output from the phase difference pixel P2 is reduced.

[0081] Next, the main control unit 50 causes the imaging sensor 20 to execute a second readout process (step S13). The second readout process is a process of reading a signal from the second phase difference pixel region R2 during a second frame period following the first frame period.

[0082] When the second readout process is completed, the main control unit 50 performs phase difference focusing based on the signals output from the phase difference pixels P1 and P2 included in the second phase difference pixel region R2 (step S14). The process of step S14 is the same as the process of step S12.

[0083] Next, the main control unit 50 determines whether there is an instruction to end video imaging due to an operation of the operation unit 42 (step S15). When the main control unit 50 determines that there is no instruction to end video imaging (step S15: NO), the process proceeds to step S11, and the main control unit 50 causes the imaging sensor 20 to execute the first readout process. On the other hand, when the main control unit 50 determines that there is an instruction to end video imaging (step S15: YES), the process ends.

[0084] As described above, in the focusing control of the present embodiment, the first readout process and the second readout process are repeatedly executed. In the present embodiment, since the first phase difference pixel region R1 and the second phase difference pixel region R2 independently perform signal readout at a period twice the frame period T, the first exposure time E R1 and the second exposure time E R2 can each exceed the frame period T (that is, T ≤ E R1 , T ≤ E R2 ). That is, according to the present embodiment, the exposure time of the phase difference pixels P1 and P2 can exceed the frame period T, and signals can be read from the phase difference pixels P1 and P2 every frame period T.

[0085] Since the phase difference pixels P1 and P2 each have a light shielding layer SF, the amount of received light is smaller than that of the imaging pixels N (see FIGS. 6 and 7). If the first exposure time E R1 and the second exposure time E R2 are each set to the imaging exposure time E RAIf it is made equal, the light reception amounts of the phase difference pixels P1 and P2 are small, resulting in a decrease in the accuracy of focus adjustment. On the other hand, according to the present embodiment, the first exposure time E R1 and the second exposure time E R2 can be made longer than the imaging exposure time E RA respectively, and can even be made longer than the frame period T. Therefore, the light reception amounts of the phase difference pixels P1 and P2 increase. As a result, the accuracy of focus adjustment is improved. The first embodiment is particularly suitable when the imaging exposure time is short (that is, when the set frame rate is high or the shutter speed is fast).

[0086] Note that the above focus adjustment is not limited to the video imaging mode in which video data is recorded in the memory 45 or the like, and can also be applied to the live view display mode in which video data is not recorded and is displayed in real time on the display 15 or the viewfinder.

[0087] [Second Embodiment] Next, the second embodiment will be described. The second embodiment is different from the first embodiment in the focus adjustment control in the video imaging mode.

[0088] FIG. 12 shows an example of imaging timing in the video imaging mode according to the second embodiment. In the present embodiment, the imaging sensor 20 executes the above-described first read process twice based on the control of the main control unit 50, and executes the above-described second read process once each time the first read process is executed twice. Therefore, in the present embodiment, following the second frame period, the first frame period continues twice in a row.

[0089] In the present embodiment, the second exposure time E R2 is 2 times or more and less than 3 times the frame period T (that is, 2T ≤ E R2 < 3T), and the first read process is executed twice during the exposure period of the second phase difference pixel region R2. Also, the first exposure time E R1 is less than the frame period T.

[0090] Thus, in this embodiment, the signal from the first phase difference pixel region R1 exposed for a first exposure time E less than the frame period T R1 and the signal from the second phase difference pixel region R2 exposed for a second exposure time E equal to or greater than twice the frame period T R2 can be obtained. In this embodiment, the main control unit 50 can perform focus adjustment control according to the brightness of the subject based on the signals of the phase difference pixels P1 and P2 with significantly different exposure times.

[0091] The main control unit 50 may perform focus adjustment by selecting either the signal of the long-time exposure or the signal of the short-time exposure according to the brightness of the subject. Alternatively, the main control unit 50 may perform focus adjustment based on the added signal of the long-time exposure signal and the short-time exposure signal. Note that the brightness of the subject may be detected based on the signal read from the imaging pixel region RA. The focus adjustment control of this embodiment is preferably executed when the brightness difference of the subject is large (i.e., the dynamic range is wide).

[0092] In FIG. 12, although the two consecutive first exposure times E R1 are equal, it is possible to make one of the two first exposure times E R1 longer than the other.

[0093] FIG. 13 shows an example of imaging timing in the video imaging mode according to a modification of the second embodiment. In this modification, the first exposure time E R1 of the first phase difference pixel region R1 where signal reading is performed during the first frame period following the second frame period is set to be greater than the frame period T (i.e., T ≤ E R1 ). Thus, in this modification, three exposure times can be set: a second exposure time E R2 equal to or greater than twice the frame period T, a first exposure time E R1 greater than the frame period T, and a first exposure time E R1 less than the frame period T.

[0094] Note that in the second embodiment, the second exposure time E R2is set to be not less than twice and less than three times the frame period T, while the second exposure time E R2 can also be set to be not less than twice the frame period T. The second exposure time E R2 When it is set to be not less than K times and less than K + 1 times the frame period T, the first readout process is executed K times during the exposure period of the second phase difference pixel region R2, and the second readout process may be executed once each time the first readout process is executed K times. Here, K is an integer of 2 or more.

[0095] Also, when the focus adjustment control of the first embodiment (see FIG. 10) is set as the first mode and the focus adjustment control of the second embodiment (see FIG. 12) is set as the second mode, it may be possible to switch between the first mode and the second mode. For example, the main control unit 50 may be configured to switch between the first mode and the second mode according to the brightness of the subject.

[0096] FIG. 14 is a flowchart showing an example of the switching process between the first mode and the second mode. First, the main control unit 50 determines whether there is an instruction to start video imaging by an operation of the operation unit 42 (step S20).

[0097] When the main control unit 50 determines that there is an instruction to start video imaging (step S20: YES), it detects the brightness of the subject based on the signal read from the imaging pixel region RA (step S21). Next, the main control unit 50 determines whether a dynamic range of a certain value or more is required (step S22). When the main control unit 50 determines that a dynamic range of a certain value or more is not required (step S22: NO), it selects the first mode (step S23). On the other hand, when the main control unit 50 determines that the dynamic range is a certain value or more (step S22: YES), it selects the second mode (step S24).

[0098] Next, the main control unit 50 determines whether there is an instruction to end video imaging by an operation on the operation unit 42 (step S25). When the main control unit 50 determines that there is no instruction to end video imaging (step S25: NO), the process proceeds to step S21 to detect the brightness of the subject. On the other hand, when the main control unit 50 determines that there is an instruction to end video imaging (step S25: YES), the process ends.

[0099] As described above, when the dynamic range is large, the second mode is selected. In the second mode, as described above, since the phase difference pixels P1 and P2 are exposed at a plurality of exposure times, even when the dynamic range is large, accurate focus adjustment can be performed based on the signals read from the phase difference pixels P1 and P2.

[0100] [Third Embodiment] Next, the third embodiment will be described. In the third embodiment, three phase difference pixel regions, i.e., a first phase difference pixel region R1, a second phase difference pixel region R2, and a third phase difference pixel region R3, are provided in the imaging sensor 20.

[0101] FIG. 15 shows the pixels from which signals are read in the video imaging mode in the third embodiment. In the third embodiment, the first phase difference pixel region R1, the second phase difference pixel region R2, and the third phase difference pixel region R3 are repeatedly arranged in the Y direction. In the Y direction, imaging pixel regions RA are arranged between the first phase difference pixel region R1 and the second phase difference pixel region R2, between the second phase difference pixel region R2 and the third phase difference pixel region R3, and between the third phase difference pixel region R3 and the first phase difference pixel region R1, respectively.

[0102] In the third embodiment, by performing reset and signal readout independently for each of the three phase difference pixel regions, the exposure time of the phase difference pixels P1 and P2 can be set to be not less than twice and less than three times the frame period T.

[0103] FIG. 16 shows an example of imaging timing according to the third embodiment. In this embodiment, the main control unit 50 sequentially selects the first phase difference pixel region R1, the second phase difference pixel region R2, and the third phase difference pixel region R3 every frame period T and reads out signals. In this embodiment, the first exposure time E R1 , the second exposure time E R2 , and the third exposure time E R3 are each different from the imaging exposure time E RA . The first exposure time E R1 , the second exposure time E R2 , and the third exposure time E R3 may be different from each other.

[0104] Note that it is also possible to provide four phase difference pixel regions in the imaging sensor 20. When providing N phase difference pixel regions from the first phase difference pixel region R1 to the Nth phase difference pixel region RN arranged in the Y direction in the imaging sensor 20, the main control unit 50 sequentially selects each of the phase difference pixel regions every frame period T and reads out signals. In this case, the main control unit 50 may set the exposure time of the phase difference pixel region to less than N times the frame period. Here, N is an integer of 3 or more.

[0105] [Fourth Embodiment] Next, the fourth embodiment will be described. In the fourth embodiment, it is possible to execute a third mode in which a repeated signal is read out only from the first phase difference pixel region R1 among the first phase difference pixel region R1 and the second phase difference pixel region R2.

[0106] FIG. 17 shows an example of imaging timing in the third mode. In the third mode, the main control unit 50 does not read out signals from the second phase difference pixel region R2 among the first phase difference pixel region R1 and the second phase difference pixel region R2 (see FIG. 9), and reads out signals from only the first phase difference pixel region R1 every frame period T. That is, the main control unit 50 can execute a third mode in which only the first readout process is repeated without performing the second readout process.

[0107] In this embodiment, the above-described first mode and third mode are configured to be switchable. For example, the main control unit 50 switches between the first mode and the third mode according to the moving speed of the subject. For example, the main control unit 50 detects the moving speed of the subject by obtaining the movement vector of the subject between frames based on the signal read from the imaging pixel region RA every frame period T.

[0108] In the first mode shown in the first embodiment, signals are read from different phase difference pixels P1 and P2 between frames, so high-resolution phase difference information can be obtained. Therefore, the first mode is particularly suitable for focus adjustment control in a situation where the movement of the subject is small. On the other hand, in the third mode, since the positions of the phase difference pixels P1 and P2 read between frames do not change, it is suitable for focus adjustment control in a situation where the movement of the subject is large.

[0109] FIG. 18 is a flowchart showing an example of the switching process between the first mode and the third mode. First, the main control unit 50 determines whether there is an instruction to start video imaging by an operation of the operation unit 42 (step S30).

[0110] When the main control unit 50 determines that there is an instruction to start video imaging (step S30: YES), it detects the moving speed of the subject based on the signal read from the imaging pixel region RA (step S31). Next, the main control unit 50 determines whether the detected moving speed is equal to or higher than a certain value (step S32). When the main control unit 50 determines that the moving speed is less than the certain value (step S32: NO), it selects the first mode (step S33). On the other hand, when the main control unit 50 determines that the moving speed is equal to or higher than the certain value (step S32: YES), it selects the third mode (step S34).

[0111] Next, the main control unit 50 determines whether or not there is an instruction to end video imaging by an operation on the operation unit 42 (step S35). When the main control unit 50 determines that there is no instruction to end video imaging (step S35: NO), the process proceeds to step S31 to detect the brightness of the subject. On the other hand, when the main control unit 50 determines that there is an instruction to end video imaging (step S35: YES), the process ends.

[0112] As described above, when the moving speed of the subject is high, the third mode is selected. In the third mode, since the positions of the phase difference pixels P1 and P2 read between frames do not change, accurate focus adjustment can be performed.

[0113] [First Modification Example of Imaging Sensor] Next, a first modification example of the imaging sensor 20 will be described. The imaging sensor 20 according to this modification example has an arrangement of the phase difference pixels P1 and P2 different from that of the first embodiment. Hereinafter, the configuration of the imaging sensor 20 according to this modification example will be described in comparison with the configuration of the imaging sensor 20 according to the first embodiment.

[0114] In the imaging sensor 20 according to the first embodiment, a pair of phase difference pixels P1 and P2 are included in each of the first phase difference pixel region R1 and the second phase difference pixel region R2 (see FIGS. 8 and 9). Hereinafter, the phase difference pixels P1 and P2 included in the first phase difference pixel region R1 are referred to as "a pair of first phase difference pixels P1 and P2". Also, the phase difference pixels P1 and P2 included in the second phase difference pixel region R2 are referred to as "a pair of second phase difference pixels P1 and P2".

[0115] In the first embodiment, since a pair of first phase difference pixels P1 and P2 are arranged in the same row, they are selected by the same row selection line L1 (see FIG. 5). Similarly, since a pair of second phase difference pixels P1 and P2 are arranged in the same row, they are selected by the same row selection line L1.

[0116] FIG. 19 shows an example of the pixel array of the imaging sensor 20 according to this modified example. In this modified example, two types of first phase difference pixel regions, a first phase difference pixel region R1a and a first phase difference pixel region R1b, are provided. Similarly, two types of second phase difference pixel regions, a second phase difference pixel region R2a and a second phase difference pixel region R2b, are provided.

[0117] The first phase difference pixel region R1a includes only the first phase difference pixel P1 among the pair of first phase difference pixels P1, P2. The first phase difference pixel region R1b includes only the first phase difference pixel P2 among the pair of first phase difference pixels P1, P2. In this modified example, the first phase difference pixel region R1a and the first phase difference pixel region R1b are arranged in the Y direction with the imaging pixel region RA interposed therebetween.

[0118] The second phase difference pixel region R2a includes only the second phase difference pixel P1 among the pair of second phase difference pixels P1, P2. The second phase difference pixel region R2b includes only the second phase difference pixel P2 among the pair of second phase difference pixels P1, P2. In this modified example, the second phase difference pixel region R2a and the second phase difference pixel region R2b are arranged in the Y direction with the imaging pixel region RA interposed therebetween.

[0119] In this modified example, since the pair of first phase difference pixels P1, P2 are arranged in different rows, they are respectively selected by two row selection lines L1 arranged in the Y direction. Similarly, since the pair of second phase difference pixels P1, P2 are arranged in different rows, they are respectively selected by two row selection lines L1 arranged in the Y direction.

[0120] The first phase difference pixel regions R1a, R1b and the second phase difference pixel regions R2a, R2b are repeatedly arranged in the Y direction with the imaging pixel region RA interposed therebetween.

[0121] FIG. 20 shows the pixels from which signals are read out in the video imaging mode in this modified example. In the video imaging mode, the first phase difference pixel regions R1a, R1b are read out in the first frame period. The second phase difference pixel regions R2a, R2b are read out in the second frame period. Other imaging operations are the same as those of the first embodiment.

[0122] Note that the first phase difference pixel region R1a and the first phase difference pixel region R1b may be provided adjacent to each other in the Y direction. Also, the second phase difference pixel region R2a and the second phase difference pixel region R2b may be provided adjacent to each other in the Y direction.

[0123] [Second Modification Example of Imaging Sensor] Next, a second modification example of the imaging sensor 20 will be described. The imaging sensor 20 according to this modification example is a so-called dual-pixel CMOS image sensor in which each pixel 26 is composed of two photodiodes.

[0124] FIG. 21 shows the pixel configuration of the imaging sensor 20 according to this modification example. In this modification example, the phase difference pixels and the imaging pixels have the same configuration. The pixel 26 includes a pair of photodiodes D1a, D1b, a color filter CF, and a microlens ML. The pair of photodiodes D1a, D1b are arranged adjacent to each other in the X direction below the color filter CF.

[0125] The photodiode D1a receives the light beam LF from the exit pupil EP1 among the exit pupils EP1, EP2 divided in the X direction. The photodiode D1b receives the light beam LF from the exit pupil EP2 among the exit pupils EP1, EP2 divided in the X direction.

[0126] Signals are read out from both of the pair of photodiodes D1a, D1b of the pixel 26, and the read signals are added to function as an imaging pixel. Also, the pixel 26 functions as a phase difference pixel when a signal is read out from one of the pair of photodiodes D1a, D1b.

[0127] The arrangements of the first phase difference pixel region R1, the second phase difference pixel region R2, and the imaging pixel region RA in this modification example are the same as those in the first embodiment (see FIGS. 8 and 9).

[0128] In this modification example, for at least some of the pixels 26 included in the first phase difference pixel region R1, the main control unit 50 reads a signal from one of the pair of photodiodes D1a and D1b. Similarly, for at least some of the pixels 26 included in the second phase difference pixel region R2, the main control unit 50 reads a signal from one of the pair of photodiodes D1a and D1b. Further, for the pixels 26 included in the imaging pixel region RA, the main control unit 50 reads signals from both of the pair of photodiodes D1a and D1b.

[0129] Note that all of the pixels 26 in the first phase difference pixel region R1 and the second phase difference pixel region R2 may function as phase difference pixels.

[0130] In each of the above embodiments and modification examples, the imaging sensor 20 is composed of the imaging region 21, the vertical scanning circuit 22, the line memory 23, the horizontal scanning circuit 24, and the output amplifier 25. However, the imaging sensor 20 may be composed of only the imaging region 21. The vertical scanning circuit 22, the line memory 23, the horizontal scanning circuit 24, and the output amplifier 25 may be provided in the processor 40.

[0131] Also, the above embodiments and modification examples can be combined with each other as long as no contradiction occurs.

[0132] In the above embodiment, as a hardware structure of the control unit taking the processor 40 as an example, the following various processors can be used. The above various processors include, in addition to the CPU which is a general-purpose processor that executes software (program) to function, processors such as FPGAs whose circuit configuration can be changed after manufacturing. The FPGA includes dedicated electric circuits and the like which are processors having a circuit configuration designed specifically for executing specific processing such as PLDs or ASICs.

[0133] The control unit may be composed of one of these various processors, or may be composed of a combination of two or more processors of the same type or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, multiple control units may be composed of one processor.

[0134] There are multiple examples of configuring multiple control units with one processor. In the first example, as represented by computers such as clients and servers, one processor is configured by a combination of one or more CPUs and software, and this processor functions as multiple control units. In the second example, as represented by a System On Chip (SOC), there is a form in which a processor that realizes the functions of the entire system including multiple control units is used on one IC chip. Thus, as a hardware structure, the control unit can be configured using one or more of the above various processors.

[0135] Furthermore, as a more specific hardware structure of these various processors, an electric circuit combining circuit elements such as semiconductor elements can be used.

[0136] The description content and illustration content shown above are detailed descriptions of the part related to the technology of the present disclosure and are only examples of the technology of the present disclosure. For example, the descriptions regarding the above configuration, function, action, and effect are descriptions regarding an example of the configuration, function, action, and effect of the part related to the technology of the present disclosure. Therefore, it goes without saying that within the scope not departing from the gist of the technology of the present disclosure, the description content and illustration content shown above may be modified by deleting unnecessary parts, adding new elements, or replacing them. Also, to avoid complication and facilitate the understanding of the part related to the technology of the present disclosure, the description regarding common technical knowledge that does not particularly require explanation for implementing the technology of the present disclosure is omitted in the description content and illustration content shown above.

[0137] All documents, patent applications, and technical standards described in this specification are incorporated herein by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually indicated to be incorporated by reference.

Explanation of Reference Numerals

[0138] 10 Imaging device 11 Main body 11A Camera-side mount 11B Electrical contact 11C Front surface 11D Rear surface 12 Imaging lens 12A Lens-side mount 12B Electrical contact 13 Dial 14 Release button 15 Display 16 Instruction key 18 Finder eyepiece 20 Imaging sensor 21 Imaging area 22 Vertical scanning circuit 23 Line memory 24 Horizontal scanning circuit 24A Horizontal output line 25 Output amplifier 26 Pixel 29 Transistor 30 Objective lens 31 Focus lens 32 Rear lens 33 Diaphragm 34 Lens drive control unit 40 Processor 42 Operation unit 45 Memory 45A Program 50 Main control unit 51 Imaging control unit 52 Image processing unit CF Color filter D1, D1a, D1b Photodiode EP, EP1, EP2 Exit pupil ER1 First exposure time ER2 Second exposure time ER3 Third exposure time ERA Exposure time for imaging L1 Row selection line L2 Row reset line L3 Column signal line LA Optical axis LF Light beam M1 Amplifier transistor M2 Pixel selection transistor M3 Reset transistor ML Microlens N Imaging pixel P1, P2 Phase difference pixels R1, R1a, R1b First phase difference pixel region R2, R2a, R2b Second phase difference pixel region R3 Third phase difference pixel region RA Imaging pixel region RST Reset signal S Pixel signal SEL Row selection signal SF Light shielding layer T Frame period VD Vertical synchronization signal

Claims

1. A processor and an imaging device, wherein the imaging device has a first phase difference pixel region and a second phase difference pixel region each including a plurality of phase difference pixels, and an imaging pixel region, the processor is configured to cause the imaging device to perform imaging in a frame period, during a first frame period, perform a first readout process of reading a signal from the first phase difference pixel region, and during a second frame period following the first frame period, perform a second readout process of reading a signal from the second phase difference pixel region, such that a part of a first exposure period during which the first phase difference pixel region is exposed and a part of a second exposure period during which the second phase difference pixel region is exposed overlap with each other, and the first readout process and the second readout process are alternately executed, a first exposure time during which the first phase difference pixel region is exposed and a second exposure time during which the second phase difference pixel region is exposed are different from an exposure time of the imaging pixel region, an imaging device.

2. The first exposure time and the second exposure time each exceed the frame period, The imaging device according to claim 1.

3. The first exposure time and the second exposure time are different from each other, The imaging device according to claim 1 or claim 2.

4. The processor is configured to execute a first mode in which the first exposure time and the second exposure time are each less than twice the frame period, The imaging device according to any one of claims 1 to 3.

5. A processor and an imaging device, wherein the imaging device has a first phase difference pixel region and a second phase difference pixel region each including a plurality of phase difference pixels, and an imaging pixel region, the processor is configured to cause the imaging device to perform imaging in a frame period, during a first frame period, perform a first readout process of reading a signal from the first phase difference pixel region, and during a second frame period following the first frame period, perform a second readout process of reading a signal from the second phase difference pixel region, a first exposure time during which the first phase difference pixel region is exposed and a second exposure time during which the second phase difference pixel region is exposed are different from an exposure time of the imaging pixel region, the processor is configured to alternately execute the first readout process and the second readout process, and execute a first mode in which the first exposure time and the second exposure time are each less than twice the frame period. When K is an integer of 2 or more, the second exposure time is set to be K times or more and less than K + 1 times the frame period, the first readout process is executed K times during the exposure period of the second phase difference pixel region, and the second readout process is executed once each time the first readout process is executed K times, enabling a second mode. Imaging device.

6. In the second mode, the first exposure time is less than the frame period. The imaging device according to claim 5.

7. The processor switches between the first mode and the second mode according to the brightness of the subject. The imaging device according to claim 5 or claim 6.

8. The processor enables a third mode in which the second readout process is not performed and only the first readout process is repeated. The imaging device according to any one of claims 5 to 7.

9. The processor switches between the first mode and the third mode according to the moving speed of the subject. The imaging device according to claim 8.

10. A driving method of an imaging device including an imaging element, the imaging element having a first phase difference pixel region and a second phase difference pixel region each including a plurality of phase difference pixels and an imaging pixel region, comprising: causing the imaging element to perform imaging at a frame period; alternately executing a first readout process of reading a signal from the first phase difference pixel region and a second readout process of reading a signal from the second phase difference pixel region during a second frame period following the first frame period, such that a part of the first exposure period during which the first phase difference pixel region is exposed and a part of the second exposure period during which the second phase difference pixel region is exposed overlap; the first exposure time during which the first phase difference pixel region is exposed and the second exposure time during which the second phase difference pixel region is exposed are different from the exposure time of the imaging pixel region. Driving method of an imaging device.

11. A program for operating an imaging device including an imaging element, the imaging element having a first phase difference pixel region and a second phase difference pixel region each including a plurality of phase difference pixels and an imaging pixel region, comprising: causing the imaging element to perform imaging at a frame period; During the first frame period, a first readout process for reading a signal from the first phase difference pixel region and, during a second frame period following the first frame period, a second readout process for reading a signal from the second phase difference pixel region are alternately executed such that a part of a first exposure period during which the first phase difference pixel region is exposed and a part of a second exposure period during which the second phase difference pixel region is exposed overlap each other. A first exposure time during which the first phase difference pixel region is exposed and a second exposure time during which the second phase difference pixel region is exposed are different from the exposure time of the imaging pixel region. Program.

Images