Imaging apparatus and method for controlling the same

Abstract

To provide an imaging apparatus that can prevent reduction of a frame rate while preventing an increase in the cost of the apparatus even if the amount of data read from an imaging device is increased.SOLUTION: The imaging apparatus comprises: a pixel unit in which unit pixels each having one micro-lens and a plurality of photoelectric conversion units are arranged in matrix; a reading unit that reads signals from the pixel unit, and that can perform a first reading operation of reading a mixed signal obtained by mixing signals from the plurality of photoelectric conversion units of the unit pixels and a second reading operation of a non-mixed signal in which the signals from the plurality of photoelectric conversion units of the unit pixels are not mixed; a dividing unit that divides the signals obtained through the first reading operation and the second reading operation into signals for picked-up images and signals for focus detection; a first output unit that outputs the signals for picked-up images obtained through the division by the dividing unit; and a second output unit that outputs the signals for focus detection obtained through the division by the dividing unit.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an imaging device and a control method thereof.

Background Art

[0002] In recent years, in imaging devices, higher pixel counts, faster readout speeds, and improved frame rates have been progressing. In addition to generating images such as still images and moving images, control such as focus adjustment is also performed using signals obtained from the imaging element.

[0003] For example, Patent Document 1 discloses a technique capable of pupil division type focus detection using signals obtained from an imaging element. Specifically, each pixel of the imaging element includes one microlens and two photodiodes, and each photodiode receives light that has passed through different pupil regions of the imaging lens. Focus detection can be achieved by comparing the output signals from these two photodiodes. It is also possible to generate an imaging image by adding the output signals from the two photodiodes.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, when each unit pixel has a plurality of photodiodes as in Patent Document 1, the amount of data read from the pixel increases, and the time required for signal readout becomes longer. In addition to higher pixel counts, faster readout speeds, and improved frame rates, the generation of focus detection data increases the data transmission amount per unit time transmitted from the imaging element to the signal processing IC. An increase in the data transmission amount per unit time leads to a decrease in the frame rate.

[0006] In order to cope with an increase in data transmission volume, if one attempts to widen the bandwidth of data transmission or improve the processing capacity of a signal processing IC, the chip costs of the imaging device and the signal processing IC will increase.

[0007] The present invention has been made in view of the above-described problems, and an object thereof is to provide an imaging device capable of suppressing a decrease in the frame rate while suppressing an increase in the cost of the device even when the amount of read data from the imaging device increases.

Means for Solving the Problems

[0008] The imaging device according to the present invention includes a pixel unit in which unit pixels each having one microlens and a plurality of photoelectric conversion units are arranged in a matrix, and a reading unit that reads a signal from the pixel unit. The reading unit is capable of performing a first reading operation of reading a mixed signal obtained by mixing signals of the plurality of photoelectric conversion units of the unit pixel and a second reading operation of reading an unmixed signal that does not mix signals of the plurality of photoelectric conversion units of the unit pixel. The imaging device further includes a distribution unit that distributes the signals obtained by the first reading operation and the second reading operation to a signal for an imaging image and a signal for focus detection, a first output unit that outputs the signal for the imaging image distributed by the distribution unit, and a second output unit that outputs the signal for focus detection distributed by the distribution unit.

Effects of the Invention

[0009] According to the present invention, there is provided an imaging device capable of suppressing a decrease in the frame rate while suppressing an increase in the cost of the device even when the amount of read data from the imaging device increases.

Brief Description of the Drawings

[0010]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Embodiments for Carrying Out the Invention

[0011] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the invention according to the claims. Although a plurality of features are described in the embodiments, not all of these plurality of features are essential to the invention, and the plurality of features may be arbitrarily combined. Further, in the accompanying drawings, the same or similar configurations are denoted by the same reference numerals, and redundant descriptions are omitted.

[0012] (First Embodiment) FIG. 1 is a diagram showing the configuration of an imaging device 100 according to the first embodiment of the present invention.

[0013] The photographic lens 101 is composed of an interchangeable lens unit or the like that can be attached to the imaging device 100, guides light from the subject to the imaging element unit 102, and forms a subject image on the pixels of the imaging element 102a (see FIG. 2) included in the imaging element unit 102.

[0014] The imaging element unit 102 includes an imaging element 102a such as a CMOS image sensor that outputs an image signal in response to incident light, a printed circuit board on which the imaging element 102a is mounted, a power supply for driving the imaging element 102a, and the like. More specifically, the imaging element unit 102 includes a photoelectric conversion unit 103, a readout unit 104, and a data distribution unit 105 that distributes the read data into imaging image data and focus detection data. Further, it includes a compression unit 106 that encodes the imaging image data, an output I / F (interface) unit (first output unit) 107 that sends the imaging image data, a resizing unit 108 that resizes the focus detection data, and a compression unit 109 that encodes the focus detection data. Furthermore, it includes a memory 110 and an output I / F (interface) unit (second output unit) that sends the focus detection data.

[0015] Also, the imaging device 100 includes, for example, an image processing unit 201 and an image processing unit 301 that are configured by separate image processing ICs. Further, it includes a control unit 312 that controls the overall operation of the imaging device 100. The control unit 312 controls the entire imaging device 100 by expanding and executing the control program stored in the ROM 314 in the RAM 316.

[0016] The photoelectric conversion unit 103 includes a photodiode or the like, receives incident light, and converts it into an electrical signal. The readout unit 104 converts the analog signal output by the photoelectric conversion unit 103 into a digital signal. Details of these parts will be described with reference to FIGS. 2 and 3.

[0017] FIG. 2 is a diagram schematically showing the pixel arrangement of the imaging element 102a.

[0018] As shown in FIG. 2, in the pixel portion of the imaging element 102a, unit pixels 400 are arranged in a matrix (row and column) shape, and R (Red) / G (Green) / B (Blue) color filters are arranged in a Bayer pattern for each unit pixel 400.

[0019] Further, within each unit pixel 400, sub-pixels a and sub-pixels b are respectively arranged, and photodiodes 401a and 401b are arranged in sub-pixels a and b respectively. Each signal (unmixed signal) output from sub-pixels a and b is used for focus detection, and the mixed signal of a and b, which is the signal obtained by mixing the signals output from sub-pixels a and b, is used for image generation.

[0020] FIG. 3 is a diagram schematically showing the relationship between the light beam emitted from the exit pupil of the photographing lens 101 and the unit pixel 400. In FIG. 3, the same parts as those in FIG. 2 are denoted by the same reference numerals.

[0021] As shown in FIG. 3, on the imaging device 102, a color filter 501 and a microlens 502 are formed on each unit pixel 400.

[0022] The light that has passed through the exit pupil 503 of the photographing lens enters the unit pixel 400 around the optical axis 504. The light beam that passes through the pupil region 505, which is a part of the exit pupil 503 of the photographing lens 101, is received by the sub-pixel a through the microlens 502. On the other hand, the light beam that passes through the pupil region 506, which is another part of the exit pupil 503, is received by the sub-pixel b through the microlens 502.

[0023] Therefore, the sub-pixels a and b receive the light from different pupil regions 505 and 506 of the exit pupil 503 of the photographing lens 101, respectively. For this reason, by comparing the output signals of the sub-pixels a and b, phase difference type focus detection becomes possible. The signal of the sub-pixel a is obtained from a plurality of unit pixels arranged in the matrix direction, and the subject image constituted by these output signal groups is defined as the image signal A. The signal of the sub-pixel b is obtained from a plurality of unit pixels arranged in the matrix direction, and the subject image constituted by these output signal groups is defined as the image signal B. A correlation operation is performed on the image signal A and the image signal B to detect the amount of image shift (pupil division phase difference). Further, by multiplying the amount of image shift by the conversion coefficient determined from the focal position of the photographing lens 101 and the optical system, the focal position corresponding to an arbitrary subject position within the screen can be calculated. By controlling the focus position of the photographing lens 101 based on the focal position information calculated here, imaging plane phase difference AF (auto focus) becomes possible. Also, by defining the signal obtained by adding the image signal A and the image signal B as the image signal AB, this image signal AB can be used for a normal photographed image.

[0024] FIG. 4 is a diagram showing the circuit configuration of a unit pixel of the imaging device.

[0025] In FIG. 4, the light incident on the photodiodes (photoelectric conversion units) 401a and 401b of the above-described sub-pixels a and b is photoelectrically converted by the photodiodes 401a and 401b, and charges corresponding to the exposure amount are accumulated in the photodiodes 401a and 401b.

[0026] By setting the control signals Txa and Txb applied to the gates of the transfer gates 402a and 402b to the High level, respectively, the charges accumulated in the photodiodes 401a and 401b are transferred to the FD (floating diffusion) unit 403.

[0027] The FD unit 403 is connected to the gate of a floating diffusion amplifier 404 (hereinafter referred to as an FD amplifier), and the amount of charge transferred from the photodiodes 401a and 401b is converted into a voltage value by the FD amplifier 404.

[0028] The reset switch 405 is a reset switch for resetting the FD section 403 and the photodiodes 401a and 401b. By setting the control signal Res applied to its gate to the high level, the FD section 403 is reset. When resetting the charges of the photodiodes 401a and 401b, the control signal Res and the control signals Txa and Txb are set to the high level simultaneously. As a result, both the transfer gates 402a and 402b and the reset switch 405 are turned on, and the photodiodes 401a and 401b are reset via the FD section 403.

[0029] By setting the control signal Sel applied to the gate of the pixel selection switch 406 to the high level, the pixel signal converted into a voltage value by the FD amplifier 404 is output to the ADC (AD converter) through the output line 402.

[0030] The FD amplifier 404 operates as a source follower amplifier in combination with a constant current source (not shown) connected to the output line 402.

[0031] The ADC block includes a comparator 407, an up / down counter (U / DCNT) 410, and a DAC (DA converter) 409.

[0032] One of the pair of input terminals of the comparator 407 is connected to the above-mentioned output line 402, and the other is connected to the DAC 409. The DAC 409 outputs a ramp signal whose level changes ramp-like based on a reference signal input from the timing control circuit 408. Then, the comparator 407 compares the level of the ramp signal input from the DAC 409 with the level of the image signal input from the output line 402. The timing control circuit 408 outputs a reference signal to the DAC 409 based on a command from the control unit 312 (see FIG. 1).

[0033] For example, when the level of the image signal is lower than the level of the ramp signal, the comparator 407 outputs a high-level comparison signal, and when the level of the image signal is higher than the level of the ramp signal, the comparator 407 outputs a low-level comparison signal.

[0034] The up-down counter 410 receives a clock for counting time from the timing control circuit 408 and is connected to the comparator 407. The up-down counter 410 counts the clock during, for example, the period when the comparison signal of the comparator 407 is at a high level or the period when it is at a low level. By this counting process, the output signal of each pixel 400 is converted into a digital value. The output signal converted into a digital signal is stored in the line memory 411.

[0035] Next, the read operation of the image signal A and the read operation of the image signal AB which is a mixed signal of the image signal A and the image signal B will be described. In the configuration of the present embodiment, it is possible to select whether to read only the image signal AB or to read the image signal A and the image signal AB for each row.

[0036] FIG. 5 shows a pixel region (Region_i) that performs both focus detection processing and image generation, and a pixel region (Region_c) that performs only image generation without performing focus detection processing, in the pixel region of the imaging element 102a described above.

[0037] From the rows of unit pixels included in the region Region_i indicated by the hatched portion, the image signal A and the image signal AB are read. From the rows of unit pixels included in the region Region_c which is a region other than the region Region_i, only the image signal AB is read, and this image signal is used only for image generation and not for focus detection calculation. It is also possible to set the entire region as a pixel region (Region_i) that performs both focus detection processing and image generation.

[0038] Next, the read operation of the signal of the imaging element 102a will be described with reference to FIG. 6. The charges are assumed to be already accumulated in the photodiodes 401a and 401b.

[0039] FIG. 6(a) is a timing chart of the read operation performed for each row of the region Region_c in FIG. 5.

[0040] Set the control signal Sel to the high level to turn on the pixel selection switch 406 of the unit pixel. Then, set the control signal Res to the low level to turn off the reset switch 405 and end the reset of the FD section 403.

[0041] Next, as a reference level before turning on the transfer gates 402a and 402b, the reference signal N is AD-converted based on the ramp signal of the DAC 409 and stored in the line memory 411. The operation of reading out the reference signal N is called N read. Also, the input section of the ADC has a sample-and-hold circuit (not shown) and can hold the signal level at the timings of N signal sampling and S signal sampling in Fig. 6(a).

[0042] Next, by setting the control signals Txa and Txb to the high level, the transfer gates 402a and 402b are turned on. By this operation, a signal obtained by mixing the charge signal accumulated in the photodiode 401a of the sub-pixel a and the charge signal accumulated in the photodiode 401b of the sub-pixel b is output to the output line 402 via the FD amplifier 404 and the pixel selection switch 406.

[0043] The signal on the output line 402 is input to the comparator 407, AD-converted based on the ramp signal of the DAC 409, the difference value from the previously recorded reference signal N is stored in the line memory 411, and the AB mixed signal (image signal AB) for one line is output to the data distribution section 105. Note that the operation of reading out the charge accumulated in the photodiode is called S read.

[0044] The above is the read operation for each row of the unit pixel in the region Region_c. As a result, the image signal AB is read out.

[0045] Subsequently, the read operation for each row of the region Region_i will be described with reference to Fig. 6(b). Fig. 6(b) is a timing chart of the operation until the image signal A and the image signal AB in one row of the region Region_i are read out.

[0046] The operation until the reference signal N is stored in the line memory 411 is the same as the operation described in Fig. 6(a).

[0047] When the storage of the reference signal N is completed, the transfer gate 402a is turned ON by setting the control signal Txa to the high level. By such an operation, the signal accumulated in the photodiode 401a of the sub-pixel a is output to the column output line 402 via the FD amplifier 404 and the pixel selection switch 406.

[0048] The image signal A output to the column output line 402 is input to the comparator 407, is AD-converted based on the ramp signal of the DAC 409, and the difference value from the previously recorded reference signal N is stored in the line memory 411. Then, the signal (image signal A) of the sub-pixel a for one row is output to the data distribution unit 105.

[0049] The control signal res remains at the low level and the control signal sel remains at the high level, and the reading of the image signal A is completed. As a result, the image signal A on the FD unit 403 is not reset but is held.

[0050] When the reading of the image signal A is completed, the operation proceeds to the reading operation of the image signal AB. The transfer gates 402a and 402b are turned ON by setting the control signals Txa and Txb to the high level. By such an operation, the signal accumulated in the photodiode 402b of the sub-pixel b is mixed with the signal of the sub-pixel a held in the FD unit 403, and the mixed signal is output to the column output line 402 via the FD amplifier 404 and the pixel selection switch 406. The subsequent part is the same as the operation of the region Region_c described with reference to Fig. 6(a).

[0051] As described above, the reading operation of each row in the region Region_i is completed. As a result, the image signal A and the image signal AB are sequentially read out. Note that the image signal B is obtained by subtracting the image signal A from the image signal AB.

[0052] Here, return to the description of FIG. 1. The data distribution unit 105 distributes the read data into imaging image data and focus detection data. Specifically, the data distribution unit 105 sends only the read image signal AB as imaging image data to the compression unit 106. Also, the data distribution unit 105 sends the image signal A and the image signal AB read from the pixel region (Region_i) where the focus detection process is performed as focus detection signals to the resizing unit 108. When focus detection is not required, it is also possible not to send the focus detection data from the data distribution unit 105 to the resizing unit 108. This enables sending the focus detection data only once for a plurality of frames during continuous shooting and the like.

[0053] The compression unit 106 performs compression encoding on the imaging image data sent from the data distribution unit 105 in a predetermined manner. The output I / F unit 107 transmits the imaging image data encoded by the compression unit 106 to the input I / F (interface) unit 202 of the image processing unit 201 via the transmission path 112.

[0054] Since the output I / F unit 107, the transmission path 112, and the input I / F unit 202 send the imaging image data, a relatively high-speed (fast communication speed) I / F (interface) is required. In order to cope with the increasing pixel count, faster readout speed, and improved frame rate required by recent imaging devices, high-speed transmission is necessary. For high-speed signal transmission, it is advisable to adopt an I / F and a transmission path corresponding to methods such as simply increasing the frequency or PAM (Pulse Amplitude Modulation) 4 transmission that can increase the number of bits that can be transmitted in 1UI (Unit Interval). Increasing the signal transmission frequency or supporting PAM4 transmission increases the chip cost of the imaging element, the transmission path, and the signal processing unit. If all the imaging image data and the focus detection data are sent by the output I / F unit 107 corresponding to the above high-speed transmission, the chip cost increases. Therefore, only the imaging image data is sent by this output I / F unit 107.

[0055] The resizing unit 108 resizes the focus detection data sent from the data distribution unit 105 in a predetermined manner. Regarding the resizing method, it is advisable to determine it based on the data transmission speed of the output I / F (interface) unit 111, the accuracy required for focus detection, etc. The compression unit 109 performs compression encoding on the resized focus detection data sent from the resizing unit 108 in a predetermined manner. The memory 110 can temporarily store the compression-encoded focus detection data for several frames, thereby enabling speed adjustment (adjustment of the processing speed) for the subsequent output I / F unit 111.

[0056] The output I / F unit 111 transmits the focus detection data stored in the memory 110 to the input I / F (interface) unit 306 of the image processing unit 301 via the transmission path 113.

[0057] The output I / F unit 111, the transmission path 113, and the input I / F unit 306 perform thinning reads and send the focus detection data reduced by the resizing unit, so they can handle even relatively low-speed (relatively slow communication speed) I / F (interfaces). Therefore, unlike the output I / F unit 107, the transmission path 112, and the input I / F unit 202, the output I / F unit 111, the transmission path 113, and the input I / F unit 306 can adopt relatively inexpensive circuits.

[0058] The image processing unit 201 includes an input I / F unit 202, an expansion unit 203, a data correction unit 204, an image processing circuit group 205, and a data transmission unit 206.

[0059] The image processing unit 301 is a different image processing unit from the image processing unit 201, and includes a data reception unit 302 that receives data from the image processing unit 201, a data correction unit 303, an image processing circuit group 304, a recording unit 305, an input I / F unit 306, an expansion unit 307, a phase difference detection unit 308, and a lens control unit 309.

[0060] For the image processing unit 201 and the image processing unit 301, for example, different image processing ICs are prepared respectively.

[0061] The input I / F unit 202 receives the imaging image data transmitted from the output I / F unit 107 via the transmission path 112. The input I / F unit 202 sends the acquired imaging image data to the decompression unit 203. In the decompression unit 203, the imaging image data compressed by the compression unit 106 is decoded. The decoded data is sent to the data correction unit 204. The data correction unit 204 performs various correction processes on the imaging image data acquired by the imaging element unit 102. For example, processes such as shading correction, gain correction, and defect correction are executed. The data after correction by the data correction unit 204 is output to the image processing circuit group 205. The image processing circuit group 205 performs white balance adjustment, noise removal processing, etc. on the output data of the data correction unit 204, and sends the processed imaging image data to the data transmission unit 206. The image processing unit 201 has a buffer memory (not shown), etc., and can adjust the speed of image processing (adjustment of processing speed) using the buffer memory as appropriate. The data transmission unit 206 sends the imaging image data to the data reception unit 302 of the image processing unit 301.

[0062] The data reception unit 302 receives the imaging image data from the data transmission unit 206 and sends it to the data correction unit 303. The data correction unit 303 performs various correction processes on the imaging image data. For example, processes such as shading correction, gain correction, and defect correction are executed. The imaging image data after correction by the data correction unit 303 is output to the image processing circuit group 304. Since the image processing unit 201 also has the data correction unit 204, the correction process may be performed by only one of the data correction unit 204 and the data correction unit 303, or the processes may be shared. The image processing circuit group 304 performs white balance adjustment, noise removal processing, etc. on the imaging image data output from the data correction unit 303, and sends it to the recording unit 305. Since the image processing unit 201 also has the image processing circuit group 205, the image processing may be performed by only one of the image processing circuit group 205 and the image processing circuit group 304, or the processes may be shared. The recording unit 305 records the imaging image data on the recording medium 310. The recording medium 310 includes, for example, memory cards such as SD cards and CF cards, stores image data, and is detachable from the imaging device 100.

[0063] The input I / F unit 306 receives the focus detection data transmitted from the output I / F unit 111 via the transmission path 113. The input I / F unit 306 sends the acquired focus detection data to the decompression unit 307. In the decompression unit 307, the focus detection data compressed by the compression unit 109 is decoded. The decoded data is sent to the phase difference detection unit 308. The phase difference detection unit 308 calculates the amount of focus deviation (defocus amount).

[0064] FIG. 7 is a diagram showing the correlation between the image signal waveform 701 obtained from the sub-pixel a and the image signal waveform 702 obtained from the sub-pixel b for different focus states.

[0065] As shown in FIG. 7(a), when out of the in-focus state, the image signal waveforms 701 and 702 obtained from the sub-pixels a and b respectively do not match and are in a largely deviated state. As it approaches the in-focus state, as shown in FIG. 7(b), the deviation between the respective image signal waveforms 701 and 702 becomes smaller, and in the in-focus state, the image signal waveforms 701 and 702 overlap. Thus, the phase difference detection unit 308 can calculate the amount of focus deviation (defocus amount) from the deviation amount between the image signal waveforms 701 and 702 obtained from the sub-pixels a and b.

[0066] Based on the information on the amount of focus deviation (defocus amount) calculated by the phase difference detection unit 308, the lens control unit 309 calculates the drive information of the optical system and controls the photographing lens 101.

[0067] Thus, according to the first embodiment, while suppressing an increase in the chip cost of the imaging device and the signal processing IC, it is possible to cope with an increase in the amount of data from the imaging device and perform focus detection and the like.

[0068] Also, in this embodiment, it is assumed that different image processing ICs are prepared for the image processing unit 201 and the image processing unit 301, but a configuration in which the two chips of the image processing unit 201 and the image processing unit 301 are in one package may also be used.

[0069] (Second Embodiment) In the second embodiment, only the image signal AB read by the data distribution unit 105 is sent to the compression unit 106 as data for the captured image, and only the image signal A read from the pixel region (Region_i) where the focus detection process is performed is sent to the resizing unit 108 as a focus detection signal.

[0070] The captured image data composed of the image signal AB sent to the image processing unit 201 is decompressed by the decompression unit 203. After that, the decompressed captured image data is sent to the image processing unit 301 via the data transmission unit 206 through the data correction unit 204 and the image processing circuit group 205, and stored in a buffer memory (not shown). The captured image data composed of the image signal AB stored in this buffer memory is processed by the subsequent data correction unit 303 and the image processing circuit group 304 to generate a captured image.

[0071] In parallel with this, the focus detection data composed of the image signal A sent to the image processing unit 301 is decompressed by the decompression unit 307, and the image signal B is obtained by subtracting it from the image signal AB stored in the above buffer memory. The phase difference can be detected from these image signals A and image signal B. By doing so, it becomes possible to further reduce the focus detection data. As described above, the preferred embodiments of the present invention have been described, but the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist thereof.

[0072] The disclosure of this specification includes the following imaging device and its control method.

[0073] (Item 1) A pixel unit in which unit pixels each having one microlens and a plurality of photoelectric conversion units are arranged in a matrix, Reading means for reading a signal from the pixel unit, the reading means being capable of performing a first reading operation for reading a mixed signal obtained by mixing signals of a plurality of photoelectric conversion units of the unit pixel and a second reading operation for reading an unmixed signal without mixing signals of a plurality of photoelectric conversion units of the unit pixel. Sorting means for sorting the signals obtained by the first reading operation and the second reading operation into a signal for an imaging image and a signal for focus detection, A first output unit that outputs a signal for an imaging image sorted by the sorting means, A second output unit that outputs a signal for focus detection sorted by the sorting means, An imaging device characterized by comprising:

[0074] (Item 2) Performing the first reading operation on the unit pixel in the first region of the pixel unit, reading the mixed signal, and performing the first reading operation and the second reading operation on a second region different from the first region of the pixel unit, and reading the mixed signal and the non-mixed signal. The imaging device according to item 1, characterized in that.

[0075] (Item 3) The sorting means sorts the mixed signal read from the first region to the first output unit, and sorts the mixed signal and the non-mixed signal read from the second region to the second output unit. The imaging device according to item 2, characterized in that.

[0076] (Item 4) The imaging device according to any one of items 1 to 3, further comprising first processing means for processing the signal for the imaging image output from the first output unit and second processing means for processing the signal for focus detection output from the second output unit.

[0077] (Item 5) The imaging device according to item 4, wherein the first processing means transmits the signal for the imaging image to the second processing means.

[0078] (Item 6) The imaging device according to item 5, wherein the second processing means records the signal for the imaging image on a recording medium.

[0079] (Item 7) The imaging device according to any one of Items 4 to 6, wherein the second processing means performs focus detection based on the signal for focus detection.

[0080] (Item 8) The imaging device according to any one of Items 1 to 7, wherein a communication speed for outputting a signal from the first output unit is higher than a communication speed for outputting a signal from the second output unit.

[0081] (Item 9) The imaging device according to any one of Items 1 to 8, further comprising resizing means for reducing the signal for focus detection before outputting the signal for focus detection from the second output unit.

[0082] (Item 10) The imaging device according to any one of Items 1 to 9, further comprising a memory for adjusting a processing speed in accordance with a communication speed of the second output unit.

[0083] (Item 11) The imaging device according to any one of Items 1 to 10, wherein the distributing means sends the signal for focus detection to the second output unit once for a plurality of frames.

[0084] (Item 12) A method for controlling an imaging device including a pixel unit in which unit pixels each having one microlens and a plurality of photoelectric conversion units are arranged in a matrix, the method comprising: a reading step of reading a signal from the pixel unit, the reading step including a first reading operation of reading a mixed signal obtained by mixing signals of the plurality of photoelectric conversion units of the unit pixel and a second reading operation of reading an unmixed signal that does not mix signals of the plurality of photoelectric conversion units of the unit pixel; a distributing step of distributing the signals obtained by the first reading operation and the second reading operation to a signal for an imaging image and a signal for focus detection; A first output step for outputting a signal for an imaging image sorted by the sorting step; A second output step for outputting a signal for focus detection sorted by the sorting step; A control method for an imaging device, characterized by comprising the above.

[0085] (Other embodiments) The present invention can also be realized by supplying a program for realizing one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (for example, ASIC) for realizing one or more functions.

[0086] The invention is not limited to the above embodiments, and various changes and modifications can be made without departing from the spirit and scope of the invention. Therefore, claims are attached to disclose the scope of the invention.

Explanation of reference numerals

[0087] 100: Imaging device, 101: Imaging lens, 102: Image sensor unit, 102a: Image sensor, 105: Data sorting unit, 107: Output I / F unit, 110: Memory, 111: Output I / F unit, 201: Image processing unit, 202: Input I / F unit, 301: Image processing unit, 305: Recording unit, 306: Input I / F unit, 308: Phase difference detection unit, 310: Recording medium, 312: Control unit

Claims

1. A pixel portion in which unit pixels each having one microlens and a plurality of photoelectric conversion portions are arranged in a matrix, Readout means for reading a signal from the pixel portion, the readout means being capable of performing a first readout operation for reading a mixed signal obtained by mixing signals of the plurality of photoelectric conversion portions of the unit pixel and a second readout operation for reading an unmixed signal without mixing signals of the plurality of photoelectric conversion portions of the unit pixel, Distribution means for distributing the signals obtained by the first readout operation and the second readout operation to a signal for an imaging image and a signal for focus detection, A first output unit that outputs a signal for an imaging image distributed by the distribution means, A second output unit that outputs a signal for focus detection distributed by the distribution means, An imaging device comprising the above.

2. The imaging device according to claim 1, wherein the first readout operation is performed on the unit pixels in a first region of the pixel portion to read the mixed signal, and the first readout operation and the second readout operation are performed on a second region different from the first region of the pixel portion to read the mixed signal and the unmixed signal.

3. The imaging device according to claim 2, wherein the distribution means distributes the mixed signal read from the first region to the first output unit, and distributes the mixed signal and the unmixed signal read from the second region to the second output unit.

4. The imaging device according to claim 1, further comprising first processing means for processing the signal for the imaging image output from the first output unit and second processing means for processing the signal for focus detection output from the second output unit.

5. The imaging device according to claim 4, wherein the first processing means transmits the signal for the imaging image to the second processing means.

6. The imaging device according to claim 5, wherein the second processing means records the signal for the imaging image on a recording medium.

7. The imaging device according to claim 4, wherein the second processing means performs focus detection based on the signal for focus detection.

8. The imaging device according to claim 1, wherein a communication speed for outputting a signal from the first output unit is faster than a communication speed for outputting a signal from the second output unit.

9. The imaging device according to claim 1, further comprising resizing means for reducing the focus detection signal before outputting the focus detection signal from the second output unit.

10. The imaging device according to claim 1, further comprising a memory for adjusting the processing speed in accordance with the communication speed of the second output unit.

11. The imaging device according to claim 1, wherein the distribution means sends the focus detection signal to the second output unit once for a plurality of frames.

12. A method for controlling an imaging device including a pixel unit in which unit pixels each having one microlens and a plurality of photoelectric conversion units are arranged in a matrix, a reading step of reading a signal from the pixel unit, the reading step including a first reading operation of reading a mixed signal obtained by mixing signals of the plurality of photoelectric conversion units of the unit pixel and a second reading operation of reading an unmixed signal that does not mix signals of the plurality of photoelectric conversion units of the unit pixel, a distribution step of distributing the signals obtained by the first reading operation and the second reading operation into a signal for an imaging image and a signal for focus detection, a first output step of outputting the signal for the imaging image distributed by the distribution step, a second output step of outputting the signal for focus detection distributed by the distribution step, characterized by including the above.

Images