Image sensor and image pickup device

Abstract

To provide an image pickup device with improved signal read speed.SOLUTION: An image pickup device 22 comprises: a first pixel and a second pixel receiving light transmitting through an optical system 31 and outputting a signal used for focus detection; a third pixel receiving the light transmitting the optical system and outputting a signal used for image formation; and an output part selecting at least one of the first pixel and the second pixel on the basis of information related to the optical system and outputting at least one of the signal of the first pixel selected and the signal of the second pixel selected at a timing different from that of signal of the third pixel.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an image pickup device and imaging device Regarding. [Background technology]

[0002] Image sensors that read out signals for focus detection and signals for image generation are known (see, for example, Patent Document 1). In such image sensors, there is a demand for faster signal readout. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2017-34606 Summary of the Invention

[0004] According to a first aspect of the invention, an imaging device includes: A first light-shielding portion is provided. optical system Different areas of the exit pupil It receives the light that passes through it and outputs a signal to be used for focus detection. do 1st pixel versus and a second light-shielding portion having an area different from that of the first light-shielding portion, and receiving light that has passed through different regions of an exit pupil of the optical system and outputting a signal used for focus detection; Second pixel versus and receiving light transmitted through the optical system and outputting a signal to be used for generating an image. do A third pixel and a signal of the third pixel Output At a different time, an exit pupil distance determined from information about the position of a set focus detection area among the first pixel pair and the second pixel pair and information about the optical system; Based on Selected, any on the other hand Signal of pixel pair and an output unit that outputs the signal. According to a second aspect of the invention, an imaging device includes the above-mentioned imaging element, The above on the other hand A focus detection unit that performs focus detection based on the signal of the pixel pair. And, it is equipped with. [Brief description of the drawings]

[0005] [Figure 1] 1 is a diagram illustrating an example of a configuration of an imaging device according to a first embodiment. [Diagram 2]1 is a diagram showing a focus detection area on an imaging surface of an imaging device according to a first embodiment. [Diagram 3] 2 is a diagram showing an example of pixel arrangement in a focus detection area of ​​the image pickup device according to the first embodiment. FIG. [Figure 4] 1 is a diagram illustrating an example of a pixel configuration in an imaging device according to a first embodiment. [Diagram 5] 2 is a cross-sectional view showing three types of AF pixel pairs arranged in a central region in the image pickup device according to the first embodiment. FIG. [Figure 6] 2 is a cross-sectional view showing three types of AF pixel pairs arranged in an area at a predetermined image height position in the imaging device according to the first embodiment. FIG. [Figure 7] 2 is a cross-sectional view showing three types of AF pixel pairs arranged in an area at a predetermined image height position in the imaging device according to the first embodiment. FIG. [Figure 8] 4 is a diagram showing the relationship between a reference exit pupil and an image height in the imaging device according to the first embodiment. FIG. [Figure 9] 1 shows various optical characteristics of an interchangeable lens in an imaging device according to a first embodiment, in which the exit pupil distance changes depending on the image height. [Figure 10] 3 is a diagram showing the relationship between the image height and the exit pupil in the imaging device according to the first embodiment. FIG. [Figure 11] 4 is a table showing focus position intervals in the imaging device according to the first embodiment and constant terms and coefficients of functions that approximate representative optical characteristic curves in the focus position intervals. [Figure 12] 4 is a table showing sections in the imaging device according to the first embodiment, and constant terms and coefficients of functions that approximate representative optical characteristic curves in the sections. [Figure 13] FIG. 2 is a diagram showing a threshold value related to the exit pupil distance, first to third exit pupil distance ranges, and an optical characteristic curve in the image pickup device according to the first embodiment. [Figure 14] 1 is a diagram showing a circuit configuration of a pixel of an image sensor according to a first embodiment. [Figure 15] FIG. 1 is a diagram showing a configuration of a portion of an imaging element according to a first embodiment. [Figure 16] 13 is a diagram showing an example of the configuration of an AF pixel in an imaging device according to a modified example. [Figure 17] 13 is a diagram showing an example of the configuration of an AF pixel in an imaging device according to a modified example. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0006] (First embodiment) 1 is a diagram showing an example of the configuration of an electronic camera 1 (hereinafter referred to as camera 1), which is an example of an imaging device according to a first embodiment. Camera 1 is made up of a camera body 2 and an interchangeable lens 3. As camera 1 is made up of the camera body 2 and the interchangeable lens 3, it is also sometimes called a camera system.

[0007] The camera body 2 is provided with a body side mount section 201 to which the interchangeable lens 3 is attached. The interchangeable lens 3 is provided with a lens side mount section 301 to which it is attached to the camera body 2. The lens side mount section 301 and the body side mount section 201 are provided with a lens side connection section 302 and a body side connection section 202, respectively. The lens side connection section 302 and the body side connection section 202 are each provided with a plurality of terminals, such as a terminal for a clock signal, a terminal for a data signal, and a terminal for power supply. The interchangeable lens 3 is detachably attached to the camera body 2 by the lens side mount section 301 and the body side mount section 201.

[0008] When the interchangeable lens 3 is attached to the camera body 2, a terminal provided on the body side connection part 202 is electrically connected to a terminal provided on the lens side connection part 302. This enables power to be supplied from the camera body 2 to the interchangeable lens 3 and communication between the camera body 2 and the interchangeable lens 3.

[0009] The interchangeable lens 3 includes a photographing optical system (imaging optical system) 31, a lens control unit 32, and a lens memory 33. The photographing optical system 31 includes a plurality of lenses, including a zoom lens (variable magnification lens) 31a that changes the focal length and a focus lens (focus adjustment lens) 31b, and an aperture 31c, and forms a subject image on the imaging surface 22a of the image sensor 22. Note that, although the zoom lens 31a and the focus lens 31b are illustrated in FIG. 1, a normal photographing optical system is generally composed of a large number of optical elements.

[0010] As described later, the photographing optical system 31 of the interchangeable lens 3 has an optical characteristic in which the position of its exit pupil, i.e., the exit pupil distance, changes depending on the image height. In other words, the exit pupil distance of the photographing optical system 31 changes depending on the position on the imaging plane 22a, i.e., the distance from the optical axis OA1 of the photographing optical system 31 on the imaging plane 22a. The optical axis OA1 of the photographing optical system 31 intersects with the imaging plane 22a at the center of the imaging plane 22a. It can also be said that the exit pupil distance of the photographing optical system 31 changes depending on the distance from the center of the imaging plane 22a. Here, the exit pupil distance is the distance between the exit pupil of the photographing optical system 31 and the image plane of the image by the photographing optical system 31. The imaging plane 22a of the image sensor 22 is, for example, a surface on which a photoelectric conversion unit, described later, is arranged, or a surface on which a microlens is arranged. Furthermore, the photographic optical system 31 differs depending on the type of interchangeable lens 3 attached to the body side mount portion 201. Therefore, the exit pupil distance of the photographic optical system 31 differs depending on the type of interchangeable lens 3. Furthermore, the optical characteristics of the exit pupil distance, which changes depending on the image height, also differ depending on the type of interchangeable lens 3.

[0011] The lens control unit 32 is configured with a processor such as a CPU, FPGA, or ASIC, and a memory such as a ROM or RAM, and controls each part of the interchangeable lens 3 based on a control program. The lens control unit 32 controls the position of the zoom lens 31a, the position of the focus lens 31b, and the drive of the aperture 31c based on a signal output from the body control unit 210 of the camera body 2. When a signal indicating the movement direction and movement amount of the focus lens 31b is input from the body control unit 210, the lens control unit 32 moves the focus lens 31b forward and backward in the direction of the optical axis OA1 based on the signal to adjust the focal position of the photographing optical system 31. The lens control unit 32 also controls the position of the zoom lens 31a and the opening diameter of the aperture 31c based on a signal output from the body control unit 210 of the camera body 2.

[0012] The lens memory 33 is composed of, for example, a non-volatile storage medium. Information related to the interchangeable lens 3 is stored (recorded) in the lens memory 33 as lens information. The lens information includes data on the optical characteristics (exit pupil distance and F-number) of the photographing optical system 31, data on the infinity position and close position of the focus lens 31b, and data on the shortest focal length and longest focal length of the interchangeable lens 3. The lens information differs depending on the type of the interchangeable lens 3. The lens information may be stored in an internal memory of the lens control unit 32. The lens information may be stored in a body memory 23 of the camera body 2 described later. In this case, the body memory 23 stores lens information of a plurality of interchangeable lenses 3.

[0013] In this embodiment, the lens information includes information on the exit pupil distance of the photographing optical system 31. The information on the exit pupil distance, which will be described later, includes information indicating the exit pupil distance (Co) at the position where the imaging surface 22a and the optical axis OA1 intersect (the position where the image height is zero), and information on coefficients (h4, h2) included in an arithmetic expression that represents the relationship between the exit pupil distance and the image height. Writing of data to the lens memory 33 and reading of data from the lens memory 33 are controlled by the lens control unit 32. When the interchangeable lens 3 is attached to the camera body 2, the lens control unit 32 transmits the lens information to the body control unit 210 via the terminals of the lens side connection unit 302 and the body side connection unit 202. In addition, the lens control unit 32 transmits position information (focal length information) of the controlled zoom lens 31a, position information of the controlled focus lens 31b, information on the F value of the controlled aperture 31c, and the like to the body control unit 210. In this embodiment, the lens control unit 32 functions as an output unit that transmits information regarding the exit pupil distance of the photographing optical system 31 to the camera body 2. The body control unit 210 functions as an input unit to which information regarding the exit pupil distance of the photographing optical system 31 is input from the interchangeable lens 3.

[0014] Furthermore, the lens control unit 32 communicates by sending and receiving information bidirectionally between the camera body 2 and the interchangeable lens 3 via the terminals of the lens side connection unit 302 and the body side connection unit 202. When a signal requesting transmission of information (h4, h2, Co) relating to the exit pupil distance is input from the camera body 2, the lens control unit 32 transmits the information relating to the exit pupil distance to the camera body 2. Note that the information relating to the exit pupil distance differs depending on the type of the interchangeable lens 3. Furthermore, the lens control unit 32 may transmit the information relating to the exit pupil distance to the camera body 2 every time the image sensor 22 captures an image. The lens control unit 32 may transmit the information relating to the exit pupil distance to the camera body 2 when the zoom lens 31a moves and the focal length of the photographing optical system 31 changes. The lens control unit 32 may transmit the information relating to the focal length of the photographing optical system 31 and the information relating to the exit pupil distance to the camera body 2 in one bidirectional communication.

[0015] Next, the configuration of the camera body 2 will be described. The camera body 2 includes an image sensor 22, a body memory 23, a display unit 24, an operation unit 25, and a body control unit 210. The image sensor 22 is a CMOS image sensor or a CCD image sensor. The image sensor 22 captures a subject image formed by a photographing optical system 31. The image sensor 22 has a plurality of pixels, each having a photoelectric conversion unit, arranged two-dimensionally (in row and column directions). The photoelectric conversion unit is composed of a photodiode (PD). The image sensor 22 photoelectrically converts received light in the photoelectric conversion unit to generate a signal, and outputs the generated signal to the body control unit 210.

[0016] As described later, the image sensor 22 has imaging pixels that output signals used for image generation, and AF pixels (focus detection pixels) that output signals used for focus detection. The imaging pixels include pixels (hereinafter referred to as R pixels) having filters with spectral characteristics that separate light in a first wavelength range (red (R) light) from the incident light, pixels (hereinafter referred to as G pixels) having filters with spectral characteristics that separate light in a second wavelength range (green (G) light) from the incident light, and pixels (hereinafter referred to as B pixels) having filters with spectral characteristics that separate light in a third wavelength range (blue (B) light) from the incident light. The R pixels, G pixels, and B pixels are arranged according to a Bayer array. The AF pixels are arranged by replacing some of the imaging pixels, and are distributed over almost the entire imaging surface 22a of the image sensor 22. In the following description, when simply referring to pixels, it refers to either one or both of the imaging pixels and the AF pixels.

[0017] The body memory 23 is composed of, for example, a non-volatile storage medium. Image data, control programs, and the like are recorded in the body memory 23. Writing data to the body memory 23 and reading data from the body memory 23 are controlled by the body control unit 210. The display unit 24 displays an image based on the image data, an image showing a focus detection area (AF area) such as an AF frame, information related to shooting such as a shutter speed and an F value, and a menu screen. The operation unit 25 includes various setting switches such as a release button, a power switch, and a switch for switching between various modes, and outputs a signal according to each operation to the body control unit 210. The operation unit 25 is also a setting unit that can set an arbitrary focus detection area from a plurality of focus detection areas, and a user can select an arbitrary focus detection area by operating the operation unit 25.

[0018] The body control unit 210 is configured with a processor such as a CPU, FPGA, or ASIC, and memories such as a ROM or RAM, and controls each unit of the camera 1 based on a control program. The body control unit 210 has an area setting unit 211, a distance calculation unit 212, a pixel selection unit 213, a readout unit 214, a focus detection unit 215, and an image data generation unit 216.

[0019] The area setting unit 211 sets (selects) at least one of the multiple focus detection areas 100 provided on the imaging surface 22a of the image sensor 22 shown in FIG. 2(a). The multiple AF frames displayed on the display unit 24 correspond to the multiple focus detection areas 100 provided on the image sensor 22, respectively. The area setting unit 211 sets, as an area for focus detection, the focus detection area 100 corresponding to the AF frame selected by the user by operating the operation unit 25, or the focus detection area 100 automatically selected by the camera 1, among the multiple AF frames displayed on the display unit 24. As will be described later, the focus detection unit 215 detects the amount of deviation (defocus amount) between the image by the photographing optical system 31 and the imaging surface 22a, using a signal output from the AF pixel in the focus detection area 100 set by the area setting unit 211.

[0020] In the focus detection area 100, as shown in FIG. 2(b), in addition to the imaging pixels, a plurality of types of pairs of AF pixels (AF pixel pairs) are arranged, and in this embodiment, a first AF pixel pair, a second AF pixel pair, and a third AF pixel pair are arranged. The first AF pixel pair, the second AF pixel pair, and the third AF pixel pair are arranged in order to detect the defocus amount with high accuracy even at an exit pupil distance that differs depending on the image height or the type of interchangeable lens. One AF pixel constituting the AF pixel pair outputs a first signal Sig1, and the other AF pixel constituting the AF pixel pair outputs a second signal Sig2. The first AF pixel pair, the second AF pixel pair, and the third AF pixel pair will be described later.

[0021] As shown in FIG. 2(a), the focus detection areas 100 are arranged in two dimensions (row and column directions) and are provided at positions with different image heights. A small area 110a (see FIG. 2(b)) in the focus detection area 100a at the center of the imaging surface 22a is located on the optical axis OA1 of the photographing optical system 31, and its image height H is approximately zero. The image height H of the focus detection area 100 increases as it moves away from the center of the imaging surface 22a (the optical axis OA1 of the photographing optical system 31). In other words, the image height H of the focus detection area 100 increases as the distance from the center of the imaging surface 22a increases. Therefore, in the row in which the focus detection area 100a is located, the focus detection areas 100 farthest from the optical axis OA1 of the photographing optical system 31 (having the highest image height H) are the focus detection areas 100b and 100c located at the left end (end in the -X direction) and right end (end in the +X direction) of the row. The focus detection areas 100 with the highest image height H in the image sensor 22 are the four focus detection areas 100 located at the corners of the image pickup surface 22a.

[0022] Since the focus detection area 100 has a predetermined area, the image height of each AF pixel differs depending on the position in the focus detection area 100. Within the same focus detection area 100, the image height differs between the small area 110a in the center (see FIG. 2(b)) and the small areas 110b and 110c (see FIG. 2(b)) located at the left end (end in the -X direction) and the right end (end in the +X direction). However, in this embodiment, the value of the image height H at the center position of one focus detection area 100 is set to the value of the image height of the entire focus detection area 100. The image height of the focus detection area 100a in the center of the imaging surface 22a is zero, and the image heights of the focus detection areas 100b and 100c are the predetermined image height H.

[0023] The distance calculation unit 212 calculates the exit pupil distance of the photographing optical system 31 at the image height H. The distance calculation unit 212 calculates the exit pupil distance Po(H) of the photographing optical system 31 at the image height H of the focus detection area 100 set by the area setting unit 211 by the following formula (1). Po(H) = h4 × H 4 +h2×H 2 +Co …(1) Equation (1) is an arithmetic expression with the image height H as a variable, where parameter (h4) is the coefficient of the fourth-order term of variable H, parameter (h2) is the coefficient of the second-order term of variable H, and constant term Co is the exit pupil distance at a position where the image height is zero (the position of the optical axis OA1 on the imaging plane 22a). Parameters (h4), (h2), and constant term Co are information on the exit pupil distance corresponding to different image heights, and are values ​​determined by the optical characteristics of the photographing optical system 31. Information indicating parameters (h4), (h2), and constant term Co is transmitted from the interchangeable lens 3 to the camera body 2 as lens information. Note that this arithmetic expression (1) is stored in an internal memory of the body control unit 210.

[0024] The distance calculation unit 212 calculates the exit pupil distance Po(H) related to the image height H of the set focus detection area 100 based on the image height H of the focus detection area 100 set by the area setting unit 211, lens information (h4, h2, Co), and arithmetic formula (1). Note that arithmetic formula (1) may be stored in an internal memory of the lens control unit 32. The lens control unit 32 may transmit arithmetic formula (1) together with the parameters (h4), (h2), and the constant term Co to the camera body 2 as lens information.

[0025] The pixel selection unit 213 selects at least one type of AF pixel pair from among multiple types of AF pixel pairs provided in the image sensor 22. In this embodiment, the pixel selection unit 213 selects one type of AF pixel pair from three types of AF pixel pairs (first to third AF pixel pairs) arranged in the focus detection area 100 set by the area setting unit 211. As will be described later, the pixel selection unit 213 selects an AF pixel pair suitable for the exit pupil distance Po(H) calculated by the distance calculation unit 212 from among the three types of AF pixel pairs. Furthermore, when multiple focus detection areas 100 are set by the area setting unit 211, the pixel selection unit 213 selects AF pixel pairs of the same type in each selected focus detection area 100.

[0026] The readout unit 214 reads out signals from the image sensor 22. When displaying a through image (live view image) of a subject on the display unit 24 or when capturing video, the readout unit 214 reads out signals used for image generation and signals used for focus detection at a predetermined cycle from the image sensor 22. The readout unit 214 reads out signals by a so-called rolling shutter method, in which the pixels of the image sensor 22 are sequentially selected row by row and signals are read out from the selected pixel row.

[0027] The readout unit 214 performs a first readout mode and a second readout mode. In the first readout mode, the readout unit 214 sequentially selects pixel rows in which AF pixels constituting an AF pixel pair selected by the pixel selection unit 213 are arranged (hereinafter referred to as AF pixel rows) and pixel rows in which AF pixels are not arranged (hereinafter referred to as imaging pixel rows), and reads out signals from each pixel. In the second readout mode, the readout unit 214 separately reads out signals from the AF pixel rows and signals from the imaging pixel rows.

[0028] For example, the readout unit 214 performs the first readout mode when continuously shooting still images or when shooting a high-resolution video (for example, 4K video). The readout unit 214 performs the second readout mode when displaying a through image on the display unit 24 or when shooting a low-resolution video (for example, FullHD video). The first readout mode and the second readout mode will be described later.

[0029] The focus detection unit 215 performs focus detection processing required for automatic focus adjustment (AF) of the photographing optical system 31. The focus detection unit 215 detects the in-focus position of the focus lens 31b (the amount of movement of the focus lens 31b to the in-focus position) for the image by the photographing optical system 31 to be focused (formed) on the imaging surface 22a. The focus detection unit 215 calculates the defocus amount by a pupil division type phase difference detection method using the first and second signals Sig1 and Sig2 of the AF pixel pair read out by the readout unit 214. The focus detection unit 215 calculates the amount of image shift by performing a correlation calculation between a first signal Sig1 generated by capturing an image by a first light beam passing through a first pupil region of the exit pupil of the photographing optical system 31 and a second signal Sig2 generated by capturing an image by a second light beam passing through a second pupil region. The focus detection unit 215 converts this amount of image shift into a defocus amount based on a predetermined conversion formula. The focus detection unit 215 calculates the amount of movement of the focus lens 31b to the in-focus position based on the calculated defocus amount.

[0030] The focus detection unit 215 judges whether the defocus amount is within a tolerance. If the defocus amount is within the tolerance, the focus detection unit 215 judges that the focus is achieved. On the other hand, if the defocus amount exceeds the tolerance, the focus detection unit 215 judges that the focus is not achieved, and transmits to the lens control unit 32 of the interchangeable lens 3 the movement amount of the focus lens 31b and a signal instructing lens movement. The lens control unit 32 moves the focus lens 31b according to the movement amount, thereby automatically adjusting the focus.

[0031] The focus detection unit 215 can also perform focus detection processing using a contrast detection method in addition to focus detection processing using a phase difference detection method. The body control unit 210 sequentially calculates the contrast evaluation value of the subject image based on the signal output from the imaging pixel while moving the focus lens 31b of the imaging optical system 31 in the direction of the optical axis OA1. The body control unit 210 associates the position of the focus lens 31b with the contrast evaluation value using position information of the focus lens 31b transmitted from the interchangeable lens 3. The body control unit 210 then detects the position of the focus lens 31b where the contrast evaluation value is at its peak, i.e., the maximum value, as the in-focus position. The body control unit 210 transmits information on the position of the focus lens 31b corresponding to the detected in-focus position to the lens control unit 32. The lens control unit 32 moves the focus lens 31b to the in-focus position to adjust the focus.

[0032] The image data generating unit 216 generates image data by performing various image processing on the signals of the imaging pixels read out by the reading unit 214. Note that the image data generating unit 216 may also generate image data using signals output from the AF pixels.

[0033] 3 is a diagram showing an example of pixel arrangement in the focus detection area 100. The R pixels 13, G pixels 13, and B pixels 13 are arranged according to a Bayer array. The first AF pixel 11 and the second AF pixel 12 are arranged by replacing some of the R, G, and B imaging pixels 13 arranged in the Bayer array. The first and second AF pixels 11 and 12 each have a light-shielding portion 43. The first AF pixel 11 and the second AF pixel 12 have light-shielding portions 43 that are located in different positions.

[0034] 3, the image sensor 22 has a pixel group (first imaging pixel row) 401 in which R pixels 13 and G pixels 13 are alternately arranged in the left-right direction, i.e., in the row direction, and a pixel group (second imaging pixel row) 402 in which G pixels 13 and B pixels 13 are alternately arranged in the row direction. The image sensor 22 also has a pixel group (first AF pixel row) 403 in which G pixels 13 and first AF pixels 11 are alternately arranged in the row direction, and a pixel group (second AF pixel row) 404 in which G pixels 13 and second AF pixels 12 are alternately arranged in the row direction.

[0035] In the first AF pixel row 403a, the first AF pixels 11a and the G pixels 13 are alternately arranged. In the second AF pixel row 404a, which is a predetermined row away from the first AF pixel row 403a, the second AF pixels 12a and the G pixels 13 are alternately arranged. The arrangement positions of the first AF pixels 11a in the first AF pixel row 403a and the arrangement positions of the second AF pixels 12a in the second AF pixel row 404a are the same. That is, the first AF pixels 11a and the second AF pixels 12a are arranged in the same column. The first AF pixels 11a in the first AF pixel row 403a and the second AF pixels 12a in the second AF pixel row 404a configure a first AF pixel pair.

[0036] In the first AF pixel row 403b, which is a predetermined number of rows away from the second AF pixel row 404a, the first AF pixels 11b and the G pixels 13 are alternately arranged. In the second AF pixel row 404b, which is a predetermined number of rows away from the first AF pixel row 403b, the second AF pixels 12b and the G pixels 13 are alternately arranged. Note that the arrangement positions of the first AF pixels 11b in the first AF pixel row 403b and the arrangement positions of the second AF pixels 12b in the second AF pixel row 404b are the same. That is, the first AF pixels 11b and the second AF pixels 12b are arranged in the same column. The first AF pixels 11b in the first AF pixel row 403b and the second AF pixels 12b in the second AF pixel row 404b form a second AF pixel pair.

[0037] In the first AF pixel row 403c, which is a predetermined number of rows away from the second AF pixel row 404b, the first AF pixel 11c and the G pixel 13 are alternately arranged. In the second AF pixel row 404c, which is a predetermined number of rows away from the first AF pixel row 403c, the second AF pixel 12c and the G pixel 13 are alternately arranged. Note that the arrangement position of the first AF pixel 11c in the first AF pixel row 403c and the arrangement position of the second AF pixel 12c in the second AF pixel row 404c are the same. That is, the first AF pixel 11c and the second AF pixel 12c are arranged in the same column. The first AF pixel 11c in the first AF pixel row 403c and the second AF pixel 12c in the second AF pixel row 404c form a third AF pixel pair.

[0038] Alternatively, the first AF pixel row 403a and the second AF pixel row 404a may be arranged in a plurality of rows, and a plurality of first AF pixel pairs may be arranged. Alternatively, the first AF pixel row 403b and the second AF pixel row 404b may be arranged in a plurality of rows, and a plurality of second AF pixel pairs may be arranged. Alternatively, the first AF pixel row 403c and the second AF pixel row 404c may be arranged in a plurality of rows, and a plurality of third AF pixel pairs may be arranged.

[0039] As described above, the first, second, and third AF pixel pairs are arranged to detect the defocus amount with high accuracy even if the exit pupil distance changes depending on the image height or the type of interchangeable lens. Therefore, the area of ​​the light shielding portion 43 of each of the first, second, and third AF pixel pairs is different, except for the pixel pairs around the optical axis OA1 (center of the imaging surface 22a) of the photographing optical system 31. When the exit pupil distance is different, the incident angle of light incident on the AF pixels is different, except for the AF pixels around the optical axis OA1 of the photographing optical system 31. When the exit pupil distance is short, the incident angle is large, and when the exit pupil distance is long, the incident angle is small. In order to shield a part of the light incident at an incident angle that differs depending on the exit pupil distance, the area of ​​the light shielding portion 43 differs depending on the AF pixel pair. This allows the focus detection unit 215 to detect the defocus amount with high accuracy even at different exit pupil distances. However, the incident angle of the pixel pairs around the optical axis OA1 (center of the imaging surface 22a) of the photographing optical system 31 is 0° regardless of the exit pupil distance. Therefore, the first AF pixel pair, the second AF pixel pair, and the third AF pixel pair have the same area of ​​the light-shielding portion 43. As will be described later, the area of ​​the light-shielding portion 43 also differs depending on the position (image height) of the AF pixel.

[0040] The first AF pixels 11a, 11b, 11c and the second AF pixels 12a, 12b, 12c each have a filter having a spectral characteristic of separating light in a second wavelength range (green (G) light) from the incident light. The filter of each of the first AF pixels 11a to 11c and the second AF pixels 12a to 12c may be a filter having a spectral characteristic of separating light in a first wavelength range (red (R) light) or light in a third wavelength range (blue (B) light). The first AF pixels 11a to 11c and the second AF pixels 12a to 12c may also have a filter having a spectral characteristic of separating light in a first, second, and third wavelength ranges from the incident light.

[0041] Fig. 4 is a diagram for explaining an example of the configuration of an AF pixel and an imaging pixel provided in an image sensor 22 according to the first embodiment. Fig. 4(a) shows an example of a cross section of a first AF pixel 11 of the first and second AF pixels 11, 12 constituting an AF pixel pair, and Fig. 4(b) shows an example of a cross section of a second AF pixel 12 of the first and second AF pixels 11, 12. Fig. 4(c) shows an example of a cross section of an imaging pixel 13 (R pixel, G pixel, B pixel).

[0042] 4, each of the first and second AF pixels 11, 12 and the imaging pixel 13 has a microlens 44, a color filter 51, and a photoelectric conversion unit 42 (PD42) that photoelectrically converts light transmitted (passed) through the microlens 44 and the color filter 51. The first light beam 61 is a light beam that has passed through a first pupil region that approximately halves the exit pupil of the photographing optical system 31. The second light beam 62 is a light beam that has passed through a second pupil region that approximately halves the exit pupil of the photographing optical system 31.

[0043] In FIG. 4(a), the first AF pixel 11 is provided with a light shielding portion 43L that shields the second light beam 62 of the first and second light beams 61 and 62. The light shielding portion 43L is located between the color filter 51 and the photoelectric conversion portion 42, and is provided on the photoelectric conversion portion 42. In the example shown in FIG. 4(a), the light shielding portion 43L is disposed so as to shield the left half (-X direction side) of the photoelectric conversion portion 42. The right end (end in the +X direction) of the light shielding portion 43L approximately coincides with the center line that divides the photoelectric conversion portion 42 into two equal parts to the left and right. The photoelectric conversion portion 42 of the first AF pixel 11 receives the first light beam 61. The photoelectric conversion portion 42 of the first AF pixel 11 photoelectrically converts the first light beam 61 to generate an electric charge, and the first AF pixel 11 outputs a first signal Sig1 based on the electric charge generated by the photoelectric conversion portion 42.

[0044] The area of ​​the light shielding portion 43L differs depending on the position (image height) of the first AF pixel 11, except for the first AF pixel 11 located around the optical axis OA1 (center of the imaging surface 22a) of the photographing optical system 31. When the position of the first AF pixel 11 differs, that is, when the image height differs, the angle of incidence of light incident on the first AF pixel 11 differs. When the image height is high, the angle of incidence becomes large, and when the image height is low, the angle of incidence becomes small, and when the image height is 0, the angle of incidence is 0°. In order to shield the second light flux 62 from the light incident at an angle of incidence that differs depending on the image height, the area of ​​the light shielding portion 43L differs depending on the image height.

[0045] In FIG. 4(b), the second AF pixel 12 is provided with a light shielding portion 43R that shields the first light beam 61 of the first and second light beams 61 and 62. The light shielding portion 43R is located between the color filter 51 and the photoelectric conversion portion 42, and is provided on the photoelectric conversion portion 42. In the example shown in FIG. 4(b), the light shielding portion 43R is disposed so as to shield the right half (the +X direction side) of the photoelectric conversion portion 42. The left end (the end in the -X direction) of the light shielding portion 43R approximately coincides with the center line that divides the photoelectric conversion portion 42 into two equal parts to the left and right. The photoelectric conversion portion 42 of the second AF pixel 12 receives the second light beam 62. The photoelectric conversion portion 42 of the second AF pixel 12 photoelectrically converts the second light beam 62 to generate an electric charge, and the second AF pixel 12 outputs a second signal Sig2 based on the electric charge generated by the photoelectric conversion portion 42.

[0046] Note that, similarly to the first AF pixel 11, the area of ​​the light-shielding portion 43R differs depending on the position (image height) of the second AF pixel 12, except for the second AF pixel 12 located around the optical axis OA1 (the center of the imaging surface 22a) of the photographing optical system 31. The area of ​​the light-shielding portion 43R differs depending on the image height in order to block the first light flux 61 of the light incident at an incident angle that differs depending on the image height.

[0047] 4(c), the photoelectric conversion unit 42 of the imaging pixel 13 receives first and second light beams 61, 62 that have passed through first and second pupil regions, respectively, of the exit pupil of the imaging optical system 31. The photoelectric conversion unit 42 of the imaging pixel 13 performs photoelectric conversion on the first and second light beams 61, 62 to generate electric charges, and the imaging pixel 13 outputs a signal based on the electric charges generated by the photoelectric conversion unit 42.

[0048] FIG. 5 is a cross-sectional view of three types of AF pixel pairs arranged in a small region 110a (see FIG. 2(b)) in the focus detection region 100a. FIG. 5(a) shows the first and second AF pixels 11a and 12a constituting a first AF pixel pair arranged in the first AF pixel row 403a and the second AF pixel row 404a of FIG. 3, respectively. FIG. 5(b) shows the first and second AF pixels 11b and 12b constituting a second AF pixel pair arranged in the first AF pixel row 403b and the second AF pixel row 404b of FIG. 3, respectively. FIG. 5(c) shows the first and second AF pixels 11c and 12c constituting a third AF pixel pair arranged in the first AF pixel row 403c and the second AF pixel row 404c of FIG. 3, respectively. 5, in each of the first AF pixels 11a to 11c and the second AF pixels 12a to 12c, a line passing through the center of the photoelectric conversion unit 42 and the optical axis OA2 of the microlens 44 approximately coincide with each other. Light incident on the optical axis OA2 of the microlens 44 at an incident angle of 0° is focused on the optical axis OA2 of the microlens 44. Since the line passing through the center of the photoelectric conversion unit 42 coincides with the optical axis OA2 of the microlens 44, light incident on the microlens 44 is focused on a line passing through the center of the photoelectric conversion unit 42. In other words, light transmitted through the imaging optical system 31 is focused on a line passing through the center of the photoelectric conversion unit 42.

[0049] In FIG. 5(a), in the first AF pixel 11a, the right end (end in the +X direction) of the light-shielding portion 43L is approximately aligned with the optical axis OA2 of the microlens 44. The light-shielding portion 43L of the first AF pixel 11a shields the left half (-X direction side) of the photoelectric conversion unit 42. The second light flux 62 transmitted through the microlens 44 is shielded by the light-shielding portion 43L before entering the photoelectric conversion unit 42. As a result, the photoelectric conversion unit 42 of the first AF pixel 11a receives the first light flux 61. In the second AF pixel 12a, the left end (end in the -X direction) of the light-shielding portion 43R is approximately aligned with the optical axis OA2 of the microlens 44. The first light flux 61 transmitted through the microlens 44 is shielded by the light-shielding portion 43R before entering the photoelectric conversion unit 42. As a result, the photoelectric conversion unit 42 of the second AF pixel 12a receives the second light flux 62.

[0050] 5(b) and (c), in each of the first AF pixels 11b and 11c, the right end (end in the +X direction) of the light-shielding portion 43L substantially coincides with the optical axis OA2 of the microlens 44. Therefore, similar to the first AF pixel 11a, the photoelectric conversion unit 42 of each of the first AF pixels 11b and 11c receives the first light flux 61. Moreover, in each of the second AF pixels 12b and 12c, the left end (end in the -X direction) of the light-shielding portion 43R substantially coincides with the optical axis OA2 of the microlens 44. Therefore, similar to the first AF pixel 12a, the photoelectric conversion unit 42 of each of the second AF pixels 12b and 12c receives the second light flux 62.

[0051] Fig. 6 is a cross-sectional view of three types of AF pixel pairs arranged in a small region 110c (see Fig. 2(b)) that is separated in the +X direction from the small region 110a in the focus detection region 100a. Fig. 6(a) shows the first and second AF pixels 11a, 12a that constitute a first AF pixel pair. Fig. 6(b) shows the first and second AF pixels 11b, 12b that constitute a second AF pixel pair. Fig. 6(c) shows the first and second AF pixels 11c, 12c that constitute a third AF pixel pair.

[0052] 6, in each of the first AF pixels 11a to 11c and the second AF pixels 12a to 12c, a line passing through the center of the photoelectric conversion unit 42 is offset in the +X direction with respect to the optical axis OA2 of the microlens 44. In this embodiment, in the first and second AF pixels arranged away from the small region 110a in the +X direction, a line passing through the center of the photoelectric conversion unit 42 is offset in the +X direction with respect to the optical axis OA2 of the microlens 44. In addition, in the first and second AF pixels arranged away from the small region 110a in the -X direction, a line passing through the center of the photoelectric conversion unit 42 is offset in the -X direction with respect to the optical axis OA2 of the microlens 44.

[0053] 6, the areas of the light-shielding portions 43L of the first AF pixels 11a to 11c are different. The area of ​​the light-shielding portion 43L of the first AF pixel 11a is smaller than the area of ​​the light-shielding portion 43L of the first AF pixel 11b. The area of ​​the light-shielding portion 43L of the first AF pixel 11b is smaller than the area of ​​the light-shielding portion 43L of the first AF pixel 11c. The areas of the light-shielding portions 43R of the second AF pixels 12a to 12c are different. The area of ​​the light-shielding portion 43R of the second AF pixel 12a is larger than the area of ​​the light-shielding portion 43R of the second AF pixel 12b. The area of ​​the light-shielding portion 43R of the second AF pixel 12b is larger than the area of ​​the light-shielding portion 43R of the second AF pixel 12c.

[0054] 6, a line passing through the center of the photoelectric conversion unit 42 is misaligned with the optical axis OA2 of the microlens 44, and the areas of the light-shielding units 43 of the first and second AF pixels are different, so that the ends of the light-shielding units of the first and second AF pixels are misaligned with the optical axis OA2 of the microlens 44. In FIG. 6(a), for example, the right end (end in the +X direction) of the light-shielding unit 43L of the first AF pixel 11a is positioned on the +X direction side from the optical axis OA2 of the microlens 44 by a shift amount d1. Also, the left end (end in the -X direction) of the light-shielding unit 43R of the second AF pixel 12a is positioned on the +X direction side from the optical axis OA2 of the microlens 44 by a shift amount d1.

[0055] As shown in Fig. 6, the second and third AF pixel pairs and the first AF pixel pair have different amounts of deviation. The deviation d2 of the first and second AF pixels 11b, 12b constituting the second AF pixel pair is larger than the deviation d1 of the first and second AF pixels 11a, 12a constituting the first AF pixel pair. The deviation d3 of the first and second AF pixels 11c, 12c constituting the third AF pixel pair is larger than the deviation d2 of the first and second AF pixels 11b, 12b constituting the second AF pixel pair. That is, d1 <d2<d3である。

[0056] Fig. 7 is a cross-sectional view of some three types of AF pixel pairs in a focus detection area 100c that is away from the focus detection area 100a in the +X direction in Fig. 2. Fig. 7(a) shows the first and second AF pixels 11a, 12a that make up a first AF pixel pair. Fig. 7(b) shows the first and second AF pixels 11b, 12b that make up a second AF pixel pair. Fig. 7(c) shows the first and second AF pixels 11c, 12c that make up a third AF pixel pair.

[0057] Similar to the three types of AF pixel pairs shown in Fig. 6, in each of the first AF pixels 11a-11c and second AF pixels 12a-12c shown in Fig. 7, a line passing through the center of the photoelectric conversion unit 42 is shifted in the +X direction with respect to the optical axis OA2 of the microlens 44. Also, similar to the three types of AF pixel pairs shown in Fig. 6, the areas of the light-shielding units 43L of each of the first AF pixels 11a-11c are different, and the areas of the light-shielding units 43R of each of the second AF pixels 12a-12c are different.

[0058] The three types of AF pixel pairs shown in FIG. 6 and FIG. 7 have different amounts of deviation of the line passing through the center of the photoelectric conversion unit 42 with respect to the optical axis OA2 of the microlens 44. In addition, the areas of the light-shielding portion 43L and the light-shielding portion 43R are different, except for the first AF pixel 11b and the second AF pixel 12b. The three types of AF pixel pairs shown in FIG. 7 have a larger amount of deviation with respect to the optical axis OA2 of the microlens 44 than FIG. 6. In addition, the first AF pixel 11a and the second AF pixel 12a shown in FIG. 7 have a smaller area of ​​the light-shielding portion 43L and a larger area of ​​the light-shielding portion 43R than FIG. 6. The first AF pixel 11c and the second AF pixel 12c shown in FIG. 7 have a larger area of ​​the light-shielding portion 43L and a smaller area of ​​the light-shielding portion 43R than FIG. 6. The first AF pixel 11b and the second AF pixel 12b shown in FIG. 7 have the same area as the light-shielding portion 43L and the same area as the light-shielding portion 43R in FIG.

[0059] In the first AF pixel 11a, the right end (end in the +X direction) of the light-shielding portion 43L is shifted in the +X direction by a shift amount d4 with respect to the optical axis OA2 of the microlens 44. In the second AF pixel 12a, the left end (end in the -X direction) of the light-shielding portion 43R is shifted in the +X direction by a shift amount d4 with respect to the optical axis OA2 of the microlens 44.

[0060] The second and third AF pixel pairs and the first AF pixel pair have different amounts of deviation. The deviation d5 of the first and second AF pixels 11b, 12b constituting the second AF pixel pair is larger than the deviation d4 of the first and second AF pixels 11a, 12a constituting the first AF pixel pair. The deviation d6 of the first and second AF pixels 11c, 12c constituting the third AF pixel pair is larger than the deviation d5 of the first and second AF pixels 11b, 12b constituting the second AF pixel pair. That is, d4 <d5<d6である。

[0061] As shown in FIG. 5, FIG. 6, and FIG. 7, the amount of deviation between the line passing through the center of the photoelectric conversion unit 42 and the optical axis OA2 of the microlens 44 varies depending on the image height. The higher the image height, the greater the amount of deviation, and the lower the image height, the smaller the amount of deviation. At a position where the image height is high, the light transmitted through the photographing optical system 31 is obliquely incident on the microlens 44. That is, the light is incident on the optical axis OA2 of the microlens 44 at an incident angle greater than 0°. Therefore, it can be said that the greater the incident angle of the light on the microlens 44, the greater the amount of deviation. The light incident on the optical axis OA2 of the microlens 44 at an incident angle greater than 0° is focused while being shifted from the optical axis OA2 of the microlens in the +X direction or the -X direction. As the line passing through the center of the photoelectric conversion unit 42 is shifted from the optical axis OA2 of the microlens 44, the light incident on the microlens 44 is focused on the line passing through the center of the photoelectric conversion unit 42. That is, the light transmitted through the photographing optical system 31 is focused on the line passing through the center of the photoelectric conversion unit 42. This allows the amount of light passing through the photographing optical system 31 and entering the photoelectric conversion section 42 to be increased.

[0062] As shown in FIGS. 5, 6, and 7, the area of the light-shielding portion 43 varies depending on the AF pixel pair. As described above, the exit pupil distance of the photographing optical system 31 varies depending on the type of the interchangeable lens 3. Therefore, each of the first AF pixel pair, the second AF pixel pair, and the third AF pixel pair has a light-shielding portion 43 with a different area in order to accurately detect the defocus amount at different exit pupil distances. In addition, the area of the light-shielding portion 43L and the area of the light-shielding portion 43R of the first AF pixel pair differ depending on the position (image height) where the first AF pixel pair is arranged. As described above, the exit pupil distance of the photographing optical system 31 varies depending on the image height. Therefore, the first AF pixel pair has the light-shielding portion 43L and the light-shielding portion 43R with areas that change depending on the image height in order to accurately detect the defocus amount at different exit pupil distances. The third AF pixel pair is the same as the first AF pixel pair. Thereby, the focus detection unit 215 can accurately detect the defocus amount even at different exit pupil distances. That is, the focus detection unit 215 can accurately detect the defocus amount even when the image height or the type of the interchangeable lens changes.

[0063] Therefore, the amount of deviation between the light-shielding portion 43 of the first to third AF pixel pairs and the optical axis of the microlens 44 increases as the image height increases in the +X direction from the small region 110a in FIG. 2(b). Comparing the deviation amounts of the first to third AF pixel pairs in three regions with image heights of Ha, Hb, and Hc (Ha < Hb < Hc), the following results are obtained. The deviation amount of the first AF pixel pair in the region with the image height Hb is larger than the deviation amount of the first AF pixel pair in the region with the image height Ha, and smaller than the deviation amount of the first AF pixel pair in the region with the image height Hc. Similarly, the deviation amounts of the second and third AF pixel pairs in the region with the image height Hb are larger than the deviation amounts of the second and third AF pixel pairs in the region with the image height Ha, respectively, and smaller than the deviation amounts of the second and third AF pixel pairs in the region with the image height Hc. The deviation amount d4 of the first AF pixel pair arranged in the focus detection region 100c shown in FIG. 7 is larger than the deviation amount d1 of the first AF pixel pair arranged in the small region 110c shown in FIG. 6. The deviation amounts d5 and d6 of the second and third AF pixel pairs arranged in the focus detection region 100c shown in FIG. 7 are larger than the deviation amounts d2 and d3 of the second and third AF pixel pairs arranged in the small region 110c shown in FIG. 6, respectively.

[0064] The first to third AF pixel pairs arranged in small region 110b away from small region 110a in the -X direction in Fig. 2(b) are given shift amounts similar to shift amounts d1 to d3 in the direction opposite to the shift direction shown in Fig. 6. The first to third AF pixel pairs arranged in focus detection region 100b in Fig. 2(a) are given shift amounts similar to shift amounts d4 to d6 in the direction opposite to the shift direction shown in Fig. 7. The shift amounts of the first to third AF pixel pairs arranged away from small region 110a in the -X direction also increase as the image height increases.

[0065] As described above, the first to third AF pixel pairs have different amounts of deviation. Therefore, in a plane intersecting the direction in which light is incident, the areas in which the photoelectric conversion units 42 of the first AF pixels 11a to 11c receive light are different from each other, and the areas in which the photoelectric conversion units 42 of the second AF pixels 12a to 12c receive light are different from each other. In this manner, in the present embodiment, the first to third AF pixel pairs have different light receiving areas of the photoelectric conversion units 42, and therefore can perform pupil division in response to different angles of incidence. This allows the focus detection unit 215 to detect the defocus amount with high accuracy.

[0066] Next, an example of a method for determining the amount of deviation of the first to third AF pixel pairs in the focus detection area 100 will be described. In FIG. 8, the position of the small area 110 located at the image height Hd from the position 0 (the center position of the imaging surface 22a) where the optical axis OA1 of the photographing optical system 31 intersects with the imaging surface 22a of the image sensor 22 is represented by 110α. A first reference exit pupil EP1, a second reference exit pupil EP2, and a third reference exit pupil EP3 are set on the optical axis OA1 of the photographing optical system 31. The second reference exit pupil EP2 is located closer to the imaging surface 22a than the first reference exit pupil EP1, and is located on the +Z direction side of the first reference exit pupil EP1. The third reference exit pupil EP3 is located closer to the imaging surface 22a than the second reference exit pupil EP2, and is located on the +Z direction side of the second reference exit pupil EP2. The distance between the first reference exit pupil EP1 and the imaging surface 22a is defined as the first reference exit pupil distance Po1, the distance between the second reference exit pupil EP2 and the imaging surface 22a is defined as the second reference exit pupil distance Po2, and the distance between the third reference exit pupil EP3 and the imaging surface 22a is defined as the third reference exit pupil distance Po3. Note that Po1 > Po2 > Po3.

[0067] In FIG. 8, L1 indicates the chief ray of the light beam that passes through the first reference exit pupil EP1 and enters the AF pixels in the small region 110 at position 110α. L2 indicates the chief ray of the light beam that passes through the second reference exit pupil EP2 and enters the AF pixels in the small region 110 at position 110α. L3 indicates the chief ray of the light beam that passes through the third reference exit pupil EP3 and enters the AF pixels in the small region 110 at position 110α.

[0068] In FIG. 8, assuming that θ1 is the incident angle of the chief ray L1 to the AF pixels, the displacement amount of the first pair of AF pixels in the small region 110 with image height Hd is determined based on the incident angle θ1. Similarly, assuming that θ2 and θ3 are the incident angles of the chief rays L2 and L3 to the AF pixels respectively, the displacement amounts of the second and third pairs of AF pixels in the small region 110 with image height Hd are determined based on the incident angles θ2 and θ3 respectively. As described above, the displacement amount increases as the incident angle increases. Also, except for the position where the image height is 0 (position 0), the incident angle decreases as the exit pupil distance increases, so θ1 < θ2 < θ3. Therefore, the displacement amounts d1, d2, and d3 of the first, second, and third pairs of AF pixels shown in FIGS. 6(a) to 6(c) are such that d1 < d2 < d3. Also, the displacement amounts d4, d5, and d6 of the first, second, and third pairs of AF pixels shown in FIGS. 7(a) to 7(c) are such that d4 < d5 < d6.

[0069] Thus, the displacement amount of the first pair of AF pixels with respect to the first reference exit pupil EP1 (first reference exit pupil distance Po1) is determined. Similarly, the displacement amount of the second pair of AF pixels with respect to the second reference exit pupil EP2 (second reference exit pupil distance Po2) is determined, and the displacement amount of the third pair of AF pixels with respect to the third reference exit pupil EP3 (third reference exit pupil distance Po3) is determined.

[0070] Next, the relationship between the exit pupil distance of the photographing optical system 31 and the first to third AF pixel pairs will be described. In Fig. 8, a first threshold value Th1 for the exit pupil distance is set at a midpoint between the first reference exit pupil EP1 and the second reference exit pupil EP2, and a second threshold value Th2 for the exit pupil distance is set at a midpoint between the second reference exit pupil EP2 and the third reference exit pupil EP3. A region where the exit pupil distance is equal to or greater than the first threshold value Th1 is defined as a first exit pupil distance range R1, a region where the exit pupil distance is between the first threshold value Th1 and the second threshold value Th2 is defined as a second exit pupil distance range R2, and a region where the exit pupil distance is equal to or less than the second threshold value Th2 is defined as a third exit pupil distance range R3.

[0071] The pixel selection unit 213 selects a first AF pixel pair when the exit pupil distance of the photographing optical system 31 is equal to or greater than the first threshold value Th1, i.e., when it belongs to the first exit pupil distance range R1. The pixel selection unit 213 selects a second AF pixel pair when the exit pupil distance of the photographing optical system 31 is between the first threshold value Th1 and the second threshold value Th2, i.e., when it belongs to the second exit pupil distance range R2. The pixel selection unit 213 selects a third AF pixel pair when the exit pupil distance of the photographing optical system 31 is equal to or less than the second threshold value Th2, i.e., when it belongs to the third exit pupil distance range R3. As described above, the pixel selection unit 213 selects an appropriate AF pixel pair from the first to third AF pixel pairs depending on which of the first to third exit pupil distance ranges R1 to R3 the exit pupil distance of the photographing optical system belongs to.

[0072] Next, the optical characteristics of the photographing optical system 31 of the interchangeable lens 3, that is, the optical characteristics in which the exit pupil distance changes depending on the image height, will be described. FIG. 9 shows the optical characteristics of the interchangeable lens 3 mounted on the camera body 2 of FIG. 1 in which the exit pupil distance changes depending on the image height. In FIG. 9, the horizontal axis represents the exit pupil distance Po, and the vertical axis represents the image height H. FIGS. 9(a), (b), (c), and (d) show the optical characteristics of different types of interchangeable lenses. The optical characteristics of the photographing optical system 31 of the interchangeable lens 3 shown in FIG. 9(a) are represented by an optical characteristic curve 200a, and the exit pupil distance Po decreases as the image height H increases. The optical characteristic curve 200a in FIG. 9(a) shows that the exit pupil distance is Poa at an image height of zero, and the exit pupil distance gradually decreases as the image height H increases, and the exit pupil distance becomes (Poa-Δp1) at the maximum image height Hmax.

[0073] The optical characteristic of the photographing optical system 31 of the interchangeable lens 3 shown in Fig. 9(b) is represented by an optical characteristic curve 200b, and the exit pupil distance Po increases as the image height H increases. The optical characteristic curve 200b in Fig. 9(b) indicates that the exit pupil distance is Pob at an image height of zero, and as the image height H increases, the exit pupil distance gradually increases, until the exit pupil distance becomes (Pob+Δp2) at the maximum image height Hmax. In the following description, an optical characteristic curve in which the exit pupil distance Po decreases as the image height H increases, such as the optical characteristic curve 200a, is referred to as a negative optical characteristic curve, and an optical characteristic curve in which the exit pupil distance Po increases as the image height H increases, such as the optical characteristic curve 200b, is referred to as a positive optical characteristic curve.

[0074] The photographing optical system 31 of the interchangeable lens 3 shown in FIG. 9(c) has an optical characteristic curve that differs, i.e., changes, depending on the position of the focus lens 31b in FIG. 1. This photographing optical system 31 exhibits an optical characteristic curve 200c when the focus lens 31b is located at a first position, and exhibits an optical characteristic curve 200d when the focus lens 31b is located at a second position. The first and second positions of the focus lens 31b are any positions between the infinity position and the close position, including the infinity position and the close position of the focus lens 31b. The infinity position of the focus lens 31b is a position where an object at an infinite distance is focused, and the close position is a position where an object at a close distance is focused.

[0075] In FIG. 9C, an optical characteristic curve 200c represents the optical characteristic of the photographing optical system 31 when the focus lens 31b is located at the first position. The optical characteristic curve 200c represents that the exit pupil distance is Poc at an image height of zero, the exit pupil distance gradually decreases as the image height H increases, and the exit pupil distance is (Poc-Δp3) at the maximum image height Hmax. The optical characteristic curve 200d represents the optical characteristic of the photographing optical system 31 when the focus lens 31b is located at the second position. The optical characteristic curve 200d represents that the exit pupil distance is Pod at an image height of zero, the exit pupil distance gradually increases as the image height H increases, and the exit pupil distance is (Pod+Δp4) at the maximum image height Hmax. 9(c), the optical characteristic curve 200c when the focus lens 31b is in the first position is shown as a negative optical characteristic curve, and the optical characteristic curve 200d when the focus lens 31b is in the second position is shown as a positive optical characteristic curve. However, there are also interchangeable lenses 3 having optical characteristics in which the optical characteristic curve 200c and the optical characteristic curve 200d are both positive or both negative.

[0076] The optical characteristic curve of the photographing optical system 31 of the interchangeable lens 3 shown in Fig. 9(d) differs, i.e., changes, depending on the focal length of the zoom lens (the position of the zoom lens 31a in Fig. 1). This photographing optical system 31 exhibits an optical characteristic curve 200e when the focal length is f1, and an optical characteristic curve 200f when the focal length is f2.

[0077] In Fig. 9(d), an optical characteristic curve 200e represents the optical characteristic of the photographing optical system 31 when the focal length is f1. The optical characteristic curve 200e indicates that the exit pupil distance is Poe at an image height of zero, and that as the image height H increases, the exit pupil distance gradually decreases, and that at the maximum image height Hmax, the exit pupil distance is (Poe-Δp5). The optical characteristic curve 200f represents the optical characteristic of the photographing optical system 31 when the focal length is f2. The optical characteristic curve 200f indicates that the exit pupil distance is Pof at an image height of zero, and that as the image height H increases, the exit pupil distance gradually increases, and that at the maximum image height Hmax, the exit pupil distance is (Pof+Δp6). 9(d), the optical characteristic curve 200e when the focal length is f1 is shown as a negative optical characteristic curve, and the optical characteristic curve 200f when the focal length is f2 is shown as a positive optical characteristic curve. However, there are also interchangeable lenses 3 having optical characteristics in which the optical characteristic curves 200e and 200f are both positive or both negative.

[0078] In the above description, the exit pupil distance Po at the image height H is the distance of the exit pupil of the photographing optical system 31 as viewed from the image height H of the imaging plane 22a. In other words, the exit pupil distance Po at the image height H is the distance of the exit pupil of the photographing optical system 31 (the distance from the imaging plane 22a) through which the light flux that has passed through the photographing optical system 31 and is incident on the position of the image height H on the imaging plane 22a passes. Fig. 10 shows the relationship between the image height H and the exit pupil distance Po. In Fig. 10, a light beam that has passed through the exit pupil EPa (exit pupil distance Poa) of the photographing optical system 31 is incident on an AF pixel (in Fig. 10, a microlens 44 is illustrated as a representative of the AF pixel) located at the center position 0 (image height zero) of the imaging surface 22a. The exit pupil distance Poa of this exit pupil EPa is the exit pupil distance of the exit pupil EPa for the image height zero. Furthermore, a light beam that has passed through an exit pupil EPb of the photographing optical system 31 is incident on an AF pixel (in FIG. 10, a microlens 44 is illustrated as a representative AF pixel) located at the image height He. The exit pupil distance (Poa-Δp) of this exit pupil EPb is the exit pupil distance of the exit pupil EPb with respect to the image height H.

[0079] Here, the relationship between the optical characteristics of each interchangeable lens 3 and the above formula (1) will be described. Po(H)=h4×H in the above formula (1) 4 +h2×H 2 +Co is a function that approximates the optical characteristic curves 200a, 200b, 200c, 200d, 200e, 200f, etc., shown in Figures 9(a) to 9(d). The optical characteristic curve 200a in Figure 9(a) is approximated by the calculation of formula (1) by setting the constant term Co in formula (1) to the exit pupil distance Poa at the image height of zero in Figure 9(a) and setting the coefficients h4 and h2 to coefficients h4a and h2a according to the curve of the optical characteristic curve 200a. The interchangeable lens 3 having the optical characteristic in Figure 9(a) stores the constant term Poa and the coefficients h4a and h2a in the lens memory 33 as lens information, as described above. Similarly, the interchangeable lens 3 having the optical characteristics of FIG. 9(b) stores the constant term Pob and coefficients h4b and h2b that specify the calculation of equation (1) that approximates the optical characteristic curve 200b in the lens memory 33 as lens information.

[0080] 9(c) has optical characteristics in which the optical characteristic curve changes depending on the position of the focus lens 31b. The interchangeable lens 3 stores in the lens memory 33 the constant term Co and coefficients h4 and h2 of the calculation of formula (1) that approximates the optical characteristic curve for each position of the focus lens 31b. The range in which the focus lens 31b moves (between the infinity position and the close position) is divided into a number of sections Z1 to Zn, and one optical characteristic curve representing each section (range) is determined for each section Z1 to Zn. For example, the optical characteristic curve when the focus lens 31b is located at the center position of one section is set as the optical characteristic curve representing that section.

[0081] The optical characteristic curve representing the section Zk is defined as the optical characteristic curve Zk (k=1, 2...n). For the calculation of formula (1) that approximates the representative optical characteristic curve Z1 of the section Z1, the constant term Co and coefficients h4 and h2 are set to Poz1, h4z1, and h2z1. For the calculation of formula (1) that approximates the optical characteristic curve Z2 of the section Z2, the constant term Co and coefficients h4 and h2 are set to Poz2, h4z2, and h2z2, respectively. Similarly, for the calculation of formula (1) that approximates the optical characteristic curve Zn of the section Zn, the constant term Co and coefficients h4 and h2 are set to Pozn, h4zn, and h2zn, respectively. FIG. 11 shows the constant terms and coefficients of the calculation that approximates these sections and the optical characteristic curves representing those sections. The interchangeable lens 3 stores in the lens memory 33 as lens information the relationships between the intervals Z1 to Zn and the constant terms Poz1 to Pozn and the coefficients h4z1 to h4zn and h2z1 to h2zn shown in FIG.

[0082] The interchangeable lens 3 in Fig. 9(d) is a zoom lens, and has optical characteristics in which the optical characteristic curve changes depending on the focal length. The interchangeable lens 3 stores in the lens memory 33 the constant term Co and coefficients h4 and h2 of the calculation of formula (1) that approximates the optical characteristic curve for each focal length. The range between the maximum focal length and the minimum focal length of the zoom lens set by the zoom lens 31a in Fig. 1 is divided into a plurality of sections W1 to Wn, and one optical characteristic curve representing each section W1 to Wn is determined. For example, the optical characteristic curve at the intermediate focal length in one section is set as the optical characteristic curve representing that section.

[0083] The optical characteristic curve representing the section Wk is defined as the optical characteristic curve Wk (k=1, 2...n). For the calculation of equation (1) that approximates the optical characteristic curve W1 in the section W1, the constant term Co and coefficients h4 and h2 are set to Pow1, h4w1, and h2w1, respectively. For the calculation of equation (1) that approximates the optical characteristic curve W2 in the section W2, the constant term Co and coefficients h4 and h2 are set to Pow2, h4w2, and h2w2, respectively. Similarly, for the calculation of equation (1) that approximates the optical characteristic curve Wn in the section Wn, the constant term Co and coefficients h4 and h2 are set to Pown, h4wn, and h2wn, respectively. FIG. 12 shows the constant terms and coefficients of the calculation that approximates these sections and the optical characteristic curves representing those sections. The interchangeable lens 3 stores in the lens memory 33 as lens information the relationship between the intervals W1 to Wn and the constant terms Pow1 to Pown and the coefficients h4w1 to h4wn and h2w1 to h2wn shown in FIG.

[0084] 9(d) is a zoom lens having optical characteristics in which the optical characteristic curve changes depending on the focal length, another zoom lens has optical characteristics in which the optical characteristic curve changes depending on the focal length and also depending on the position of the focus lens 31b. That is, the optical characteristic curve of the other zoom lens changes depending on both the position (focal length) of the zoom lens 31a and the position of the focus lens 31b.

[0085] Next, the relationship between the optical characteristic curve showing the optical characteristics of the interchangeable lens 3 shown in FIG. 9 and the first to third exit pupil distance ranges R1 to R3 shown in FIG. 8 will be described. FIG. 13 shows the first and second thresholds Th1 and Th2 related to the exit pupil distance shown in FIG. 8, the first to third exit pupil distance ranges R1 to R3, and the optical characteristic curve exemplified in FIG. 9. In FIG. 13, the entire optical characteristic curve 200g, that is, the exit pupil distance from the image height zero to the maximum image height Hmax, is located within the second exit pupil distance range R2. When the interchangeable lens 3 having such an optical characteristic curve 200g is attached to the camera body 2, the pixel selection unit 213 selects the second AF pixel pair regardless of the image height H set by the area setting unit 211 to the focus detection area 100.

[0086] In the optical characteristic curve 200h, the exit pupil distance from image height zero to image height Hf belongs to the second exit pupil distance range R2, but the exit pupil distance from image height Hf to the maximum image height Hmax belongs to the first exit pupil distance range R1. The pixel selection unit 213 selects the second AF pixel pair when the area setting unit 211 sets the focus detection area 100 with an image height equal to or less than Hf, and selects the first AF pixel pair when the area setting unit 211 sets a focus detection area with an image height greater than the image height Hf.

[0087] In the optical characteristic curve 200i, the exit pupil distance from image height zero to image height Hg belongs to a third exit pupil distance range R3, but the exit pupil distance from image height Hg to the maximum image height Hmax belongs to a second exit pupil distance range R2. The pixel selection unit 213 selects the third AF pixel pair when the area setting unit 211 sets the focus detection area 100 with an image height equal to or less than Hg, and selects the second AF pixel pair when the area setting unit 211 sets a focus detection area with an image height greater than the image height Hg.

[0088] As described above, when a plurality of focus detection areas 100 are set by the area setting unit 211, the pixel selection unit 213 selects the same type of AF pixel pair in each selected focus detection area 100. In this case, the pixel selection unit 213 selects the AF pixel pair based on the position of the focus detection area 100 that is the furthest from the optical axis OA1 of the photographing optical system 31 (has the highest image height H) among the selected plurality of focus detection areas 100. In this embodiment, the pixel selection unit 213 selects the AF pixel pair as described above according to the image height of the focus detection area 100 with the highest image height among the selected plurality of focus detection areas 100. The pixel selection unit 213 selects the same type of AF pixel pair in the other focus detection areas 100 as the AF pixel pair selected in the focus detection area 100 with the highest image height among the selected plurality of focus detection areas 100.

[0089] The circuit configuration and operation of the image sensor 22 according to the first embodiment will be described with reference to Fig. 14 and Fig. 15. Fig. 14 is a diagram showing the configuration of a pixel of the image sensor 22 according to the first embodiment. The pixel 13 has a photoelectric conversion unit 42, a transfer unit 52, a reset unit 53, a floating diffusion (FD) 54, an amplifier unit 55, and a selection unit 56. The photoelectric conversion unit 42 is a photodiode PD, which converts incident light into electric charges and accumulates the photoelectrically converted electric charges.

[0090] The transfer unit 52 is composed of a transistor M1 controlled by a signal TX, and transfers the charge photoelectrically converted by the photoelectric conversion unit 42 to the FD54. The transistor M1 is a transfer transistor. The capacitance C of the FD54 accumulates (holds) the charge transferred to the FD54.

[0091] The amplifier 55 outputs a signal based on the charge accumulated in the capacitance C of the FD 54. The amplifier 55 and the selection unit 56 constitute an output unit that generates and outputs a signal based on the charge generated by the photoelectric conversion unit 42.

[0092] The reset unit 53 is composed of a transistor M2 controlled by a signal RST, and discharges the charge accumulated in the FD 54 and resets the voltage of the FD 54. The transistor M2 is a reset transistor. The selection unit 56 is composed of a transistor M4 controlled by a signal SEL, and electrically connects or disconnects the amplification unit 55 and the vertical signal line 60. The transistor M4 is a selection transistor.

[0093] As described above, the charge photoelectrically converted by the photoelectric conversion unit 42 is transferred to the FD 54 by the transfer unit 52. Then, a signal corresponding to the charge transferred to the FD 54 is output to the vertical signal line 60. The pixel signal is an analog signal generated based on the charge photoelectrically converted by the photoelectric conversion unit 42. The signal output from the imaging pixel 13 is converted into a digital signal and then output to the body control unit 210.

[0094] In this embodiment, the circuit configuration of the first AF pixel 11 (11a to 11c) and the second AF pixel 12 (12a to 12c) is the same as the circuit configuration of the imaging pixel 13. Signals output from the first AF pixel 11 and the second AF pixel 12 are converted into digital signals and then output to the body control unit 210 as a pair of signals (first and second signals Sig1, Sig2) used for focus detection.

[0095] FIG. 15 is a diagram showing a configuration example of an image sensor according to the first embodiment. The image sensor 22 has a plurality of image pixels 13, a first AF pixel 11, a second AF pixel 12, a vertical control unit 70, and a plurality of column circuit units 80. In FIG. 15, for the sake of simplicity, only 128 pixels, i.e., 8 pixels in the row direction (±X direction)×16 pixels in the column direction (±Y direction), are shown. In FIG. 15, the pixel in the upper left corner is the image pixel 13 (1,1) in the first row and first column, and the image pixel in the lower right corner is the image pixel 13 (16,8) in the 16th row and eighth column. The image sensor 22 is provided with a plurality of vertical signal lines 60 (vertical signal lines 60a to 60h). The plurality of vertical signal lines 60 are connected to pixel columns (first to eighth columns) that are columns of a plurality of pixels aligned in the column direction, i.e., the vertical direction. The vertical signal lines 60a, 60c, 60e, and 60g are connected to a plurality of imaging pixels 13 arranged in the same column, and each output a signal from the connected imaging pixels 13. The vertical signal lines 60b, 60d, 60f, and 60h are connected to a plurality of imaging pixels 13, a plurality of first AF pixels 11, and a plurality of second AF pixels 12 arranged in the same column, and each output a signal from the connected imaging pixels 13, first AF pixels 11, and second AF pixels 12.

[0096] The vertical control unit 70 is provided in common to a plurality of pixel columns. The vertical control unit 70 supplies the signals TX, RST, and SEL shown in Fig. 14 to each pixel to control the operation of each pixel. The vertical control unit 70 supplies a signal to the gate of each transistor of the pixel to turn the transistor on (connected state, conductive state, short-circuited state) or off (disconnected state, non-conductive state, open state, cut-off state).

[0097] The column circuit section 80 is configured to include an analog / digital conversion section (AD conversion section), and converts analog signals input from each pixel via the vertical signal line 60 into digital signals and outputs the digital signals. The pixel signals converted into digital signals are input to a signal processing section (not shown) and subjected to signal processing such as correlated double sampling and processing for correcting the signal amount, and then output to the body control section 210 of the camera 1.

[0098] The readout unit 214 of the camera 1 controls the vertical control unit 70 to perform a first readout mode in which all pixel rows are selected sequentially and signals from each pixel are read out, and a second readout mode in which signals from each pixel in the AF pixel row and signals from each pixel in the imaging pixel row are read out separately.

[0099] When the readout unit 214 sets the first readout mode, the vertical control unit 70 sequentially selects a plurality of pixel rows and causes each pixel to output a signal. In FIG. 15, the vertical control unit 70 sequentially selects the imaging pixel rows 401 and 402 and the AF pixel rows 403a, 404a, 403b, and 404b from the 1st row to the 16th row. The vertical control unit 70 causes each pixel in the selected imaging pixel row or AF pixel row to output a signal to the vertical signal line 60. The readout unit 214 reads out the signal output to the vertical signal line 60. An example of a signal readout method in the first readout mode will be described below.

[0100] First, the vertical control unit 70 turns on the selection units 56 of the R pixel 13(1,1) to G pixel 13(1,8), which are pixels in the first imaging pixel row 401 in the first row. The vertical control unit 70 turns off the selection units 56 of the pixels in rows other than the first row. As a result, the signals of the R pixel 13(1,1) to G pixel 13(1,8) in the first row are output to the vertical signal lines 60a to 60h connected to each pixel via the selection units 56 of each pixel. The readout unit 214 reads out the signals output to the vertical signal lines 60 from the R pixel 13(1,1) to G pixel 13(1,8) to the vertical signal lines 60.

[0101] Next, the vertical control unit 70 turns on the selection units 56 of the G pixel 13(2,1) to the first AF pixel 11a(2,8), which are pixels in the first AF pixel row 403a in the second row. The vertical control unit 70 also turns off the selection units 56 of the pixels in rows other than the second row. As a result, the signals of the G pixel 13(2,1) to the first AF pixel 11a(2,8) in the second row are output to the vertical signal lines 60a to 60h, respectively. The readout unit 214 reads out the signals output to the vertical signal line 60 from the G pixel 13(2,1) to the first AF pixel 11a(2,8) in the second row. Similarly, the vertical control unit 70 sequentially selects the third and subsequent pixel rows (the first imaging pixel row 401, the second imaging pixel row 402, the first AF pixel row 403, and the second AF pixel row 404) one by one in the order of the third row, the fourth row, the fifth row, and the sixth row. The vertical control unit 70 causes each pixel in the selected imaging pixel row or AF pixel row to output a signal to the vertical signal line 60. The readout unit 214 reads out the signal output to the vertical signal line 60.

[0102] In this way, in the first readout mode, the readout unit 214 reads out signals from each pixel in all pixel rows. The signals read out from each pixel are subjected to signal processing by the column circuit unit 80 and the like, and then output to the body control unit 210.

[0103] When the readout unit 214 sets the second readout mode, the vertical control unit 70 outputs signals of each pixel in the AF pixel row to the vertical signal line 60 separately from signals of each pixel in the imaging pixel row to the vertical signal line 60. In this embodiment, the vertical control unit 70 first sequentially selects only the AF pixel rows and causes each pixel in the selected AF pixel row to output a signal to the vertical signal line 60. Thereafter, the vertical control unit 70 sequentially selects the imaging pixel rows and causes each pixel in the selected imaging pixel row to output a signal to the vertical signal line 60. The readout unit 214 first reads out only the signals output from each pixel in the AF pixel row to the vertical signal line 60, and then reads out the signals output from each pixel in the imaging pixel row to the vertical signal line 60.

[0104] An example of a signal readout method in the second readout mode will be described below. The vertical control unit 70 selects an AF pixel row in which an AF pixel pair selected by the pixel selection unit 213 is arranged in one (or more) focus detection areas 100 set by the area setting unit 211. In the example shown below, it is assumed that a first AF pixel pair is selected by the pixel selection unit 213 based on the exit pupil distance of the photographing optical system 31.

[0105] First, the vertical control unit 70 turns on the selection units 56 of the G pixel 13(2,1) to the first AF pixel 11a(2,8) constituting the first AF pixel row 403a in the second row shown in FIG. 15. The vertical control unit 70 turns off the selection units 56 of the pixels in rows other than the second row. As a result, the signals of the G pixel 13(2,1) to the first AF pixel 11a(2,8) are output to the vertical signal lines 60a to 60h connected to the respective pixels via the selection units 56 of the respective pixels. The readout unit 214 reads out the signals output to the vertical signal line 60 from the G pixel 13(2,1) to the first AF pixel 11a(2,8).

[0106] Next, the vertical control unit 70 turns on the selection units 56 of the G pixel 13(6,1) to the second AF pixel 12a(6,8) constituting the second AF pixel row 404a in the sixth row shown in FIG. 15. The vertical control unit 70 also turns off the selection units 56 of the pixels in rows other than the sixth row. As a result, the signals of the G pixel 13(6,1) to the second AF pixel 12a(6,8) are output to the vertical signal lines 60a to 60h, respectively. The readout unit 214 reads out the signals output to the vertical signal line 60 from the G pixel 13(6,1) to the second AF pixel 12a(6,8).

[0107] Although not shown, the first AF pixel row 403a and the second AF pixel row 404a are arranged in a plurality of rows from the 16th row onwards. The vertical control unit 70 sequentially selects only the plurality of first AF pixel rows 403a and second AF pixel rows 404a in the column direction (+Y direction). The vertical control unit 70 outputs signals from each pixel constituting the selected first AF pixel row 403a and second AF pixel row 404a to the vertical signal line 60. The readout unit 214 reads out signals output to the vertical signal line 60 from the G pixel 13, the first AF pixel 11a, and the second AF pixel 12a. The signals sequentially read out from each AF pixel row are subjected to signal processing by the column circuit unit 80 and the like, and then output to the body control unit 210.

[0108] After reading out the signals from each pixel in the AF pixel row, the vertical control unit 70 sequentially selects the imaging pixel rows in the column direction (+Y direction). The vertical control unit 70 causes each pixel in the selected imaging pixel row to output a signal to the vertical signal line 60. The readout unit 214 reads out the signals output to the vertical signal line 60 from each pixel in the imaging pixel row. The vertical control unit 70 turns on the selection units 56 of the R pixels 13(1,1) to G pixels 13(1,8) constituting the first imaging pixel row 401 in the first row shown in FIG. 15. The vertical control unit 70 turns off the selection units 56 of the pixels in rows other than the first row. As a result, the signals of the R pixels 13(1,1) to G pixels 13(1,8) are output to the vertical signal lines 60a to 60h, respectively. The readout unit 214 reads out the signals output to the vertical signal line 60 from the R pixels 13(1,1) to G pixels 13(1,8).

[0109] Next, the vertical control unit 70 turns on the selection units 56 of the R pixels 13(3,1) to G pixels 13(3,8) constituting the first imaging pixel row 401 in the third row shown in FIG. 15. The vertical control unit 70 also turns off the selection units 56 of the pixels in rows other than the third row. As a result, the signals of the R pixels 13(3,1) to G pixels 13(3,8) are output to the vertical signal lines 60a to 60h, respectively. The readout unit 214 reads out the signals output to the vertical signal lines 60 from the R pixels 13(3,1) to G pixels 13(3,8).

[0110] Furthermore, the vertical control unit 70 turns on the selection units 56 of the G pixels 13(4,1) to B pixels 13(4,8) constituting the fourth row of the first imaging pixel row 402 shown in FIG. 15. The vertical control unit 70 also turns off the selection units 56 of the pixels in rows other than the fourth row. As a result, the signals of the G pixels 13(4,1) to B pixels 13(4,8) are output to the vertical signal lines 60a to 60h, respectively. The readout unit 214 reads out the signals output to the vertical signal lines 60 from the G pixels 13(4,1) to B pixels 13(4,8). Similarly, the imaging pixel rows (first imaging pixel row 401, second imaging pixel row 402) from the fifth row onwards are selected one by one. The vertical control unit 70 outputs signals from each pixel constituting the selected first imaging pixel row 401 and second imaging pixel row 402 to the vertical signal line 60. The readout unit 214 reads out signals output from the R pixels 13, G pixels 13, and B pixels 13 to the vertical signal line 60. The signals sequentially read out from each imaging pixel row are subjected to signal processing by the column circuit unit 80 etc., and then read out to the body control unit 210.

[0111] Thus, in the second readout mode, the readout unit 214 controls the vertical control unit 70 to read out signals from each pixel of the AF pixel row before the imaging pixel row. Therefore, the first and second signals Sig1, Sig2 of the AF pixel pair can be read out at high speed, and the time required for focus adjustment can be shortened. In addition, since the signals of each pixel of the AF pixel row are read out by the readout unit 214 separately from the signals of each pixel of the imaging pixel row, signals used for focus detection can be obtained efficiently, and the burden of signal processing for AF can be reduced. In addition, the camera 1 according to this embodiment reads out the first and second signals Sig1, Sig2 of the AF pixel pair selected based on the exit pupil distance of the photographing optical system 31, and performs focus detection processing. Therefore, focus detection with high accuracy can be performed.

[0112] When the second readout mode is set, the readout unit 214 may read out signals from each pixel in the imaging pixel row before the AF pixel row. In this case, too, the signals of the AF pixel pair selected based on the exit pupil distance of the imaging optical system 31 are read out and focus detection processing is performed, allowing for highly accurate focus detection. In addition, the signals of each pixel in the AF pixel row can be read out separately from the signals of each pixel in the imaging pixel row, reducing the burden of signal processing for AF.

[0113] Furthermore, when the readout unit 214 sets the second readout mode to read signals from each pixel of the imaging pixel rows (the first imaging pixel row 401 and the second imaging pixel row 402), the readout unit 214 may perform thinning readout, in which imaging pixels in a specific row or column among all the imaging pixels are thinned out and signals are read out. When performing thinning readout, the readout unit 214 selects imaging pixels in a specific row or column among all the imaging pixels and reads signals from the selected imaging pixels. The readout unit 214 controls the vertical control unit 70 to skip reading signals from pixels in a specific row or column, thereby enabling high-speed signal reading. In this case, by performing the second readout mode, signals from the AF pixel row can be read out before signals from the imaging pixel row are read out, and signals from the imaging pixel row can be read out at high speed. Therefore, by performing the second readout mode when displaying a live view image or shooting a video, high-speed focus detection and high-speed shooting are possible. Note that the readout unit 214 may add and read out signals from a plurality of imaging pixels.

[0114] According to the above-described embodiment, the following effects can be obtained. (1) The focus detection device includes an imaging section (image sensor 22) having a first pixel and a second pixel (AF pixel) that receive light transmitted through an optical system (photographing optical system 31) and output a signal used for focus detection, and a third pixel (imaging pixel) that receives light transmitted through the optical system and output a signal used for image generation, an input section (body control section 210) to which information related to the optical system is input, a selection section (pixel selection section 213) that selects at least one of the first pixel and the second pixel based on the information input to the input section, a readout section (readout section 214) that reads out at least one of the signal of the first pixel and the signal of the second pixel at a timing different from that of the signal of the third pixel based on the selection by the selection section, and a focus detection section 215 that performs focus detection based on at least one of the signal of the first pixel and the signal of the second pixel read out by the readout section. In this embodiment, the readout section 214 reads out signals from each pixel of the AF pixel row before the imaging pixel row. Therefore, the focus detection device can read out the signals of the AF pixel pairs at high speed, and can perform focus adjustment at high speed. Also, the signals of each pixel in the AF pixel row can be read out separately from the signals of each pixel in the imaging pixel row, and the burden of signal processing for AF can be reduced. Also, the focus detection unit 215 performs focus detection processing using the signals output from the AF pixel pairs selected based on the exit pupil distance of the photographing optical system 31. Therefore, focus detection with high accuracy can be performed.

[0115] The following modifications are also within the scope of the present invention, and one or more of the modifications may be combined with the above-described embodiment.

[0116] (Variation 1) In the first embodiment, three reference exit pupils (first to third exit pupils EP1 to EP3) are used as the reference exit pupils, but two reference exit pupils or four or more reference exit pupils may be used.

[0117] (Variation 2) The method of calculating the exit pupil distance according to the image height is not limited to the method using the above-mentioned formula (1). For example, instead of formula (1), a calculation formula using the cube of the image height may be used. Furthermore, information (table) showing the relationship between the image height and the exit pupil distance may be used without using a calculation formula.

[0118] (Variation 3) In the first embodiment, an example has been described in which information on the exit pupil distance is stored in advance in the lens memory 33 or the like, and the information on the exit pupil distance is input to the camera body 2 from the interchangeable lens 3. However, the information on the exit pupil distance may be input to the camera body 2 from a source other than the interchangeable lens 3. For example, the information on the exit pupil distance may be stored in advance in the body memory 23, and the body control unit 210 may acquire the information on the exit pupil distance from the body memory 23. In addition, the camera body 2 may acquire the information on the exit pupil distance from a storage medium, or may acquire the information on the exit pupil distance from an external device via wired communication or wireless communication. The information on the exit pupil distance may be information on the exit pupil distance corresponding to one image height.

[0119] (Variation 4) In the first embodiment, the parameters (h4), (h2) and the constant term Co used in calculating the exit pupil distance Po(H) have been given as examples of information related to the exit pupil distance. However, the camera body 2 may acquire the exit pupil distance value Po(H) itself corresponding to the image height from the interchangeable lens 3, a storage medium, etc. as information related to the exit pupil distance.

[0120] (Variation 5) In the above-described embodiment, an example has been described in which first to third AF pixel pairs having different amounts of deviation are arranged as multiple types of AF pixel pairs in the image sensor 22. However, multiple types of AF pixel pairs having different positions of light shielding parts between the color filter 51 and the photoelectric conversion unit 42 may be arranged in the image sensor 22. Fig. 16 is a diagram showing an example of the configuration of AF pixels in the image sensor 22 according to a modified example. In the figure, the same reference numbers are used for parts that are the same as or equivalent to those in the above-described embodiment.

[0121] The light-shielding portion 43L of the first AF pixel 11a is provided at a predetermined distance h1 from the photoelectric conversion unit 42 between the color filter 51 and the photoelectric conversion unit 42. The light-shielding portion 43L of the first AF pixel 11b is provided at a predetermined distance h2 from the photoelectric conversion unit 42 between the color filter 51 and the photoelectric conversion unit 42. The light-shielding portion 43L of the first AF pixel 11c is provided at a predetermined distance h3 from the photoelectric conversion unit 42 between the color filter 51 and the photoelectric conversion unit 42. The distance h2 is smaller than the distance h1 and larger than the distance h3. That is, h1>h2>h3. In this way, the first AF pixels 11a, 11b, and 11c differ in the arrangement position of the light-shielding portion 43L. The other second AF pixels 12a, 12b, and 12c constituting each AF pixel pair differ in the arrangement position of the light-shielding portion 43R. This allows the first to third AF pixel pairs to perform pupil division in response to mutually different angles of incidence, similar to the case of the above-described embodiment.

[0122] (Variation 6) In the first embodiment, an example in which one photoelectric conversion unit is arranged per pixel has been described, but the pixel may be configured to have two or more photoelectric conversion units per pixel.

[0123] (Variation 7) FIG. 17 is a diagram showing an example of the configuration of an AF pixel of an image sensor 22 according to a modified example. As an example, FIG. 17 shows a cross-sectional view of some three types of AF pixel pairs in the focus detection area 100c of FIG. 2. In the figure, the same reference numerals are used for the same or corresponding parts as those in the above-mentioned embodiment. Each of the three types of AF pixels shown in FIG. 17(a) to (c) has a microlens 44, and a first photoelectric conversion unit 42a and a second photoelectric conversion unit 42b that photoelectrically convert light transmitted through the microlens 44. In this modified example, the first to third AF pixel pairs have different light receiving areas for the first photoelectric conversion unit 42a and the second photoelectric conversion unit 42b that receive light. In this case, the first to third AF pixel pairs can perform pupil division in response to different incident angles, as in the case of the above-mentioned embodiment.

[0124] (Variation 8) The pixel selection unit 213 may select a plurality of types of AF pixel pairs. In this case, the focus detection unit 215 may calculate a plurality of defocus amounts from the selected plurality of types of AF pixel pairs, and calculate the movement amount of the focus lens 31b based on the average value of the defocus amounts. For example, the movement amount of the focus lens 31b may be determined based on the defocus amount calculated using the first and second signals Sig1, Sig2 of the first AF pixel pair, and the average value of the defocus amount calculated using the first and second signals Sig1, Sig2 of the second AF pixel pair.

[0125] (Variation 9) In the above embodiment, a case has been described in which a primary color (RGB) color filter is used in the imaging element 22, but a complementary color (CMY) color filter may also be used.

[0126] (Variation 10) The imaging devices described in the above-mentioned embodiments and modifications may be applied to cameras, smartphones, tablets, cameras built into PCs, in-vehicle cameras, cameras mounted on unmanned aerial vehicles (drones, radio-controlled aircraft, etc.), and the like.

[0127] Although various embodiments and modifications have been described above, the present invention is not limited to these. Other embodiments that are conceivable within the scope of the technical idea of ​​the present invention are also included within the scope of the present invention.

[0128] The disclosures of the following priority applications are incorporated herein by reference: Japan Patent Application No. 2018-137274 (filed July 20, 2018) [Explanation of symbols]

[0129] 1...imaging device, 2...camera body, 3...interchangeable lens, 11...AF pixel, 12...AF pixel, 13...imaging pixel, 22...imaging element, 31...imaging optical system, 32...lens control unit, 42...photoelectric conversion unit, 210...body control unit, 211...area setting unit, 212...distance calculation unit, 213...pixel selection unit, 214...reading unit, 215...focus detection unit, 216...image data generation unit

Claims

1. A first pixel pair having a first light-shielding portion, the first pixel pair receiving light that has passed through different regions of an exit pupil of an optical system and outputting a signal used for focus detection; a second pixel pair that has a second light-shielding portion having an area different from that of the first light-shielding portion, receives light that has passed through different regions of an exit pupil of the optical system, and outputs a signal used for focus detection; a third pixel that receives light transmitted through the optical system and outputs a signal used for generating an image; an output unit that outputs a signal of one of the first pixel pair and the second pixel pair, selected based on an exit pupil distance determined from information about a position of a set focus detection area and information about the optical system, at a timing different from the timing of outputting the signal of the third pixel; and An imaging element comprising:

2. 2. The imaging device according to claim 1, The output section is an imaging element that outputs a signal from the one pixel pair before a signal from the third pixel.

3. 3. The imaging device according to claim 2, the output unit is an image sensor capable of switching between a first readout in which a signal of one of the pixel pairs is output before a signal of the third pixel, and a second readout in which signals are output in order from smallest row to largest row depending on the row in which the first pixel pair, the second pixel pair, and the third pixel are arranged, regardless of the exit pupil distance.

4. 4. The imaging device according to claim 3, A plurality of the third pixels are provided, The output unit performs the first readout when it thins out and outputs the signals of the plurality of third pixels, or when it adds up and outputs the signals of the plurality of third pixels, and performs the second readout when it outputs the signals of the plurality of third pixels without performing either thinning out or adding up.

5. 5. The imaging device according to claim 1, an imaging element including a signal line for outputting a signal from the one pixel pair and a signal from the third pixel;

6. 6. The imaging device according to claim 1, the first pixel pair includes a first pixel, and the second pixel pair includes a second pixel; At least one of the third pixels is provided between the first pixel and the second pixel in the column direction.

7. 6. The imaging device according to claim 1, the first pixel pair includes a first pixel, and the second pixel pair includes a second pixel; a first pixel row including a plurality of the first pixels arranged along a first direction, a second pixel row including a plurality of the second pixels arranged along the first direction, and a third pixel row including a plurality of the third pixels arranged along the first direction, the third pixel row, the first pixel row, and the second pixel row are arranged in this order from the top in a second direction perpendicular to the first direction; an imaging element that, when the first pixel pair is selected, outputs signals of the pixels in the first pixel row before signals of the pixels in the third pixel row, and, when the second pixel pair is selected, outputs signals of the pixels in the second pixel row before signals of the pixels in the third pixel row.

8. The imaging element according to any one of claims 1 to 7, the first pixel pair and the second pixel pair are provided in both a first region and a second region located farther away from an optical axis of the optical system than the first region, When both the first area and the second area are set as the focus detection area, the output section outputs a signal of one of the pixel pairs selected based on an exit pupil distance determined from information regarding the position of the second area and information regarding the optical system.

9. 9. The imaging device according to claim 1, The information about the optical system is information about an exit pupil distance of the optical system.

10. 10. The imaging device according to claim 1, An image sensor, wherein the information about the optical system is information about a position on an image plane and an exit pupil distance of the optical system.

11. The imaging element according to any one of claims 1 to 10, a focus detection unit that performs focus detection based on a signal from the one pixel pair; An imaging device comprising:

Images