Imaging element, focus detection device, and imaging device

Abstract

An imaging element is provided with: a first pixel and a second pixel each having a pair of photoelectric conversion units for receiving light beams passing through different pupil regions of an exit pupil of an optical system, the first pixel and the second pixel outputting a signal for focus detection of the optical system; and a control unit that performs a first control for outputting both a signal of one selected one of the first pixel and the second pixel and a signal of the other selected one of the first pixel and the second pixel, and a second control for outputting both a signal of the other selected one of the first pixel and the second pixel and a signal of the other selected one of the first pixel and the second pixel. And a signal output unit that outputs a signal of the one of the first pixel and the second pixel.

Description

Technical Field

[0001] It involves imaging elements, focus detection devices, and imaging devices. Background Technology

[0002] A known imaging device selects an AF pixel pair corresponding to the exit pupil position of a lens from a variety of AF pixel pairs for focus detection (Patent Document 1). There has always been a demand for improved focus detection accuracy.

[0003] Existing technical documents

[0004] Patent documents

[0005] Patent Document 1: Japanese Patent Application Publication No. 2009-204987 Summary of the Invention

[0006] According to the disclosed technical solution, the imaging element includes: a first pixel and a second pixel, each having a pair of photoelectric conversion units that receive light beams from different pupil regions of the exit pupil of the optical system and output signals for focus detection of the optical system; and a control unit that performs a first control and a second control, wherein in the first control, both the signal of a selected pixel of the first pixel and the second pixel and the signal of the other pixel of the first pixel and the second pixel are output, and in the second control, the signal of the selected pixel of the first pixel and the second pixel is output.

[0007] According to another disclosed technical solution, the imaging device includes: the aforementioned imaging element; and a generation unit that generates image data based on a signal output from the imaging element.

[0008] According to another disclosed technical solution, a focus detection device comprises: an imaging unit having a first pixel and a second pixel, the first pixel and the second pixel each having a pair of photoelectric conversion units for receiving light beams from different pupil regions of an exit pupil of an optical system; a detection unit for performing focus detection of the optical system based on signals from the first pixel and the second pixel; a selection unit for selecting a pixel of either the first pixel or the second pixel; and a control unit for controlling the position of the optical system, wherein the control unit is activated when the detection unit fails to detect a focus based on a signal from either the first pixel or the second pixel. If the focus detection of the optical system is successfully performed, and the focus detection of the optical system is successfully performed based on the signal of the other of the first pixel and the second pixel, the position of the optical system is controlled after a first period following the receipt of an instruction to perform focus detection of the optical system. If the focus detection of the optical system is unsuccessful by the detection unit based on either the signal of the first pixel or the signal of the second pixel, the position of the optical system is controlled after a second period following the receipt of an instruction to perform focus detection of the optical system, the second period being shorter than the first period.

[0009] According to another disclosed technical solution, the shooting device includes: the aforementioned focus detection device; and a loading and unloading section, which is capable of loading and unloading a replaceable lens having the optical system.

[0010] Furthermore, the configuration of the embodiments described later can be appropriately modified, and at least some components can be replaced with other components. Moreover, the configuration elements are not particularly limited in terms of their arrangement and are not limited to the configuration disclosed in the embodiments; they can be arranged in a position that enables their function. Attached Figure Description

[0011] Figure 1 This is a diagram illustrating an example of the configuration of a photographing device according to one embodiment.

[0012] Figure 2 (A) is a diagram representing the focus detection area of ​​the imaging surface of the imaging element. Figure 2 (B) is a diagram representing a small region within the focal detection area.

[0013] Figure 3 This is a diagram showing an example of the pixel configuration within the focus detection area.

[0014] Figure 4 It is a graph representing the relationship between the first pixel set, the second pixel set, the third pixel set, and the focus detection region.

[0015] Figure 5(A) ~ Figure 5 (C) is a diagram illustrating an example of the configuration of the focus detection pixel and the shooting pixel set in the pixel section.

[0016] Figure 6 (A) and Figure 6 (B) is a diagram used to explain focus detection based on the first and second signals output from the AF pixel pairs selected by the selection unit.

[0017] Figure 7 This is a flowchart (1) illustrating an example of the processing performed by the main control unit involved in the implementation.

[0018] Figure 8 This is a flowchart (2) illustrating an example of the processing performed by the main control unit involved in the implementation method.

[0019] Figure 9 This is a flowchart (3) illustrating an example of the processing performed by the main control unit involved in the implementation method.

[0020] Figure 10 This diagram schematically illustrates the processes performed by the main control unit involved in the implementation method.

[0021] Figure 11 This is a graph illustrating an example of the relationship between the position of the focusing lens and the reliability calculated by the subject detection unit.

[0022] Figure 12 This is a flowchart (1) illustrating an example of the processing performed by the main control unit involved in the variation.

[0023] Figure 13 This is a flowchart (2) illustrating an example of the processing performed by the main control unit involved in the variation.

[0024] Figure 14 This is a flowchart (3) illustrating an example of the processing performed by the main control unit involved in the variation.

[0025] Figure 15 This is a flowchart (4) illustrating an example of the processing performed by the main control unit involved in the variation.

[0026] Figure 16 This is a flowchart (5) illustrating an example of the processing performed by the main control unit involved in the variation.

[0027] Figure 17 This is a diagram that schematically illustrates the processing steps S101 to S135. Detailed Implementation

[0028] The following is for reference Figures 1-11An example of an imaging device according to one embodiment, an electronic camera 1 (hereinafter referred to as camera 1), will be described.

[0029] Figure 1 This diagram illustrates a configuration example of an electronic camera 1 (hereinafter referred to as camera 1) according to one embodiment. Camera 1 includes a camera body 2 and an interchangeable lens 3. Since camera 1 includes a camera body 2 and an interchangeable lens 3, it is sometimes referred to as a camera system.

[0030] (Change lens 3)

[0031] The interchangeable lens 3 includes a lens-side mounting portion 301, an imaging optical system (imaging optical system) 31, a lens control portion 32, and a lens memory 33. The lens-side mounting portion 301 includes a lens-side connecting portion 302. The lens-side connecting portion 302 has multiple terminals, such as a terminal for clock signals, a terminal for data signals, and a terminal for power supply. The interchangeable lens 3 is detachably mounted to the camera body 2 using the lens-side mounting portion 301 and the body-side mounting portion 201 (described later).

[0032] The imaging optical system 31 includes multiple lenses and an aperture 31c, forming an image of the subject on the imaging surface 22a of the imaging element 22. The multiple lenses include a zoom lens (magnification-changing lens) 31a for changing the focal length and a focusing lens (focusing lens) 31b. Furthermore, in Figure 1 The image schematically illustrates zoom lens 31a and focusing lens 31b, but typical shooting optical systems generally consist of many optical elements.

[0033] As described later, the imaging optical system 31 of the interchangeable lens 3 has the optical characteristic that the position of its exit pupil, i.e., the exit pupil distance, varies with the image height. In other words, the exit pupil distance of the imaging optical system 31 varies depending on its position on the imaging surface 22a, i.e., the distance on the imaging surface 22a from the optical axis OA1 of the imaging optical system 31. The optical axis OA1 of the imaging optical system 31 intersects the imaging surface 22a at its center. Alternatively, it can be said that the exit pupil distance of the imaging optical system 31 varies with its distance from the center of the imaging surface 22a. Here, the exit pupil distance refers to the distance between the exit pupil of the imaging optical system 31 and the image plane of the image formed by the imaging optical system 31. Furthermore, the imaging surface 22a of the imaging element 22 may be, for example, the surface where the photoelectric conversion unit described later is disposed, or the surface where a microlens is disposed.

[0034] The imaging optical system 31 varies depending on the type of interchangeable lens 3 mounted on the main body side mounting portion 201. Therefore, the exit pupil distance of the imaging optical system 31 varies depending on the type of interchangeable lens 3. Furthermore, the optical characteristics of the exit pupil distance, which vary according to the image height, also differ depending on the type of interchangeable lens 3.

[0035] The lens control unit 32 consists of processors such as CPU, FPGA, and ASIC, and memories such as ROM and RAM. It controls the various parts of the interchangeable lens 3 based on a control program. The lens control unit 32 controls the position of the zoom lens 31a, the position of the focusing lens 31b, and the drive of the aperture 31c based on signals output from the main control unit 21 of the camera body 2. When a signal indicating the movement direction and amount of the focusing lens 31b is input from the main control unit 21, the lens control unit 32 moves the focusing lens 31b back and forth along the optical axis OA1 based on this signal, thereby adjusting the focus position of the shooting optical system 31. Furthermore, the lens control unit 32 controls the position of the zoom lens 31a and the aperture diameter of the aperture 31c based on signals output from the main control unit 21 of the camera body 2.

[0036] The lens memory 33 is constructed, for example, from a non-volatile storage medium. The lens memory 33 stores (records) information associated with the interchangeable lens 3 as lens information. This lens information includes data related to the optical characteristics of the shooting optical system 31 (exit pupil distance, F-number), data related to the infinity and near positions of the focusing lens 31b, and data related to the shortest and longest focal lengths of the interchangeable lens 3. The optical characteristics of the shooting optical system 31 include the exit pupil distance and F-number (aperture value of aperture 31c). Furthermore, the lens information varies depending on the type of interchangeable lens 3. Alternatively, the lens information can be stored in the memory inside the lens control unit 32. Additionally, the lens information can also be stored in the main memory 23 of the camera body 2, described later. In this case, the main memory 23 stores lens information for multiple interchangeable lenses 3.

[0037] In this embodiment, the lens information includes information related to the exit pupil distance of the shooting optical system 31. The exit pupil distance related information includes the exit pupil distance (Co) at the position where the shooting surface 22a intersects the optical axis OA1 (the position where the image height is zero), and information about the coefficients included in the formula representing the relationship between the exit pupil distance and the image height. The writing of data to the lens memory 33 and the reading of data from the lens memory 33 are controlled by the lens control unit 32. When the lens 3 is replaced and mounted onto the camera body 2, the lens control unit 32 sends the lens information to the body control unit 21 via the terminals of the lens-side connection 302 and the body-side connection 202. In addition, the lens control unit 32 sends the position information (focal length information) of the controlled zoom lens 31a, the position information of the controlled focusing lens 31b, and the F-value information of the controlled aperture 31c to the body control unit 21.

[0038] The lens control unit 32 communicates bidirectionally between the camera body 2 and the interchangeable lens 3 via terminals of the lens-side connector 302 and the body-side connector 202. When a signal requesting the transmission of information related to the exit pupil distance is received from the camera body 2, the lens control unit 32 transmits such information to the camera body 2. Furthermore, the information related to the exit pupil distance varies depending on the type of interchangeable lens 3. Additionally, the lens control unit 32 can also transmit the information related to the exit pupil distance to the camera body 2 whenever the imaging element 22 is capturing an image. The lens control unit 32 can also transmit the information related to the exit pupil distance to the camera body 2 when the focal length of the imaging optical system 31 changes due to the movement of the zoom lens 31a. The lens control unit 32 can also transmit both the focal length information of the imaging optical system 31 and the information related to the exit pupil distance to the camera body 2 in a single bidirectional communication.

[0039] (Camera body 2)

[0040] The camera body 2 includes a body-side mounting portion 201, an imaging element 22, a main memory 23, a display portion 24, an operation portion 25, and a main control portion 21. In this embodiment, the imaging element 22 and the main control portion 21 constitute a focus detection device 4.

[0041] The main body side mounting part 201 includes a main body side connecting part 202. The main body side connecting part 202 has multiple terminals, such as a clock signal terminal, a data signal terminal, and a power supply terminal.

[0042] When the interchangeable lens 3 is assembled to the camera body 2, the terminal provided on the body-side connecting part 202 is electrically connected to the lens-side connecting part 302. This enables power supply from the camera body 2 to the interchangeable lens 3 and communication between the camera body 2 and the interchangeable lens 3.

[0043] The imaging element 22 is a CMOS image sensor or a CCD image sensor. The imaging element 22 captures an image of the subject formed by the imaging optical system 31. The imaging element 22 includes a pixel section 221 arranged in a two-dimensional shape (along the row and column directions) with multiple pixels having photoelectric conversion units, and a control section 222 that controls the pixel section 221. The photoelectric conversion unit is composed of a photodiode (PD).

[0044] As will be explained later, the pixel unit 221 includes a capturing pixel and a focus detection pixel. The capturing pixel uses a photoelectric conversion unit to perform photoelectric conversion on the received light and outputs a signal for image generation. The focus detection pixel uses a photoelectric conversion unit to perform photoelectric conversion on the received light and outputs a signal for focus detection. The capturing pixel includes: a pixel (hereinafter referred to as an R pixel) having a filter that has a beam splitting characteristic for light in the first wavelength region (red (R) light) of the incident light; a pixel (hereinafter referred to as a G pixel) having a filter that has a beam splitting characteristic for light in the second wavelength region (green (G) light) of the incident light; and a pixel (hereinafter referred to as a B pixel) having a filter that has a beam splitting characteristic for light in the third wavelength region (blue (B) light) of the incident light. The R pixel, G pixel, and B pixel are arranged in a Bayer arrangement. The focus detection pixel is arranged in a manner that replaces a portion of the capturing pixel and is distributed over approximately the entire surface of the capturing surface 22a of the capturing element 22.

[0045] The control unit 222 outputs the signal of the focus detection pixel based on the instruction signal from the main control unit 21. Additionally, the control unit 222 outputs the signal of the imaging pixel based on the instruction signal from the main control unit 21.

[0046] The main memory 23 is constructed, for example, from a non-volatile storage medium. Image data, control programs, etc., are recorded in the main memory 23. The writing of data to the main memory 23 and the reading of data from the main memory 23 are controlled by the main control unit 21. The display unit 24 displays images based on image data, images showing focus detection areas (AF areas) such as AF frames, shooting-related information such as shutter speed and F-stop, as well as menu screens, etc.

[0047] The operation unit 25 includes a release button, a power switch, and various setting switches such as switches for switching between different modes, and outputs operation signals corresponding to their respective operations to the main control unit 21. Furthermore, the operation unit 25 is a setting unit capable of setting any focus detection area from multiple focus detection areas, allowing the user to select any focus detection area by operating the operation unit 25.

[0048] The main control unit 21 consists of processors such as CPU, FPGA, and ASIC, and memories such as ROM and RAM, and controls various parts of the camera 1 based on a control program. The main control unit 21 includes an image data generation unit 211, a subject detection unit 212, a region setting unit 213, a distance calculation unit 214, a selection unit 215, a focus detection unit 216, and a position control unit 217. The image data generation unit 211, subject detection unit 212, region setting unit 213, distance calculation unit 214, selection unit 215, focus detection unit 216, and position control unit 217 are implemented, for example, by a processor executing a program.

[0049] The image data generation unit 211 performs various image processing operations on the signal output from the imaging pixel of the imaging element 22 to generate image data. Alternatively, the image data generation unit 211 may also use the signal output from the focus detection pixel to generate image data.

[0050] The subject detection unit 212 detects predetermined subjects from images based on image data generated by the image data generation unit 211. For example, when a "bird mode" suitable for photographing wild birds is set to the shooting mode, the subject detection unit 212 detects birds as subjects. Similarly, when an "airplane mode" suitable for photographing airplanes is set to the shooting mode, the subject detection unit 212 detects airplanes as subjects. Furthermore, when a "portrait mode" suitable for photographing people is set to the shooting mode, the subject detection unit 212 detects people as subjects.

[0051] Region setting section 213 settings (selection) in Figure 2 At least one of the multiple focus detection areas 100 provided on the shooting surface 22a of the shooting element 22 shown in (A) is a focus detection area. Multiple AF frames displayed on the display unit 24 correspond to the multiple focus detection areas 100 provided on the shooting element 22. The area setting unit 213 sets, for example, the focus detection area 100 among the multiple AF frames displayed on the display unit 24 that corresponds to the AF frame selected by the user through the operation unit 25, or the focus detection area 100 that corresponds to the AF frame containing the subject detected by the subject detection unit 212, as the area for focus detection.

[0052] In each focus detection area 100, in addition to the shooting pixels, there are also multiple types of focus detection pixel pairs (AF pixel pairs).

[0053] Figure 3 This is a diagram showing an example of the pixel configuration within the focus detection region 100. Figure 3In the middle, a first pixel group 401, in which R pixels 13 and G pixels 13 are alternately arranged in the ±X direction, i.e., the row direction, and a second pixel group 402, in which G pixels 13 and B pixels 13 are alternately arranged in the row direction, are alternately arranged in the ±Y direction, i.e., the column direction. The shooting pixels 13 are arranged according to the Bayer arrangement.

[0054] A portion of the plurality of second pixel groups 402 includes a first or a second focus detection pixel 11, 12. The first and second focus detection pixels 11, 12 each have a light-shielding portion 43. Figure 3 In the diagram, the second pixel group 402, including the first focus detection pixel 11, is represented by second pixel groups 402a, 402c, and 402e, and the second pixel group 402, including the second focus detection pixel 12, is represented by second pixel groups 402b, 402d, and 402f. The second pixel groups 402a, 402c, and 402e including the first focus detection pixel 11 and the second pixel groups 402b, 402d, and 402f including the second focus detection pixel 12 will be explained below.

[0055] In the second pixel group 402a, B pixel 13 is replaced by the first focus detection pixel 11a. The first focus detection pixel 11a and G pixel 13 are alternately arranged in the second pixel group 402a. Furthermore, the photoelectric conversion unit of the first focus detection pixel 11a receives a light beam passing through one of the first and second pupil regions of the exit pupil of the imaging optical system 31. The light-shielding part 43 of the first focus detection pixel 11a blocks the light beam passing through the other of the first and second pupil regions of the exit pupil of the imaging optical system 31. In the following description, the photoelectric conversion unit of the first focus detection pixel 11a is assumed to receive a light beam passing through the first pupil region of the exit pupil of the imaging optical system 31. The light-shielding part 43 of the first focus detection pixel 11a is assumed to block a light beam passing through the second pupil region of the exit pupil of the imaging optical system 31.

[0056] In a second pixel group 402b, which is a predetermined row away from the second pixel group 402a, the B pixel 13 is replaced by the second focus detection pixel 12a. In the second pixel group 402b, the second focus detection pixel 12a and the G pixel 13 are alternately arranged. Furthermore, the photoelectric conversion unit of the second focus detection pixel 12a receives a light beam passing through a pupil region different from that of the first focus detection pixel 11a. The light-shielding part 43 of the second focus detection pixel 12a blocks the light beam passing through a pupil region different from that of the first focus detection pixel 11a. In the following description, the photoelectric conversion unit of the second focus detection pixel 12a is assumed to receive a light beam passing through a second pupil region of the exit pupil of the imaging optical system 31. The light-shielding part 43 of the second focus detection pixel 12a is assumed to block the light beam passing through a first pupil region of the exit pupil of the imaging optical system 31.

[0057] Furthermore, the configuration positions of the first focus detection pixel 11a in the second pixel group 402a and the second focus detection pixel 12a in the second pixel group 402b are the same. That is, the first focus detection pixel 11a and the second focus detection pixel 12a are configured in the same column.

[0058] The first focus-detecting pixel 11a of the second pixel group 402a and the second focus-detecting pixel 12a of the second pixel group 402b constitute the first AF pixel pair PR1. Alternatively, the second pixel groups 402a and 402b can be configured in multiple rows, thereby configuring multiple first AF pixel pairs PR1. The set of pixels including the first AF pixel pair PR1 and the capturing pixel 13 is defined as the first pixel set 400-1.

[0059] In the second pixel group 402c, which is a predetermined row away from the second pixel group 402b, the B pixel 13 is replaced by the first focus detection pixel 11b. In the second pixel group 402c, the first focus detection pixel 11b and the G pixel 13 are alternately arranged. Similar to the first focus detection pixel 11a, the photoelectric conversion unit of the first focus detection pixel 11b receives the light beam passing through the first pupil region of the exit pupil of the imaging optical system 31. Similar to the light-shielding unit 43 of the first focus detection pixel 11a, the light-shielding unit 43 of the first focus detection pixel 11b blocks the light beam passing through the second pupil region of the exit pupil of the imaging optical system 31.

[0060] In a second pixel group 402d, which is a predetermined row away from the second pixel group 402c, the B pixel 13 is replaced by the second focus detection pixel 12b. In the second pixel group 402d, the second focus detection pixel 12b and the G pixel 13 are alternately arranged. Similar to the second focus detection pixel 12a, the photoelectric conversion unit of the second focus detection pixel 12b receives the light beam passing through the second pupil region of the exit pupil of the imaging optical system 31. Similar to the light-shielding unit 43 of the second focus detection pixel 12a, the light-shielding unit 43 of the second focus detection pixel 12b blocks the light beam passing through the first pupil region of the exit pupil of the imaging optical system 31.

[0061] Furthermore, the configuration positions of the first focus detection pixel 11b in the second pixel group 402c and the second focus detection pixel 12b in the second pixel group 402d are the same. That is, the first focus detection pixel 11b and the second focus detection pixel 12b are configured in the same column.

[0062] The first focus-detecting pixel 11b of the second pixel group 402c and the second focus-detecting pixel 12b of the second pixel group 402d constitute the second AF pixel pair PR2. Alternatively, the second pixel groups 402c and 402d can be configured in multiple rows, thereby configuring multiple second AF pixel pairs PR2. The set of pixels including the second AF pixel pair PR2 and the capturing pixel 13 is defined as the second pixel set 400-2.

[0063] In the second pixel group 402e, which is a predetermined row away from the second pixel group 402d, the B pixel 13 is replaced by the first focus detection pixel 11c. In the second pixel group 402e, the first focus detection pixel 11c and the G pixel 13 are alternately arranged. Similar to the first focus detection pixels 11a and 11b, the photoelectric conversion unit of the first focus detection pixel 11c receives the light beam passing through the first pupil region of the exit pupil of the imaging optical system 31. Similar to the light-shielding units 43 of the first focus detection pixels 11a and 11b, the light-shielding unit 43 of the first focus detection pixel 11c blocks the light beam passing through the second pupil region of the exit pupil of the imaging optical system 31.

[0064] In the second pixel group 402f, which is a predetermined row away from the second pixel group 402e, the B pixel 13 is replaced by the second focus detection pixel 12c. In the second pixel group 402f, the second focus detection pixel 12c and the G pixel 13 are alternately arranged. Furthermore, the photoelectric conversion section of the second focus detection pixel 12c receives the light beam passing through the second pupil region of the exit pupil of the imaging optical system 31. Similar to the light-shielding sections 43 of the second focus detection pixels 12a and 12b, the light-shielding section 43 of the second focus detection pixel 12c blocks the light beam passing through the first pupil region of the exit pupil of the imaging optical system 31.

[0065] Furthermore, the configuration positions of the first focus detection pixel 11c in the second pixel group 402e and the second focus detection pixel 12c in the second pixel group 402f are the same. That is, the first focus detection pixel 11c and the second focus detection pixel 12c are configured in the same column.

[0066] The first focus-detecting pixel 11c of the second pixel group 402e and the second focus-detecting pixel 12c of the second pixel group 402f constitute the third AF pixel pair PR3. Alternatively, the second pixel groups 402e and 402f can be configured in multiple rows, thereby configuring multiple third AF pixel pairs PR3. The set of pixels including the third AF pixel pair PR3 and the capturing pixel 13 is defined as the third pixel set 400-3.

[0067] Figure 4 This is a diagram showing the relationship between the first pixel set 400-1, the second pixel set 400-2, the third pixel set 400-3, and the focus detection region 100. (Example) Figure 4 As shown, each focus detection region 100 includes a first pixel set 400-1, a second pixel set 400-2, and a third pixel set 400-3. The first pixel set 400-1 of adjacent focus detection regions 100 in the X direction (row direction) is adjacent in the X direction. The second pixel set 400-2 of adjacent focus detection regions 100 in the X direction is adjacent in the X direction. The third pixel set 400-3 of adjacent focus detection regions 100 in the X direction is adjacent in the X direction. Therefore, as... Figure 4 As shown, in the X direction (row direction), the first pixel set 400-1, the second pixel set 400-2, and the third pixel set 400-3 are arranged consecutively. On the other hand, in the Y direction (column direction), the first pixel set 400-1, the second pixel set 400-2, and the third pixel set 400-3 are arranged repeatedly in sequence.

[0068] Except for the pixel pairs located around the optical axis OA1 (center of the shooting surface 22a) of the shooting optical system 31, the areas of the light-shielding portions 43 of the first AF pixel pair PR1, the second AF pixel pair PR2, and the third AF pixel pair PR3 are different. When the exit pupil distance is different, the incident angle of light incident on the focus detection pixels, except for the focus detection pixels located around the optical axis OA1 of the shooting optical system 31, is different. When the exit pupil distance is shorter, the incident angle is larger, and when the exit pupil distance is longer, the incident angle is smaller. In order to block a portion of the light incident at different incident angles depending on the exit pupil distance, the area of ​​the light-shielding portion 43 is different for each AF pixel pair. Thus, even with different exit pupil distances, the focus detection unit 216 can detect the defocus amount with high accuracy. However, for the pixel pairs located around the optical axis OA1 (center of the shooting surface 22a) of the shooting optical system 31, the incident angle is 0° regardless of the exit pupil distance. Therefore, the light-shielding portions 43 of the first AF pixel pair PR1, the second AF pixel pair PR2, and the third AF pixel pair PR3, located around the optical axis OA1 (center of the shooting surface 22a) of the shooting optical system 31, each have the same area. The area of ​​the light-shielding portion 43 also varies depending on the position (image height) of the focus detection pixel.

[0069] In this embodiment, the first focus detection pixels 11a-11c and the second focus detection pixels 12a-12c each have a filter that has a beam-splitting characteristic for splitting light in the second wavelength region (green (G) light) of the incident light. Furthermore, the filter in each of the first focus detection pixels 11a-11c and the second focus detection pixels 12a-12c may also be a filter that has a beam-splitting characteristic for splitting light in the first wavelength region (red (R) light) or light in the third wavelength region (blue (B) light). Additionally, the first focus detection pixels 11a-11c and the second focus detection pixels 12a-12c may also have a filter that has a beam-splitting characteristic for splitting light in the first, second, and third wavelength regions of the incident light.

[0070] Figure 5 (A) ~ Figure 5 (C) is a diagram illustrating an example of the configuration of the focus detection pixel and the shooting pixel provided in the pixel unit 221. Figure 5 (A) represents an example of a cross-section of the first focus detection pixel 11 in the first and second focus detection pixels 11 and 12 that constitute the AF pixel pair. Figure 5 (B) represents an example of a cross section of the second focus detection pixel 12 among the first and second focus detection pixels 11 and 12. Figure 5 (C) represents an example of a cross section of 13 pixels (R pixel, G pixel, B pixel).

[0071] exist Figure 5 (A) ~ Figure 5 In (C), the first and second focus detection pixels 11 and 12 and the capturing pixel 13 each have a microlens 44, a color filter 51, and a photoelectric conversion unit 42 (PD42). The photoelectric conversion unit 42 performs photoelectric conversion on the light that passes through the microlens 44 and the color filter 51. The first beam 61 is a beam that passes through a first pupil region that roughly bisects the exit pupil of the capturing optical system 31. The second beam 62 is a beam that passes through a second pupil region that roughly bisects the exit pupil of the capturing optical system 31.

[0072] exist Figure 5 In (A), a light-shielding part 43 is provided in the first focus detection pixel 11 to block the second beam 62 of the first and second beams 61 and 62. The light-shielding part 43 is located between the color filter 51 and the photoelectric conversion unit 42, and is provided on the photoelectric conversion unit 42. Figure 5 In the example shown in (A), the light-shielding part 43 is configured to block the light from the left half (-X direction side) of the photoelectric conversion part 42. The right end (the end in the +X direction) of the light-shielding part 43 is approximately aligned with the center line that bisects the photoelectric conversion part 42. The photoelectric conversion part 42 of the first focus detection pixel 11 receives the first light beam 61. The photoelectric conversion part 42 of the first focus detection pixel 11 performs photoelectric conversion on the first light beam 61 to generate a charge, and the first focus detection pixel 11 outputs a first signal Sig1 based on the charge generated by the photoelectric conversion part 42.

[0073] Furthermore, apart from the first focus detection pixel 11 located around the optical axis OA1 (center of the imaging surface 22a) of the imaging optical system 31, the area of ​​the light-shielding portion 43 varies depending on the position (image height) of the first focus detection pixel 11. When the position of the first focus detection pixel 11 is different, i.e., the image height is different, the angle of incidence of the light incident on the first focus detection pixel 11 is different. When the image height increases, the angle of incidence increases; when the image height decreases, the angle of incidence decreases; and when the image height is 0, the angle of incidence is 0°. In order to block the second beam 62 in the light incident at an angle of incidence that varies depending on the image height, the area of ​​the light-shielding portion 43 varies depending on the image height.

[0074] exist Figure 5 In (B), a light-shielding part 43 is provided in the second focus detection pixel 12 to block the first beam 61 of the first and second beams 61 and 62. The light-shielding part 43 is located between the color filter 51 and the photoelectric conversion unit 42, and is provided on the photoelectric conversion unit 42. Figure 5In the example shown in (B), the light-shielding part 43 is configured to block the light from the right half (+X direction side) of the photoelectric conversion part 42. The left end (the end in the -X direction) of the light-shielding part 43 is approximately aligned with the center line that bisects the photoelectric conversion part 42. The photoelectric conversion part 42 of the second focus detection pixel 12 receives the second beam 62. The photoelectric conversion part 42 of the second focus detection pixel 12 performs photoelectric conversion on the second beam 62 to generate a charge, and the second focus detection pixel 12 outputs a second signal Sig2 based on the charge generated by the photoelectric conversion part 42.

[0075] Furthermore, similar to the first focus detection pixel 11, except for the second focus detection pixel 12 located around the optical axis OA1 (center of the imaging surface 22a) of the imaging optical system 31, the area of ​​the light-shielding portion 43 varies depending on the position (image height) of the second focus detection pixel 12. In order to block the first beam 61 of light incident at an angle of incidence that varies depending on the image height, the area of ​​the light-shielding portion 43 varies depending on the image height. The area of ​​the light-shielding portion 43 can be set according to the position (image height) of the focus detection pixel, for example, as disclosed in WO2020 / 017640.

[0076] exist Figure 5 In (C), the photoelectric conversion unit 42 of the imaging pixel 13 receives the first and second light beams 61 and 62 that have passed through the first and second pupil regions of the imaging optical system 31, respectively. The photoelectric conversion unit 42 of the imaging pixel 13 performs photoelectric conversion on the first and second light beams 61 and 62 to generate charges, and the imaging pixel 13 outputs a signal (imaging signal) based on the charges generated by the photoelectric conversion unit 42.

[0077] In addition, such as Figure 2 As shown in (A), multiple focus detection regions 100 are arranged in a two-dimensional direction (row and column directions) and positioned at different image heights. A small region 110a within the focus detection region 100a at the center of the imaging surface 22a (see reference) Figure 2 (B) is located on the optical axis OA1 of the imaging optical system 31, and its image height H is approximately zero. As the focus detection area 100 moves away from the center of the imaging surface 22a (the optical axis OA1 of the imaging optical system 31), its image height H increases. In other words, as the distance of the focus detection area 100 from the center of the imaging surface 22a increases, its image height H increases. Therefore, the focus detection areas 100 furthest from the optical axis OA1 of the imaging optical system 31 (with the highest image height H) in the row containing focus detection area 100a are focus detection areas 100b and 100c located at the left end (end in the -X direction) and right end (end in the +X direction) of the row. The focus detection areas 100 with the highest image height H in the imaging element 22 are the four focus detection areas 100 located at the corners of the imaging surface 22a.

[0078] Furthermore, since the focus detection region 100 has a predetermined area, the image height varies for each focus-detected pixel depending on its position within the focus detection region 100. A small region 110a (see reference 110a) is located in the center of the same focus detection region 100. Figure 2 (B) and small regions 110b and 110c located at the left end (end in the -X direction) and the right end (end in the +X direction) (refer to) Figure 2 The image heights differ between (B) and (C). However, in this embodiment, the image height H at the center of one focus detection area 100 is set as the overall image height of that focus detection area 100. The image height of the focus detection area 100a at the center of the imaging surface 22a is zero, while the image heights of the focus detection areas 100b and 100c are predetermined image heights H.

[0079] Return to Figure 1 The distance calculation unit 214 calculates the exit pupil distance of the imaging optical system 31 at the image height H. The distance calculation unit 214 calculates the exit pupil distance Po(H) of the imaging optical system 31 at the image height H of the focus detection area 100 set by the area setting unit 213 using a predetermined formula. The predetermined formula can be, for example, the following formula (1), but it can also be other formulas.

[0080] Po(H) = h4 × H 4 +h2×H 2 +Co …(1)

[0081] Formula (1) is a formula with image height H as the variable. Parameter (h4) is the coefficient of the fourth term of variable H, parameter (h2) is the coefficient of the second term of variable H, and constant Co is the exit pupil distance at the position where the image height is zero (the position of the optical axis OA1 in the shooting plane 22a). Parameters (h4), (h2), and constant Co are information related to the exit pupil distance corresponding to different image heights, and are values ​​determined by the optical characteristics of the shooting optical system 31. Information representing parameters (h4), (h2), and constant Co is sent from the interchangeable lens 3 to the camera body 2 as lens information. Furthermore, formula (1) is stored in the memory inside the main control unit 21. The distance calculation unit 214 calculates the exit pupil distance Po(H) related to the image height H of the set focus detection area 100 based on the image height H of the set focus detection area 100 set by the area setting unit 213, the lens information (h4, h2, Co), and formula (1). Alternatively, the formula (1) can be stored in the internal memory of the lens control unit 32. The lens control unit 32 can also send the formula (1) together with the parameters (h4), (h2) and the constant term Co as lens information from the replacement lens 3 to the camera body 2.

[0082] The selection unit 215 selects which AF pixel pair (Sig1, Sig2) from the first to third AF pixel pairs (PR1 to PR3) provided by the pixel unit 221 will be used for focus detection. In this embodiment, the selection unit 215 selects any one of the first to third AF pixel pairs (PR1 to PR3) disposed within the focus detection area 100 set by the area setting unit 213. The selection unit 215 selects from the first to third AF pixel pairs (PR1 to PR3) an AF pixel pair suitable for the exit pupil distance Po(H) calculated by the distance calculation unit 214. Furthermore, when multiple focus detection areas 100 are set by the area setting unit 213, the selection unit 215 selects the same type of AF pixel pair in each selected focus detection area 100.

[0083] The focus detection unit 216 performs focus detection processing required for the autofocus (AF) of the shooting optical system 31. The focus detection unit 216 uses the signals Sig1 and Sig2 output from the AF pixel pairs selected by the selection unit 215 to calculate the defocus amount using a pupil-segmented phase difference detection method.

[0084] The focus detection unit 216 performs correlation calculations on a first signal Sig1 generated when capturing an image formed by a first light beam passing through the first pupil region of the shooting optical system 31 and a second signal Sig2 generated when capturing an image formed by a second light beam passing through the second pupil region, and calculates the deviation between the image plane of the image formed by the shooting optical system 31 and the shooting plane 22a of the shooting element 22. The focus detection unit 216 converts this deviation into a defocus amount based on a predetermined conversion formula.

[0085] The position control unit 217 calculates the focusing position (the amount of movement of the focusing lens 31b to the focusing position) of the focusing lens 31b for focusing (imaging) the image formed by the imaging optical system 31 on the imaging surface 22a of the imaging element 22 based on the defocus amount calculated by the focus detection unit 216.

[0086] More specifically, the position control unit 217 determines whether the defocus amount is within the allowable value. If the defocus amount is within the allowable value, the position control unit 217 determines that the focus is achieved. On the other hand, if the defocus amount exceeds the allowable value, the position control unit 217 determines that the focus is off and sends a signal to the lens control unit 32 of the interchangeable lens 3, instructing the amount of movement of the focusing lens 31b and the lens movement. The lens control unit 32 moves the focusing lens 31b according to the amount of movement, thereby automatically focusing.

[0087] Furthermore, in this embodiment, in addition to focus detection processing using phase difference detection, focus detection unit 216 can also perform focus detection processing using contrast detection. In this case, while position control unit 217 moves the focusing lens 31b of the imaging optical system 31 along the optical axis OA1, focus detection unit 216 sequentially calculates the contrast evaluation value of the subject image based on the signal output from the imaging pixel. Position control unit 217 establishes a correspondence between the position of focusing lens 31b and the contrast evaluation value using the position information of focusing lens 31b sent from the interchangeable lens 3. Furthermore, position control unit 217 detects the position of focusing lens 31b where the contrast evaluation value exhibits a peak, i.e., a maximum value, as the focus position. Position control unit 217 sends the detected position information of focusing lens 31b corresponding to the focus position to lens control unit 32. Lens control unit 32 moves focusing lens 31b to the focus position to perform focusing. Furthermore, in the following description, the action of the focus detection unit 216 sequentially calculating the contrast evaluation value of the subject image based on the signal output from the shooting pixels and detecting the focus position while the position control unit 217 moves the focusing lens 31b of the shooting optical system 31 along the optical axis OA1 is sometimes referred to as a scanning operation. For example, if the defocus amount cannot be calculated using the signals Sig1 and Sig2 output from the AF pixel pair selected by the selection unit 215, the position control unit 217 starts the scanning operation after a predetermined time in order to find the focus position.

[0088] Figure 6 (A) and Figure 6 (B) is a diagram used to explain the focus detection based on the signals Sig1 and Sig2 output from the AF pixel pairs selected by the selection unit 215.

[0089] As described above, the focus detection unit 216 uses the signals Sig1 and Sig2 output from the AF pixel pair selected by the selection unit 215 to calculate the defocus amount using a pupil-segmented phase difference detection method.

[0090] exist Figure 6 (A) and Figure 6 In (B), it is assumed that the AF pixel pair selected by the selection unit 215 is the second AF pixel pair PR2. Figure 6 (A) and Figure 6 In (B), the set of the second pixels, 400-2, including the second AF pixel pair PR2, is represented by a shading line.

[0091] Here, as Figure 6As shown in (A), when a portion of the subject image SBJ overlaps with the second pixel set 400-2 including the second AF pixel pair PR2, if the subject image SBJ is not in a severely out-of-focus state, the focus detection unit 216 can calculate the out-of-focus amount using the signals Sig1 and Sig2 output from the second AF pixel pair PR2. On the other hand, as Figure 6 As shown in (B), when the subject image SBJ does not overlap with the second pixel set 400-2 including the second AF pixel pair PR2, that is, when the subject image SBJ is located in a continuous area including the first pixel set 400-1 including the first AF pixel pair PR1 (not selected by the selection unit 215) and the third pixel set 400-3 including the third AF pixel pair PR3, even if the subject image SBJ is near the focus point, the focus detection unit 216 cannot use the signals Sig1 and Sig2 output from the second AF pixel pair PR2 to calculate the defocus amount. In the following description, the area containing the pixel set including the AF pixel pair not selected by the selection unit 215 is sometimes referred to as the dead zone. Figure 6 (A) and Figure 6 In (B), the area without a shaded area is a dead zone, denoted by DZ.

[0092] As cases where the amount of defocus cannot be calculated based on the signals Sig1 and Sig2 output from the AF pixel pair selected by the selection unit 215, there are (1) cases where the subject image is in a state of severe defocus and (2) cases where the subject image is near the focus but happens to be in the dead zone.

[0093] In the case described in (1) above, it is preferable to detect the focus position by scanning (moving the focusing lens 31b). However, if scanning is performed in the case described in (2) above, the subject may be lost. In addition, in the case described in (2) above, frequent scanning may occur even though the subject image is near the focus point, which may cause discomfort to the user.

[0094] Therefore, in this embodiment, if the defocus amount cannot be calculated based on the signals Sig1 and Sig2 output from the AF pixel pair selected by the selection unit 215, it is determined whether it is the case described in (1) or the case described in (2) above, and the time for starting the distance scanning operation is changed according to the determination result.

[0095] Figures 7-9 This is a flowchart illustrating an example of the processing performed by the main control unit 21. Figures 7-9The processing is performed when the shooting mode is "Bird Mode" or "Airplane Mode" and no predetermined subject (bird, airplane) is detected, or when the shooting mode is "Bird Mode" or "Airplane Mode" and a predetermined subject (bird, airplane) is detected but the longitudinal (Y-direction) dimension of the subject image is less than or equal to a predetermined dimension. Furthermore, the predetermined dimension can be set to the longitudinal dimension of a pixel set (dead zone) that includes AF pixel pairs other than those selected by the selection unit 215. In other words, the predetermined dimension can be set to the longitudinal (Y-direction) dimension of the region between the pixel set containing the AF pixel pairs selected by the selection unit 215 and another pixel set adjacent to that pixel set in the Y-direction and including the AF pixel pairs selected by the selection unit 215.

[0096] exist Figure 7 In the processing, for example, when the user operates the operation unit 25 to set the autofocus (AF) mode, the area setting unit 213 of the camera body 2 sets the focus detection area 100 corresponding to the AF frame including the subject detected by the subject detection unit 212 as the area for focus detection (step S11). The image height of the focus detection area 100 set by the area setting unit 213 is set to the image height Hx. Furthermore, if the subject detection unit 212 does not detect a predetermined subject, the focus detection area 100 corresponding to the AF frame corresponding to the setting of the camera body 2 or the AF frame set by the user is set as the area for focus detection.

[0097] Next, the distance calculation unit 214 of the camera body 2 substitutes the image height Hx of the set focus detection area 100 into the calculation formula (1) determined by the constant term Po and coefficients h4 and h2 of the lens information, and calculates the exit pupil distance Pox relative to the image height Hx (step S13). Furthermore, the constant term Po and coefficients h4 and h2 are stored, for example, in the lens memory 33 (or the memory inside the lens control unit 32), and are sent to the camera body 2 from the interchangeable lens 3 when the power to the camera body 2 is turned on. The camera body 2 stores the constant term Po and coefficients h4 and h2 received from the interchangeable lens 3, for example, in the memory inside the body control unit 21.

[0098] Next, the selection unit 215 determines whether the exit pupil distance Pox calculated by the distance calculation unit 214 is within the first exit pupil distance range (first range) (step S15). If the exit pupil distance Pox is within the first exit pupil distance range (step S15 / Yes), the selection unit 215 selects the first AF pixel pair PR1 (step S17).

[0099] If the exit pupil distance Pox is not within the first exit pupil distance range (step S15 / No), the selection unit 215 determines whether the exit pupil distance Pox is within the second exit pupil distance range (second range) (step S19). If the exit pupil distance Pox is within the second exit pupil distance range (step S19 / Yes), the selection unit 215 selects the second AF pixel pair PR2 (step S21).

[0100] If the distance from the exit pupil to Pox is not within the range of the distance from the second exit pupil (step S19 / No), the selection unit 215 selects the third AF pixel pair PR3 (step S23).

[0101] Next, the focus detection unit 216 of the camera body 2 performs the first focus detection (step S25). Specifically, the focus detection unit 216 performs correlation operations on the signals Sig1 and Sig2 output from the AF pixel pairs selected in steps S17, S21, or S23, calculates the deviation between the image plane of the imaging optical system 31 and the imaging plane 22a of the imaging element 22, and converts the calculated deviation into a defocus amount. The calculated defocus amount is stored as a history of the focus detection results in a volatile memory or the like provided in the body control unit 21.

[0102] Next, the focus detection unit 216 determines whether the release button (operation unit 25) has been half-pressed (step S27). In this embodiment, the half-pressing of the release button is equivalent to an indication for performing focus detection of the shooting optical system 31.

[0103] If the release button is not half-pressed (step S27 / No), the focus detection unit 216 performs a second focus detection (step S29). Specifically, the focus detection unit 216 performs correlation operations on the signals Sig1 and Sig2 from one of the AF pixel pairs not selected by the selection unit 215, calculates the deviation between the image plane of the imaging optical system 31 and the imaging plane 22a of the imaging element 22, and converts the calculated deviation into a defocus amount. For example, if the AF pixel pair selected by the selection unit 215 is the second AF pixel pair PR2, correlation operations are performed on the signals Sig1 and Sig2 from one of the first AF pixel pair PR1 and the third AF pixel pair PR3 (e.g., the third AF pixel pair PR3), calculates the deviation between the image plane of the imaging optical system 31 and the imaging plane 22a of the imaging element 22, and converts the calculated deviation into a defocus amount. The calculated defocus amount is stored as a history of the focus detection results in a volatile memory or the like provided in the main control unit 21.

[0104] Next, the focus detection unit 216 determines whether the release button is half-pressed (step S31). If the release button is not half-pressed (step S31 / No), the focus detection unit 216 performs the first focus detection (step S33). That is, the focus detection unit 216 performs correlation operations on the signals Sig1 and Sig2 from the AF pixel pair selected by the selection unit 215, calculates the deviation between the image plane of the imaging optical system 31 and the imaging plane 22a of the imaging element 22, and converts the calculated deviation into a defocus amount. The calculated defocus amount is stored as a history of the focus detection result in a volatile memory or the like provided by the main control unit 21.

[0105] Next, the focus detection unit 216 determines whether the release button is half-pressed (step S35). If the release button is not half-pressed (step S35 / No), the focus detection unit 216 performs the third focus detection (step S37). Specifically, the focus detection unit 216 performs correlation operations on the signals Sig1 and Sig2 from the other AF pixel pair not selected by the selection unit 215, calculates the deviation between the image plane of the imaging optical system 31 and the imaging plane 22a of the imaging element 22, and converts the calculated deviation into a defocus amount. For example, if the AF pixel pair selected by the selection unit 215 is the second AF pixel pair PR2, the focus detection unit performs correlation operations on the signals Sig1 and Sig2 from the other side of the first AF pixel pair PR1 and the third AF pixel pair PR3 (e.g., the first AF pixel pair PR1), calculates the deviation between the image plane of the imaging optical system 31 and the imaging plane 22a of the imaging element 22, and converts the calculated deviation into a defocus amount. The calculated defocus amount is stored as a history of focus detection results in a volatile memory or similar device in the main control unit 21.

[0106] Next, the focus detection unit 216 determines whether the release button has been half-pressed (step S39). If the release button has not been half-pressed (step S39 / No), the process returns to step S25. Thus, the focus detection unit 216 repeatedly performs steps S25 to S39 until the release button is half-pressed. Because the focus detection unit 216 alternately performs focus detection based on the signal of the AF pixel pair selected by the selection unit 215 and the signal of AF pixel pairs other than those selected by the selection unit 215, the control unit 222 of the imaging element 22 alternately outputs the signal of the AF pixel pair selected by the selection unit 215 and the signal of the AF pixel pair other than those selected by the selection unit 215.

[0107] Figure 10 This diagram schematically illustrates the processing performed by the main control unit 21. Figure 10 This indicates that the selection unit 215 has selected the second AF pixel pair PR2. For example... Figure 10As shown, the focus detection unit 216 alternately performs focus detection based on signals Sig1 and Sig2 from the second AF pixel pair PR2 and focus detection based on signals Sig1 and Sig2 from either the first AF pixel pair PR1 or the third AF pixel pair PR3, until the release button is half-pressed.

[0108] Return to Figure 7 When the release button is half-pressed (step S27 / Yes, step S31 / Yes, step S35 / Yes, or step S39 / Yes), the position control unit 217 sets the period T0 to the standby time (step S40). The standby time is the time from the start of the scanning operation when the defocus amount cannot be calculated based on the signals Sig1 and Sig2 of the AF pixel pair selected by the selection unit 215. The period T0 is, for example, 0 seconds.

[0109] Next, the focus detection unit 216 performs the first focus detection (step S43). In this embodiment, when the release button is half-pressed, that is, when an instruction is received to perform focus detection for the shooting optical system 31, focus detection is performed using the AF pixel pair selected by the selection unit 215 in order to calculate the defocus amount with high accuracy. That is, in this embodiment, after the release button is half-pressed, the focus detection unit 216 only performs the first focus detection. Therefore, after the release button is half-pressed, the control unit 222 of the shooting element 22 outputs the signal of the AF pixel pair selected by the selection unit 215.

[0110] Next, the position control unit 217 determines whether the defocus amount was successfully calculated in the first focus detection in step S43 (step S45). If the defocus amount was successfully calculated (step S45 / Yes), the position control unit 217 calculates the focusing position of the focusing lens 31b based on the defocus amount (the amount of movement of the focusing lens 31b to the focusing position), and sends a signal indicating the amount of movement of the focusing lens 31b and the lens movement (focusing lens drive instruction) to the lens control unit 32 of the interchangeable lens 3 (step S77).

[0111] Next, the focus detection unit 216 determines whether the half-press of the release button has been released (step S79). If the half-press of the release button has been released (step S79 / Yes), the process returns to step S11.

[0112] If the release button is not released when it is half-pressed (step S79 / No), the focus detection unit 216 determines whether the release button is fully pressed (step S81). In this embodiment, fully pressing the release button means an instruction to take a picture (record a still image).

[0113] If the release button is fully pressed (step S81 / Yes), the process ends. Figures 7-9The main control unit 21 performs a predetermined shooting process. If the release button is not fully pressed (step S81 / No), the process returns to step S40.

[0114] If the defocus amount cannot be calculated in the first focus detection in step S43 (step S45 / No), the position control unit 217 determines whether the defocus amount was successfully calculated in any of the multiple focus detections performed immediately before the first focus detection in step S43 (step S47). For example, in Figure 10 The scenario is set such that, when the release button is half-pressed at the timing indicated by the arrow, the defocus amount is not calculated in the first focus detection (based on the focus detection of signals Sig1 and Sig2 of the second AF pixel selected by the selection unit 215) performed after the release button is half-pressed. In this case, it is determined whether the defocus amount was successfully calculated in any of the four focus detections performed immediately preceding it (shown by the single-dot dash).

[0115] exist Figure 10 In the first focus detection performed after the release button is half-pressed, the subject image SBJ is located in the dead zone. Therefore, the second pixel set 400-2 of the second AF pixel pair PR2 selected by the selection unit 215 does not overlap with the subject image SBJ, and the defocus amount cannot be calculated. On the other hand, before the release button is half-pressed, a part of the subject image SBJ overlaps with the first pixel set 400-1 of the first AF pixel pair PR1 and the third pixel set 400-3 of the third AF pixel pair PR3. Therefore, if the subject image SBJ is not severely out of focus (if the subject image SBJ is near the focus point), the defocus amount can be calculated. Therefore, if the defocus amount is successfully calculated in any of the multiple focus detections performed immediately before the first focus detection in step S43, it can be determined that the subject image just happened to be located in the dead zone when the first focus detection in step S43 was performed.

[0116] Therefore, if the defocus amount is successfully calculated in any of the multiple focus checks performed before the first focus check in step S43 (step S47 / Yes), the standby time before the start of the scanning operation is set to a period T1 that is longer than the period T0 (step S49). The period T1 is, for example, 200 ms. This is because, if the subject happens to be located in a dead zone, the probability of calculating the defocus amount in the first focus check (focus check based on the signal of the selected AF pixel pair) that is repeatedly performed during the standby time is high, so the scanning operation is not performed immediately.

[0117] Next, the focus detection unit 216 determines whether the half-press of the release button has been released (step S51). If the half-press of the release button has been released (step S51 / Yes), the process returns to step S11. If the half-press of the release button has not been released (step S51 / No), the focus detection unit 216 determines whether the release button has been fully pressed (step S53).

[0118] If the release button is fully pressed (step S53 / Yes), the process ends. Figures 7-9 In this process, the main control unit 21 performs a predetermined shooting process. This is because, although the defocus amount was not calculated in step S43, it was successfully calculated in any of the multiple focus checks performed immediately before the first focus check in step S43. Therefore, it can be assumed that the subject image SBJ is near the focus point, and there is no problem even if shooting is performed. Furthermore, the main control unit 21 can also perform shooting processing after the scanning operation.

[0119] If the release button is not fully pressed (step S53 / No), the focus detection unit 216 performs the first focus detection (step S55).

[0120] Next, the position control unit 217 determines whether the defocus amount was successfully calculated in the first focus detection in step S55 (step S57). If the defocus amount was successfully calculated (step S57 / Yes), the process moves to step S77. The processing after step S77 is the same as the process described above, so the explanation is omitted.

[0121] If the defocus amount cannot be calculated in the first focus detection in step S55 (step S57 / No), the position control unit 217 determines whether the movement direction of the subject is the first direction (step S59). Here, the first direction refers to the direction that intersects the arrangement direction (X direction) of the pixel set including the AF pixel pair selected by the selection unit 215, and is the following direction: when the focus detection unit 216 performs the first focus detection at a predetermined time interval, even if the subject image is in the dead zone in the first focus detection in step S43, if the movement direction of the subject is the first direction, it can be considered that the pixel set including the AF pixel pair selected by the selection unit 215 overlaps with a part of the subject image in the first focus detection in step S55. The first direction is, for example, a direction whose angle with the vertical direction (Y direction) is within ±45°. Furthermore, the movement direction (movement vector) of the subject is detected for each frame.

[0122] When the moving direction of the subject is the first direction (step S59 / Yes), the position control unit 217 sets the standby time for the start of the scanning operation to a period T2 that is shorter than period T1 (step S61). Period T2 can be shorter than period T1, longer than period T0, or the same as period T0. When the moving direction of the subject is the first direction, although it can be assumed that the pixel set including the AF pixel pair selected by the selection unit 215 in the first focus detection in step S55 overlaps with the subject image, the defocus amount was not calculated in step S55, so the subject image is likely to be severely out of focus. Therefore, when the defocus amount was not calculated in step S55 and the moving direction of the subject is the first direction, the standby time for the start of the scanning operation is shortened.

[0123] If the direction of movement of the subject is not the first direction (step S59 / No), skip the processing of step S61.

[0124] Next, the focus detection unit 216 determines whether the half-press of the release button has been released (step S63). If the half-press of the release button has been released (step S63 / Yes), the process returns to step S11. If the half-press of the release button has not been released (step S63 / No), the focus detection unit 216 determines whether the release button has been fully pressed (step S65).

[0125] If the release button is fully pressed (step S65 / Yes), the process ends. Figures 7-9 The main control unit 21 performs the predetermined image processing. Alternatively, the main control unit 21 may perform image processing after the scanning operation, for example.

[0126] If the release button is not fully pressed (step S65 / No), the position control unit 217 determines whether the elapsed time after the release button is half-pressed has exceeded the standby time (step S67). Alternatively, the position control unit 217 can also determine whether the elapsed time after executing step S43 has exceeded the standby time.

[0127] If the elapsed time does not exceed the standby time (step S67 / No), return to step S55. On the other hand, if the elapsed time exceeds the standby time (step S67 / Yes), the position control unit 217 performs a scanning operation (step S69). After step S69 is completed, return to step S40.

[0128] In addition, Figure 8In step S47, if any of the multiple focus checks performed immediately preceding the first focus check in step S43 fails to calculate the defocus amount (step S47 / No), the subject image is severely out of focus. Therefore, it is highly likely that the defocus amount cannot be calculated for any pair of AF pixels 1 to 3 (PR1 to PR3). Thus, if the determination in step S47 is No, the process moves to step S67, where the position control unit 217 determines whether the elapsed time has exceeded the standby time. The standby time at this time is period T0, for example, 0 seconds. If the elapsed time exceeds the standby time (step S67 / Yes), the position control unit 217 performs a scanning operation (step S69) and returns to step S40. This allows the focusing lens 31b to be positioned near the focus position.

[0129] As described above, during the scanning operation, while the position control unit 217 moves the focusing lens 31b of the imaging optical system 31 along the optical axis OA1, the focus detection unit 216 sequentially calculates the contrast evaluation value of the subject image based on the signal output from the imaging pixel. At this time, if the focusing lens 31b is driven from the very near end to the infinite end, the scanning operation takes time. Therefore, in this embodiment, by limiting the driving range of the focusing lens 31b during the scanning operation, the time spent on the scanning operation is shortened.

[0130] Specifically, during the scanning operation, the subject detection unit 212 sequentially calculates the reliability that the detected subject is a predetermined subject (e.g., a bird or an airplane). Furthermore, the position control unit 217 limits the range for driving the focusing lens 31b based on the relationship between the position of the focusing lens 31b and the reliability at that position.

[0131] Figure 11 This is a graph illustrating an example of the relationship between the position of the focusing lens 31b and the reliability calculated by the subject detection unit 212. Assume that the subject detection unit 212 calculates the reliability relative to the pupil of the detected subject, the reliability relative to the face of the detected subject, and the reliability of the detected subject as a whole. Figure 11 The reliability is shown relative to the pupil of the detected subject and relative to the face of the detected subject.

[0132] like Figure 11 As shown, when the focusing lens 31b is moved from the very near end toward the infinity end, the reliability relative to the pupil of the subject decreases sharply near position P1 and becomes low at position P2. Furthermore, the reliability relative to the face of the subject increases sharply near position P3, decreases sharply near position P4, and reaches a maximum value between positions P3 and P4.

[0133] The position control unit 217, for example, moves the focusing lens 31b from the near end toward the infinity end. If the focusing lens 31b reaches a position P2 where its reliability relative to the subject's pupil is low, the unit prevents the focusing lens 31b from moving further toward the infinity side than position P2. In other words, the interval SC1 from the near end to position P2 is defined as the interval during the scanning operation that drives the focusing lens 31b. Alternatively, the position control unit 217, for example, moves the focusing lens 31b from the near end toward the infinity end. If the focusing lens 31b reaches a position P5 that exceeds the reliable range relative to the subject's face, the unit prevents the focusing lens 31b from moving further toward the infinity side than position P5. Furthermore, if the focusing lens 31b is moved from position P5 toward the near end, and reaches a position P6 that exceeds the reliable range relative to the subject's face, the unit prevents the focusing lens 31b from moving further toward the near end than position P6. In other words, the region SC2, which includes the reliable protrusion relative to the face of the subject, is set as the region in which the focusing lens 31b is driven during the scanning operation. As a result, the range of driving the focusing lens 31b is limited, and the time spent on the scanning operation can be shortened compared to the case where the focusing lens 31b is moved from the very near end to the infinite end during the scanning operation.

[0134] As detailed above, according to this embodiment, the imaging element 22 includes: a first AF pixel pair PR1, a second AF pixel pair PR2, and a third AF pixel pair PR3, which perform photoelectric conversion on light transmitted through the imaging optical system 31 and output signals Sig1 and Sig2 for focus detection of the imaging optical system 31; and a control unit 222, which performs a first control and a second control. In the first control, the signals Sig1 and Sig2 of the selected AF pixel pair among the first to third AF pixel pairs PR1 to PR3 and the signals Sig1 and Sig2 of AF pixel pairs other than the selected AF pixel pair are output alternately. In the second control, the signals Sig1 and Sig2 of the selected AF pixel pair among the first to third AF pixel pairs PR1 to PR3 are output. Thus, during the first control, focus detection based on the signals Sig1 and Sig2 of the selected AF pixel pair and focus detection based on the signals Sig1 and Sig2 of AF pixel pairs other than the selected AF pixel pair can be performed.

[0135] Furthermore, in this embodiment, the control unit 222 performs first control before receiving an instruction to perform focus detection on the imaging optical system 31 (before the release button is half-pressed), and performs second control after receiving the instruction. Therefore, after the release button is half-pressed, focus detection based on the signals Sig1 and Sig2 of the selected AF pixel pair can be performed, thus enabling high-precision focus detection (defocus calculation). Additionally, the results of focus detection performed before the release button is half-pressed, based on the signals Sig1 and Sig2 of the selected AF pixel pair, and the results of focus detection based on the signals Sig1 and Sig2 of AF pixel pairs other than the selected AF pixel pair, can be used for control after the release button is half-pressed.

[0136] Furthermore, according to this embodiment, the focus detection device 4 includes: an imaging element 22 having a first AF pixel pair PR1, a second AF pixel pair PR2, and a third AF pixel pair PR3 that photoelectrically convert light transmitted through the imaging optical system 31 and output signals Sig1 and Sig2 for focus detection of the imaging optical system 31; a focus detection unit 216 that performs focus detection of the imaging optical system 31 based on at least one of the signals Sig1 and Sig2 from the first AF pixel pair PR1, the second AF pixel pair PR2, and the third AF pixel pair PR3; and a position control unit 217 that controls the position of the imaging optical system 31 (focusing lens 31b). When the focus detection unit 216 successfully performs focus detection on the imaging optical system 31, the position control unit 217 controls the position of the imaging optical system 31 after a period T1 (e.g., 200 ms) following the receipt of the instruction to perform focus detection on the imaging optical system 31. When the focus detection unit 216 fails to perform focus detection on the imaging optical system 31, the position control unit 217 controls the position of the imaging optical system 31 after a period T0 (e.g., 0 seconds) shorter than T1 following the receipt of the instruction to perform focus detection on the imaging optical system 31. Therefore, even if the focus detection unit 216 successfully performs focus detection on the imaging optical system 31, the position of the imaging optical system 31 will not be controlled unless a period T1 longer than T0 is elapsed, even if the instruction to perform focus detection on the imaging optical system 31 is received. This prevents situations where, despite successful focus detection, the position of the imaging optical system 31 changes, causing it to lose track of the subject.

[0137] Furthermore, in this embodiment, if the focus detection unit 216 successfully performs focus detection of the imaging optical system 31 before receiving an instruction to perform focus detection, the position control unit 217 controls the position of the imaging optical system 31 after a period T1. If the focus detection unit 216 fails to successfully perform focus detection of the imaging optical system 31 before receiving an instruction to perform focus detection, the position of the imaging optical system 31 is controlled after a period T0. This prevents situations where, although the focus detection unit 216 successfully performs focus detection of the imaging optical system 31 before receiving an instruction to perform focus detection, the position of the imaging optical system 31 changes for reasons such as losing track of the subject after receiving the instruction to perform focus detection because the subject image is in a dead zone and the focus detection unit 216 cannot perform focus detection of the imaging optical system 31. Furthermore, if the focus detection unit 216 fails to successfully perform focus detection of the imaging optical system 31 before receiving an instruction to perform focus detection of the imaging optical system 31, it can be considered that the subject image is in a state of severe defocus. Therefore, by controlling the position of the imaging optical system 31 after a period T0 that is shorter than the period T1, the severe defocus state can be eliminated as early as possible.

[0138] Furthermore, in this embodiment, if the focus detection unit 216 successfully detects the focus of the imaging optical system 31 during period T1 (and successfully calculates the defocus amount), the position control unit 217 controls the position of the imaging optical system 31 based on the detection result of the focus detection unit 216. Therefore, even if the subject happens to be located in a dead zone, as long as the image of the subject overlaps with the pixel set including the selected AF pixel pair during period T1, the focusing lens 31b can be moved to the focusing position.

[0139] Furthermore, in this embodiment, the imaging element 22 includes an imaging pixel 13 that performs photoelectric conversion on the light transmitted through the imaging optical system 31 and outputs an imaging signal for image generation. The position control unit 217 controls the position of the imaging optical system 31 to detect the focus state of the imaging optical system 31, and changes the range of the controlled position of the imaging optical system 31 based on the relationship between the position of the imaging optical system 31 in the optical axis direction and the reliability of a predetermined subject detected in the image generated based on the imaging signal of the imaging pixel 13. As a result, compared to the case where the focus state of the imaging optical system 31 is detected by moving the imaging optical system 31 from the very near end to the infinite end during the scanning operation, the time spent on the scanning operation can be shortened.

[0140] Furthermore, when the position control unit 217 detects that the predetermined direction of movement of the subject detected in the image generated based on the shooting signal of the shooting pixel 13 is the first direction, it controls the position of the shooting optical system 31 after receiving an instruction to perform focus detection for the shooting optical system 31, and after a period T3 shorter than the period T1. Thus, the timing of the scanning operation can be changed based on whether the subject image is severely out of focus or whether the subject is in a dead zone.

[0141] Furthermore, according to this embodiment, the camera 1 includes: an imaging element 22 having a first AF pixel pair PR1, a second AF pixel pair PR2, a third AF pixel pair PR3, and an imaging pixel 13; the first AF pixel pair PR1, the second AF pixel pair PR2, and the third AF pixel pair PR3 perform photoelectric conversion on light incident through the imaging optical system 31 having a focusing lens 31b and output signals Sig1 and Sig2 for focus detection; the imaging pixel 13 performs photoelectric conversion on light incident through the imaging optical system 31 and outputs an imaging signal for image generation; a focus detection unit 216 that performs focus detection of the imaging optical system 31 based on the signals Sig1 and Sig2 output from at least one of the first AF pixel pair PR1, the second AF pixel pair PR2, and the third AF pixel pair PR3; and a position control unit 217 that performs a scanning operation that sequentially calculates an evaluation value related to the contrast of the image formed by the imaging optical system 31 based on the imaging signal while moving the focusing lens 31b along the optical axis direction. The focus detection unit 216 alternately performs a first focus detection based on signals Sig1 and Sig2 output from the selected AF pixel pair and a second focus detection based on signals Sig1 and Sig2 output from AF pixel pairs other than the selected AF pixel pair, until it receives an instruction to perform focus detection for the imaging optical system 31. After receiving the instruction to perform focus detection for the imaging optical system 31, the focus detection unit 216 performs the first focus detection based on signals Sig1 and Sig2 output from the selected AF pixel pair. The position control unit 217 performs a scanning operation if the time during the first focus detection performed after receiving the instruction for focus detection is such that a standby time determined based on the focus detection results of the first and second focus detections performed before receiving the instruction has elapsed. This suppresses frequent scanning operations.

[0142] (Modified example)

[0143] In the above embodiment, when the release button is half-pressed (step S27 / Yes, step S31 / Yes, step S35 / Yes, or step S39 / Yes), the position control unit 217 calculates the focus position of the focusing lens 31b based on the defocus amount calculated from the signals Sig1 and Sig2 of the AF pixel pair selected by the selection unit 215, but is not limited thereto. For example, the defocus amount calculated from the signals Sig1 and Sig2 of AF pixel pairs other than the AF pixel pair selected by the selection unit 215 may also be used to calculate the focus position of the focusing lens 31b based on the image height Hx of the focus detection area 100. That is, it is also possible that, based on the image height Hx of the focus detection area 100, focus detection based on the signals Sig1 and Sig2 of the AF pixel pairs selected from the first to third AF pixel pairs PR1 to PR3 and focus detection based on the signals Sig1 and Sig2 of AF pixel pairs other than the selected AF pixel pairs are alternately performed after the release button is half-pressed.

[0144] Figures 12-16 This is a flowchart illustrating an example of the processing performed by the main control unit 21 in the modified example. In the modified example, the difference from the example of the processing performed by the main control unit 21 in the embodiment is that, between step S40 and step S43 in the embodiment, a determination is made as to whether the image height of the focus detection region 100 is less than a threshold (step S41).

[0145] When the image height Hx of the focal detection region is above the threshold (100), Figure 13 The processing of step S41 (No) is the same as that in the above-described implementation method. Therefore, the same reference numerals are used to refer to the same processing, and detailed descriptions are omitted.

[0146] When the image height Hx of the focus detection area 100 is less than the threshold (step S41 / Yes), that is, when the focus detection area 100 is located in a predetermined area including the center of the shooting surface 22a, it can be considered that even if the signals Sig1 and Sig2 of the AF pixel pairs not selected by the selection unit 215 are used, the defocus amount can be calculated with no problem in terms of accuracy.

[0147] Therefore, in the modified example, when the image height Hx of the focus detection region 100 is less than the threshold (step S41 / Yes), the focus detection unit 216 performs not only the first focus detection, but also the second and third focus detections.

[0148] In this modified example, when the image height Hx of the focus detection region 100 is less than the threshold (step S41 / Yes), the focus detection unit 216 first performs the first focus detection (step S101).

[0149] Next, the position control unit 217 determines whether the defocus amount was successfully calculated in step S101 (step S103). If the defocus amount cannot be calculated (step S103 / No), the focus detection unit 216 determines whether the half-press of the release button has been released (step S105).

[0150] If the half-press of the release button is released (step S105 / Yes), return to step S11. If the half-press of the release button is not released (step S105 / No), the focus detection unit 216 determines whether the release button is fully pressed (step S107).

[0151] If the release button is fully pressed (step S107 / Yes), the process ends. Figures 12-16 The main control unit 21 performs the predetermined shooting process. If the release button is not fully pressed (step S107 / No), the focus detection unit 216 performs the second focus detection (step S109).

[0152] Next, the position control unit 217 determines whether the defocus amount was successfully calculated in step S109 (step S111). If the defocus amount cannot be calculated (step S111 / No), the focus detection unit 216 determines whether the half-press of the release button has been released (step S113).

[0153] If the half-press of the release button is released (step S113 / Yes), return to step S11. If the half-press of the release button is not released (step S113 / No), the focus detection unit 216 determines whether the release button is fully pressed (step S115).

[0154] If the release button is fully pressed (step S115 / Yes), the process ends. Figures 12-16 The main control unit 21 performs the predetermined shooting process. If the release button is not fully pressed (step S115 / No), the focus detection unit 216 performs the first focus detection (step S117).

[0155] Next, the position control unit 217 determines whether the defocus amount was successfully calculated in step S117 (step S119). If the defocus amount cannot be calculated (step S119 / No), the focus detection unit 216 determines whether the half-press of the release button has been released (step S121).

[0156] If the half-press of the release button is released (step S121 / Yes), return to step S11. If the half-press of the release button is not released (step S121 / No), the focus detection unit 216 determines whether the release button is fully pressed (step S123).

[0157] If the release button is fully pressed (step S123 / Yes), the process ends. Figures 12-16 The main control unit 21 performs the predetermined shooting process. If the release button is not fully pressed (step S123 / No), the focus detection unit 216 performs the third focus detection (step S125).

[0158] Next, the position control unit 217 determines whether the defocus amount was successfully calculated in step S125 (step S127). If the defocus amount was not calculated (step S127 / No), that is, the defocus amount could not be calculated regardless of whether the first AF pixel pair PR1, the second AF pixel pair PR2, or the third AF pixel pair PR3 was used. In this case, it is highly likely that the subject image is severely out of focus, thus the defocus amount could not be calculated. Therefore, if the defocus amount was not calculated in step S125 (step S127 / No), the position control unit 217 performs a scanning operation (step S129) and returns to step S40.

[0159] On the other hand, if the defocus amount is successfully calculated in any one of steps S103, S111, S119 and S127 (step S103 / yes, step S111 / yes, step S119 / yes, step S127 / yes), the position control unit 217 calculates the focus position of the focusing lens 31b based on the calculated defocus amount and instructs the driving of the focusing lens 31b (step S131).

[0160] Next, the focus detection unit 216 determines whether the half-press of the release button has been released (step S133). If the half-press of the release button has been released (step S133 / Yes), the process returns to step S11. If the half-press of the release button has not been released (step S133 / No), the focus detection unit 216 determines whether the release button has been fully pressed (step S135).

[0161] If the release button is fully pressed (step S135 / Yes), the process ends. Figures 12-16 The main control unit 21 performs the predetermined shooting process. If the release button is not fully pressed (step S135 / No), the process returns to step S101.

[0162] Figure 17 This is a diagram schematically illustrating the processing steps S101 to S135. Figure 17 In this context, the second AF pixel pair PR2 is defined as the AF pixel pair selected by the selection unit 215.

[0163] like Figure 17As shown, the position control unit 217 alternately performs focus detection based on signals Sig1 and Sig2 from the second AF pixel pair PR2 and focus detection based on signals Sig1 and Sig2 from either the first AF pixel pair PR1 or the third AF pixel pair PR3, until the release button is half-pressed. Furthermore, if the image height Hx of the focus detection area 100 is less than a threshold, the position control unit 217 continues to alternately perform focus detection based on signals Sig1 and Sig2 from the second AF pixel pair PR2 and focus detection based on signals Sig1 and Sig2 from either the first AF pixel pair PR1 or the third AF pixel pair PR3, even after the release button is half-pressed. Figure 17 In the example, if the defocus amount can be calculated from the focus detection based on signals Sig1 and Sig2 from the 3rd AF pixel pair PR3 (shown by the single-dot dash), and from the focus detection based on signals Sig1 and Sig2 from the 1st AF pixel pair PR1, then the position control unit 217 calculates the focus position of the focusing lens 31b based on the defocus amount and instructs the focusing lens 31b to be driven. Therefore, even if the defocus amount cannot be calculated based on signals Sig1 and Sig2 from the AF pixel pair selected by the selection unit 215, the subject image can still be focused.

[0164] Furthermore, in the above embodiments and variations, the control unit 222 of the imaging element 22 alternately outputs the signals Sig1 and Sig2 of the selected AF pixel pairs among the first to third AF pixel pairs PR1 to PR3 and the signals Sig1 and Sig2 of AF pixel pairs other than the selected AF pixel pairs, but is not limited to this. For example, if it is possible to simultaneously output the signals Sig1 and Sig2 of the selected AF pixel pairs among the first to third AF pixel pairs PR1 to PR3 and the signals Sig1 and Sig2 of AF pixel pairs other than the selected AF pixel pairs, they can also be output simultaneously. In this case, the focus detection unit 216 of the main control unit 21 can perform focus detection using the signals Sig1 and Sig2 output from the appropriate AF pixel pairs from the signals Sig1 and Sig2 output from the first to third AF pixel pairs PR1 to PR3 respectively.

[0165] In addition, in the above embodiments and variations, a first pixel set 400-1, a second pixel set 400-2 and a third pixel set 400-3 are configured in each focal detection region 100, but it is sufficient to configure at least two of the first to third pixel sets 400-1 to 400-3.

[0166] Furthermore, in the above-described embodiments and variations, Figures 7-9 processing or Figures 12-16The processing is performed when the shooting mode is "Bird Mode" or "Airplane Mode" and no predetermined subject (bird, airplane) is detected, or when the shooting mode is "Bird Mode" or "Airplane Mode" and a predetermined subject (bird, airplane) is detected but the longitudinal (Y-direction) dimension of the subject image is less than the predetermined dimension, but is not limited to these cases. For example, it can also be performed regardless of the shooting mode, when the longitudinal dimension of the subject image is less than the predetermined dimension, when the subject is small, or when the subject is a small object. Figures 7-9 processing or Figures 12-16 The processing can also be performed when the shooting mode is "Small Object Mode," in addition to "Bird Mode" and "Airplane Mode." Figures 7-9 processing or Figures 12-16 The processing.

[0167] In addition, in the above embodiments and variations, when the subject may be a small object in a specific shooting mode (e.g., bird mode, airplane mode, small object mode), or when the subject is determined to be a small object in the subject detection of the subject detection unit 212, the standby time of the distance-shifting scanning operation can be extended.

[0168] Furthermore, in the above embodiments and variations, when the shooting mode is "bird mode" or "airplane mode," the control unit 222 of the shooting element 22 performs the first control before the release button is half-pressed and the second control after the release button is half-pressed. However, the control performed by the control unit 222 in other shooting modes is not limited to this and can be appropriately set. For example, when the shooting mode is a mode other than "bird mode," "airplane mode," and "small object mode," such as "portrait mode" suitable for shooting people, the control unit 222 can perform the second control regardless of whether the release button is half-pressed, without switching between the first and second controls before or after the release button is half-pressed.

[0169] The above-described embodiments are preferred embodiments of the present invention. However, they are not limited thereto, and various modifications can be made without departing from the spirit of the present invention.

[0170] Explanation of reference numerals in the attached figures

[0171] 1 camera

[0172] 2. Camera body

[0173] 3. Change the lens

[0174] 4. Focus Detection Device

[0175] 11 and 12 focus detection pixels

[0176] 13 shooting pixels

[0177] 21 Main Control Department

[0178] 22 camera components

[0179] 25 Operations Department

[0180] 31. Imaging Optical System

[0181] 31b Focusing lens

[0182] 216 Focus Detection Department

[0183] 217 Position Control Unit

[0184] 222 Control Department

[0185] PR1 1st AF pixel pair

[0186] PR2 2nd AF pixel pair

[0187] PR3 3rd AF pixel pair

[0188] Sig1 and Sig2 signals

Claims

1. A shooting element, comprising: The first pixel and the second pixel each have a pair of photoelectric conversion units that receive light beams from different pupil regions of the exit pupil of the optical system and output signals for focus detection of the optical system; and The control unit performs a first control and a second control. In the first control, it outputs both the signal of a selected pixel (the first pixel and the second pixel) and the signal of the other pixel (the first pixel and the second pixel). In the second control, it outputs the signal of the selected pixel (the first pixel and the second pixel).

2. The imaging element according to claim 1, wherein, The control unit performs the second control after receiving an instruction to perform focus detection of the optical system.

3. The imaging element according to claim 1 or 2, wherein, The control unit performs the first control before receiving an instruction to perform focus detection of the optical system.

4. The imaging element according to any one of claims 1 to 3, wherein, In the first control, the control unit causes the signal of one pixel and the signal of the other pixel to be output alternately.

5. The imaging element according to any one of claims 1 to 4, wherein, In the second control, the control unit outputs a signal of a pixel selected based on information from the optical system.

6. The imaging element according to any one of claims 1 to 5, wherein, In the first shooting mode for capturing a specific subject image, the control unit performs the first control and the second control; in the second shooting mode, which is different from the first shooting mode, the control unit performs the second control.

7. The imaging element according to any one of claims 1 to 6, wherein, The pair of photoelectric conversion units includes: a first photoelectric conversion unit that receives a light beam passing through a first pupil region of the exit pupil of the optical system; and a second photoelectric conversion unit that receives a light beam passing through a second pupil region of the exit pupil of the optical system. The light-receiving area of ​​the first photoelectric conversion unit of the first pixel is different from the light-receiving area of ​​the first photoelectric conversion unit of the second pixel.

8. The imaging element according to claim 7, wherein, The first pixel has a first light-shielding portion that blocks a portion of the light beam from the optical system. The second pixel has a second light-shielding portion that blocks a portion of the light beam from the optical system, and the area of ​​the second light-shielding portion is different from that of the first light-shielding portion.

9. The imaging element according to any one of claims 1 to 8, wherein, The first pixel includes a first pixel pair, which receives light beams from different pupil regions of the exit pupil of the optical system. The second pixel includes a second pixel pair that receives light beams from different pupil regions of the exit pupil of the optical system.

10. A shooting device, comprising: The imaging element according to any one of claims 1 to 9; and The generation unit generates image data based on the signal output from the imaging element.

11. A focus detection device, comprising: The imaging unit has a first pixel and a second pixel, each of which has a pair of photoelectric conversion units that receive light beams from different pupil regions of the exit pupil of the optical system; The detection unit performs focus detection of the optical system based on each signal from the signal of the first pixel and the signal of the second pixel; The selection unit selects a pixel from either the first pixel or the second pixel; as well as The control unit controls the position of the optical system. If the detection unit fails to perform focus detection of the optical system based on the signal of one of the first pixel and the second pixel, but successfully performs focus detection of the optical system based on the signal of the other of the first pixel and the second pixel, the control unit controls the position of the optical system after a first period following receiving an instruction to perform focus detection of the optical system. If the detection unit fails to perform focus detection of the optical system based on either the signal of the first pixel or the signal of the second pixel, the control unit controls the position of the optical system after a second period following receiving an instruction to perform focus detection of the optical system, wherein the second period is shorter than the first period.

12. The focus detection device according to claim 11, wherein, If the control unit successfully performs focus detection of the optical system based on the signal of the other pixel before receiving an instruction to perform focus detection of the optical system, the control unit controls the position of the optical system after the first period has elapsed. If the detection unit fails to successfully perform focus detection of the optical system based on the signal of the other pixel before receiving an instruction to perform focus detection of the optical system, the control unit controls the position of the optical system after the second period has elapsed.

13. The focus detection device according to claim 11 or 12, wherein, If, during the first period, the control unit successfully performs focus detection of the optical system based on the signal of one of the pixels by the detection unit, it controls the position of the optical system based on the detection result of the detection unit.

14. The focus detection device according to any one of claims 11 to 13, wherein, The detection unit detects the deviation between the image plane of the optical system and the imaging plane of the imaging unit based on each of the signals from the first pixel and the second pixel.

15. The focus detection device according to any one of claims 11 to 14, wherein, The imaging unit includes a third pixel, which performs photoelectric conversion on the light transmitted through the optical system and outputs a signal for image generation. The control unit changes the range of the position of the optical system based on the subject detected in the image generated based on the signal of the third pixel.

16. The focus detection device according to claim 15, wherein, The control unit adjusts the range of the controlled optical system position based on the position of the optical system and the reliability of the detected subject.

17. The focus detection device according to claim 15 or 16, wherein, When the control unit detects that the predetermined direction of movement of the subject in the image generated based on the signal of the third pixel is a direction intersecting the horizontal direction, it controls the position of the optical system after receiving an instruction to perform focus detection of the optical system and after a third period, the third period being shorter than the first period.

18. The focus detection device according to any one of claims 11 to 17, wherein, The pair of photoelectric conversion units includes: a first photoelectric conversion unit that receives a light beam passing through a first pupil region of the exit pupil of the optical system; and a second photoelectric conversion unit that receives a light beam passing through a second pupil region of the exit pupil of the optical system. The light-receiving area of ​​the first photoelectric conversion unit of the first pixel is different from the light-receiving area of ​​the first photoelectric conversion unit of the second pixel.

19. The focus detection device according to claim 18, wherein, The first pixel has a first light-shielding portion that blocks a portion of the light beam from the optical system. The second pixel has a second light-shielding portion that blocks a portion of the light beam from the optical system, and the area of ​​the second light-shielding portion is different from that of the first light-shielding portion.

20. The focus detection device according to any one of claims 11 to 19, wherein, The first pixel includes a first pixel pair, which receives light beams from different pupil regions of the exit pupil of the optical system. The second pixel includes a second pixel pair that receives light beams from different pupil regions of the exit pupil of the optical system.

21. The focus detection device according to any one of claims 11 to 20, wherein, The indication for focusing the optical system is given by a half-press operation performed by the user.

22. The focus detection device according to any one of claims 11 to 21, wherein, If the detection unit fails to perform focus detection of the optical system based on the signal of one pixel but successfully performs focus detection of the optical system based on the signal of the other pixel, the control unit performs a scanning operation to move the focusing lens of the optical system after receiving an instruction to perform focus detection of the optical system and after the first period has elapsed. If the detection unit fails to perform focus detection of the optical system based on either the signal of the first pixel or the signal of the second pixel, the control unit performs the scanning operation after receiving an instruction to perform focus detection of the optical system and after the second period has elapsed, where the second period is shorter than the first period.

23. A shooting device, comprising: The focus detection device according to any one of claims 11 to 22; and The loading and unloading section is capable of loading and unloading replacement lenses with the optical system described above.

Images