Selection method, imaging method, and imaging device

Abstract

To provide a selection method, an imaging method, and an imaging apparatus which allow an object gazed by a user to be easily focused.SOLUTION: A selection method includes: a first imaging step of capturing an image of photographic subjects in a plurality of candidate areas having a first area and a plurality of second areas; a calculation step of calculating a first distance which is a distance to a first photograph subject in the first area and second distances which are distances to a plurality of second subjects in the plurality of second areas; a specification step of specifying a first specific area, corresponding to the second distances which satisfy a first condition, from the plurality of second areas; and a selection step of selecting a first focused photograph subject to be focused from the first photographic subject and the second photographic subjects in the first specific area, based on a first ratio which is a ratio of the first specific area to the plurality of second areas.SELECTED DRAWING: Figure 8

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a selection method, an imaging method, and an imaging device. [Background technology]

[0002] Patent Document 1 discloses an imaging device that has a function of detecting an area of ​​a predetermined object from a captured image and automatically focusing on the detected area. The imaging device described in Patent Document 1 includes an image sensor, a first detection unit, a second detection unit, a focus position determination unit, and an AF control unit.

[0003] In the imaging device described in Patent Document 1, an image sensor captures an image of a subject and generates image data representing the captured image. A first detection unit detects an area including a predetermined object from the captured image. A second detection unit detects distance information from the captured image, indicating the distance to the subject included in each of multiple small areas set in the captured image. A focus position determination unit determines a focus position in the detected area based on the area detected by the first detection unit and the distance information detected by the second detection unit. An AF control unit controls an autofocus operation based on the focus position.

[0004] In the imaging device described in Patent Document 1, the focus position determination unit sets the focus position to focus on the small area at the predetermined position when the subject distance of the small area at the predetermined position within the detected area is equal to or less than a predetermined value. Also, when the subject distance of the small area at the predetermined position is greater than the predetermined value, the focus position determination unit sets the focus position to focus on the small area that is arranged around the small area at the predetermined position and has a subject distance equal to or less than the predetermined value and is the shortest distance from the small area at the predetermined position.

[0005] Patent Document 2 discloses an imaging device having a focus detection means, a distance detection means, and a control means. In the imaging device described in Patent Document 2, the focus detection means performs an AF scan to detect the in-focus position of a set focus detection area based on a focus evaluation value obtained from a captured image. The distance detection means determines the distribution of subject distances included in the captured scene based on the focus evaluation value obtained by the AF scan. The control means controls the operation of the imaging device based on the distribution of subject distances determined by the distance detection means. The distance detection means detects the focus lens position at which the focus evaluation value peaks for each focus detection area, and then corrects the focus lens position at which the detected focus evaluation value peaks according to the position of the focus detection area to determine the distribution of subject distances.

[0006] Patent Document 3 discloses an autofocus device. In the autofocus device described in Patent Document 3, if it is determined that the difference between the detected subject distance and the previous subject distance is greater than a predetermined value during continuous shooting, that is, if the ranging area moves away from the main subject, a focusing operation is performed based on the previous subject distance rather than the subject distance detected at that time. In this case, because the previous subject distance is the subject distance of the main subject, an image focused on the main subject is captured.

[0007] Patent Document 4 discloses a camera. The camera described in Patent Document 4 includes an image sensor that captures images of a subject at time intervals, a distance measuring unit that measures the distance to the subject, and an image capturing interval adjustment unit that increases the frame rate of image capturing by the image sensor when the amount of change in distance per unit time measured by the distance measuring unit increases during continuous image capturing. [Prior art documents] [Patent documents]

[0008] [Patent Document 1] Japanese Patent Publication No. 2020-067534 [Patent Document 2] Japanese Patent Application Laid-Open No. 2014-126858 [Patent Document 3] Japanese Patent Application Laid-Open No. 2006-243609 [Patent Document 4] Japanese Patent Application Laid-Open No. 2009-118162 Summary of the Invention

[0009] In one aspect, the embodiment of the technology of the present disclosure provides a selection method and an imaging device that can make it easier to focus on a subject that a user is paying attention to. In another aspect, the embodiment of the technology of the present disclosure provides an imaging method that can achieve a good balance between releasing the shutter and focusing. [Means for solving the problem]

[0010] A first aspect of the technology of the present disclosure includes a first imaging step of imaging a subject included in a plurality of candidate regions including a first region and a plurality of second regions, and a second imaging step of calculating a first distance that is a distance to the first subject in the first region and a plurality of second distances that are distances to a plurality of second subjects in the plurality of second regions. No. 1 a calculation step; and identifying a first specific area corresponding to a second distance that satisfies a first condition from among the plurality of second distances. No. 1 A first focus object to be focused is selected from the first object and the second object in the first specific area based on a first ratio, which is a ratio of the first specific area to the plurality of second areas, in the identification step. No. 1 A selection method comprising:

[0011] A second aspect of the technology disclosed herein is an imaging device that includes an image sensor and a processor, in which the processor causes the image sensor to capture images of subjects included in multiple candidate areas including a first area and multiple second areas, obtains a first distance of the first subject in the first area and multiple second distances that are distances to the multiple second subjects in the multiple second areas, identifies a first specific area from the multiple second areas that corresponds to a second distance among the multiple second distances that satisfies a first condition, and selects a first focused subject to focus from the first subject and the second subjects in the first specific area based on a first ratio that is the ratio of the first specific area to the multiple second areas.

[0012] A third aspect of the technology of the present disclosure is an imaging method including: a first calculation step of calculating a first distance to a first subject included in first frame data of a first frame period; a first movement step of moving a focus lens to a first position based on the first distance; a second calculation step of calculating a second distance to a second subject included in second frame data of a second frame period after the first frame period; a selection step of selecting, based on the second distance, a second position or a third position closer to the first position than the second position as a position to move the focus lens to; and an imaging step of moving the focus lens to the selected second position or third position and imaging the second subject. [Brief explanation of the drawings]

[0013] [Figure 1] 1A and 1B are conceptual diagrams showing an example of the appearance of an imaging device according to a first embodiment and an example of an AF frame. [Figure 2] FIG. 3 is a conceptual diagram showing an example of an AF frame according to the first embodiment. [Figure 3] 1 is a schematic configuration diagram showing an example of a hardware configuration of an imaging device according to a first embodiment. [Figure 4] FIG. 2 is a block diagram showing an example of the functions of a processor according to the first embodiment. [Figure 5] 4 is a conceptual diagram showing an example of processing contents of a first imaging control unit, a first calculation unit, and a display control unit according to the first embodiment. FIG. [Figure 6]FIG. 4 is a conceptual diagram illustrating an example of processing details of a first calculation unit and a first identification unit according to the first embodiment. [Figure 7] FIG. 3 is a conceptual diagram showing an example of processing details of a first specifying unit and a first selecting unit according to the first embodiment. [Figure 8] FIG. 3 is a conceptual diagram showing an example of processing details of a first specifying unit and a first selecting unit according to the first embodiment. [Figure 9] FIG. 3 is a conceptual diagram showing an example of processing details of a first specifying unit and a first selecting unit according to the first embodiment. [Figure 10] 3 is a conceptual diagram showing an example of processing details of a first imaging control unit, a first calculation unit, a display control unit, and a first selection unit according to the first embodiment. FIG. [Figure 11] 4 is a conceptual diagram showing an example of processing content of a first imaging control unit according to the first embodiment. FIG. [Figure 12] 5 is a flowchart showing an example of the flow of imaging processing according to the first embodiment. [Figure 13] FIG. 10 is a conceptual diagram showing a modified example of the processing content of the first identification unit according to the first embodiment. [Figure 14] FIG. 10 is a block diagram showing an example of the functions of a processor according to the second embodiment. [Figure 15] FIG. 10 is a block diagram illustrating an example of a first imaging control unit, a second imaging control unit, and a first calculation unit according to a second embodiment. [Figure 16] FIG. 10 is a conceptual diagram illustrating an example of processing details of a first calculation unit and a second selection unit according to the second embodiment. [Figure 17] 10 is a conceptual diagram showing an example of processing details of a second imaging control unit, a first calculation unit, a display control unit, and a second selection unit according to the second embodiment. FIG. [Figure 18A] 10 is a flowchart showing an example of the flow of imaging processing according to the second embodiment. [Figure 18B] This is a continuation of the flowchart shown in FIG. 18A. [Figure 19] 18C is a modified example of the flowchart shown in FIG. 18B. [Figure 20] FIG. 11 is a conceptual diagram showing an example of an AF frame according to the third embodiment. [Figure 21]FIG. 11 is a block diagram showing an example of the functions of a processor according to the third embodiment. [Figure 22] 10 is a conceptual diagram showing an example of processing details of a first imaging control unit, a second calculation unit, and a display control unit according to the third embodiment. FIG. [Figure 23] FIG. 11 is a conceptual diagram illustrating an example of processing details of a second calculation unit and a second identification unit according to the third embodiment. [Figure 24] FIG. 11 is a conceptual diagram illustrating an example of processing details of a second specifying unit and a third selecting unit according to the third embodiment. [Figure 25] FIG. 11 is a conceptual diagram illustrating an example of processing details of a second specifying unit and a third selecting unit according to the third embodiment. [Figure 26] 10 is a conceptual diagram showing an example of processing details of a first imaging control unit, a second calculation unit, a display control unit, and a third selection unit according to the third embodiment. FIG. [Figure 27] 10 is a conceptual diagram showing an example of processing details of a first imaging control unit, a second imaging control unit, and a second calculation unit according to the third embodiment. FIG. [Figure 28] FIG. 11 is a conceptual diagram illustrating an example of processing details of a second calculation unit and a second selection unit according to the third embodiment. [Figure 29] 10 is a conceptual diagram showing an example of processing details of a second imaging control unit, a second calculation unit, a display control unit, and a second selection unit according to the third embodiment. FIG. [Figure 30A] 11 is a flowchart showing an example of the flow of imaging processing according to the third embodiment. [Figure 30B] This is a continuation of the flowchart shown in FIG. 30A. [Figure 30C] This is a continuation of the flowchart shown in Figures 30A and 30B. [Figure 31] 1 is a time chart showing an example of a flow of a conventionally known continuous shooting process. [Figure 32] FIG. 10 is a block diagram showing an example of the functions of a processor according to the fourth embodiment. [Figure 33] FIG. 13 is a conceptual diagram showing an example of the processing contents of a focus position calculation unit, a focus position prediction unit, and a control unit according to the fourth embodiment. [Figure 34]FIG. 11 is a conceptual diagram showing an example of the content of processing performed by a processor according to the fourth embodiment. [Figure 35] FIG. 11 is a conceptual diagram showing an example of processing content of a control unit according to the fourth embodiment. [Figure 36] FIG. 13 is a conceptual diagram showing an example of the relationship between the release priority range, the focusing priority range, the standby priority range, and the amount of blur according to the fourth embodiment. [Figure 37] 10 is a time chart showing an example of the flow of continuous shooting processing performed by an imaging device according to a fourth embodiment. [Figure 38A] 13 is a flowchart showing an example of the flow of continuous shooting control processing according to the fourth embodiment. [Figure 38B] This is a continuation of the flowchart shown in Figure 38A. [Figure 38C] This is a continuation of the flowchart shown in Figure 38B. [Figure 38D] This is a continuation of the flowchart shown in Figure 38C. DETAILED DESCRIPTION OF THE INVENTION

[0014] Hereinafter, exemplary embodiments of a selection method, an imaging method, and an imaging device according to the techniques of the present disclosure will be described with reference to the accompanying drawings.

[0015] [First embodiment] As an example, as shown in Fig. 1, an imaging device 10, which is an example of an "imaging device" according to the technology of the present disclosure, captures an imaging target area 12 designated as a subject. The range of the imaging target area 12 is determined by an angle of view designated by a user of the imaging device 10 (hereinafter referred to as "user"). In the example shown in Fig. 1, the imaging target area 12 includes a person 14 and a road 16. Also, in the example shown in Fig. 1, an aspect in which the person 14 is standing on the road 16 is shown.

[0016] For example, the imaging device 10 is an interchangeable lens digital camera. The imaging device 10 includes an imaging device main body 18 and an interchangeable lens 20. The interchangeable lens 20 is interchangeably attached to the imaging device main body 18. Note that, although an interchangeable lens digital camera is given here as an example of the imaging device 10, this is merely an example and a fixed lens digital camera may also be used. Furthermore, the technology of the present disclosure can also be applied to digital cameras mounted on various electronic devices such as smart devices, wearable terminals, cell observation devices, ophthalmic observation devices, or surgical microscopes.

[0017] The imaging device body 18 is provided with a dial 22, a release button 24, a touch panel display 26, instruction keys 28, and the like.

[0018] The dial 22 is operated when setting an operation mode, etc. In the imaging device 10, various operation modes are selectively set by operating the dial 22. The operation modes include operation modes of the imaging system. Examples of operation modes of the imaging system include a live view imaging mode, a still image imaging mode, a moving image imaging mode, and a continuous shooting mode. The live view imaging mode is an operation mode in which continuous imaging for live view images (hereinafter also referred to as "live view imaging") is performed. The still image imaging mode is an operation mode in which still images are captured with a main exposure for one frame. The moving image imaging mode is an operation mode in which moving images for recording are obtained by imaging a subject according to a moving image frame rate (for example, several tens of fps). The continuous shooting mode is an operation mode in which continuous shooting (i.e., continuous still images) is performed. Imaging ) is an operating mode.

[0019] The release button 24 functions as an imaging preparation instruction unit and an imaging instruction unit, and is capable of detecting two pressing operations: an imaging preparation instruction state that instructs the imaging device 10 to prepare for imaging, and an imaging instruction state that instructs the imaging device 10 to capture an image. The imaging preparation instruction state refers to a state in which the button is pressed from a standby position to an intermediate position (half-pressed position), for example, and the imaging instruction state refers to a state in which the button is pressed beyond the intermediate position to a final pressed position (fully-pressed position). Note that, hereinafter, the "state in which the button is pressed from the standby position to the half-pressed position" will be referred to as the "half-pressed state," and the "state in which the button is pressed from the standby position to the fully-pressed position" will be referred to as the "fully-pressed state." Depending on the configuration of the imaging device 10, the imaging preparation instruction state may be a state in which the user's finger is in contact with the release button 24, and the imaging instruction state may be a state in which the operating user's finger has moved from a state in which the button is in contact with the release button 24 to a state in which the operating user's finger is released.

[0020] The release button 24 is also operated to instruct the imaging device 10 to perform continuous shooting. Continuous shooting is the capture of consecutive still images accompanied by a main exposure. When the imaging mode is set for the imaging device 10, if the release button 24 is pressed fully for a certain period of time (e.g., 0.5 seconds) or more, the device enters continuous shooting mode and continuous shooting begins. Continuous shooting continues until the fully pressed state is released. In the imaging device 10, continuous shooting is achieved by successively performing main exposure at a predetermined time interval. Here, the predetermined time interval refers to a time interval for one frame determined by a continuous shooting frame rate of, for example, several fps to several tens of fps.

[0021] The touch panel display 26 includes a display 30 and a touch panel 32. Examples of the touch panel display 26 include an out-cell type, an on-cell type, or an in-cell type touch panel display. Examples of the display 30 include an organic EL display or a liquid crystal display.

[0022] The display 30 is also used to display a still image obtained by capturing a still image when an instruction to capture a still image is given to the imaging device 10 via the release button 24. Furthermore, the display 30 is also used to display a playback image when the imaging device 10 is in playback mode, a menu screen, and the like.

[0023] The touch panel 32 accepts instructions from the user. For example, the instructions from the user include an instruction to prepare for imaging, an instruction to capture an image, an instruction to perform continuous shooting, etc. The instruction to prepare for imaging, an instruction to capture an image, an instruction to perform continuous shooting, etc. are realized by operating a soft key. For example, the user turns on a soft key displayed on the display 30 via the touch panel 32, thereby providing the instruction to prepare for imaging, an instruction to capture an image, an instruction to perform continuous shooting, etc. to the imaging device 10.

[0024] The instruction keys 28 accept various instructions. Here, "various instructions" refers to, for example, an instruction to display a menu screen from which various menus can be selected, an instruction to select one or more menus, an instruction to confirm the selection, an instruction to erase the selection, and various instructions such as zooming in, zooming out, and frame-by-frame playback. These instructions may also be given via the touch panel 32.

[0025] 1 shows an example of a mode in which a live view image 34 (in the example shown in FIG. 1, an image including an image of an imaging target area 12) obtained by imaging by imaging device 10 is displayed on display 30. Imaging device 10 has an AF (auto focus) function, and an AF frame 36 is displayed superimposed on live view image 34. Imaging device 10 focuses on a subject included in AF frame 36, i.e., a subject indicated by an image displayed within AF frame 36 (i.e., a subject in real space).

[0026] The screen 30A of the display 30 is a rectangular screen having a short side 30A1 and a long side 30A2. The AF frame 36 is a rectangular frame and is displayed in a central portion 30B of the screen 30A. The AF frame 36 includes a plurality of regions 38 arranged in a 3x3 matrix. The regions 38 are regions defined by the rectangular frame. The plurality of regions 38 are an example of "a plurality of candidate regions" according to the technology of the present disclosure.

[0027] An up-down direction 40 is set for the AF frame 36. The up-down direction 40 is a direction along the short side 30A1. The up-down direction 40 is also fixed in advance with respect to the AF frame 36. Therefore, even if the orientation of the image capture device 10 changes, the up-down direction 40 with respect to the AF frame 36 remains unchanged. In other words, even if the orientation of the image capture device 10 changes, the up-down direction 40 remains a direction along the short side 30A1. For example, even if the orientation of the image capture device 10 changes from landscape to portrait, or from portrait to landscape, the up-down direction 40 with respect to the AF frame 36 remains unchanged.

[0028] The multiple regions 38 include a central region 42 and multiple peripheral regions 44. The multiple peripheral regions 44 are arranged on eight sides of the central region 42 so as to surround the central region 42 within the screen 30A. The central region 42 is an example of a "first region" and a "central region" according to the technology of the present disclosure. The multiple peripheral regions 44 are also an example of a "multiple second regions" according to the technology of the present disclosure. The peripheral region 44 is also an example of a "peripheral region" according to the technology of the present disclosure.

[0029] In the example shown in FIG. 1, eight peripheral regions 44 are shown as the multiple peripheral regions 44. In the example shown in FIG. 1, the eight peripheral regions 44 refer to peripheral regions 44A to 44H. The peripheral regions 44A to 44C are located below the central region 42 in the vertical direction 40 and are arranged along a direction (hereinafter also referred to as the "horizontal direction") orthogonal to the vertical direction 40 within the screen 30A, from the bottom left to the bottom right in a rear view of the landscape-oriented imaging device 10 shown in FIG. 1. The peripheral regions 44D and 44E are adjacent to each other in the horizontal direction across the central region 42. Specifically, the peripheral region 44D is arranged to the left of the central region 42 in a rear view of the landscape-oriented imaging device 10 shown in FIG. 1, and the peripheral region 44E is arranged to the right of the central region 42 in a rear view of the landscape-oriented imaging device 10 shown in FIG. 1. The peripheral areas 44F to 44H are located above the central area 42 in the vertical direction 40, and are arranged from the upper left to the upper right in rear view along the horizontal direction in the image capturing device 10 oriented horizontally as shown in FIG.

[0030] As an example, as shown in FIG. 2, a plurality of regions 38 include subjects. An imaging method using imaging device 10 includes a step of capturing an image of the subjects included in the plurality of regions 38. The subjects included in the plurality of regions 38 are a first subject 46 in central region 42 and second subjects 48A-48H in peripheral regions 44A-44H. First subject 46 is an example of a "first subject" according to the technology of the present disclosure, and second subjects 48A-48H are examples of "plurality of second subjects" according to the technology of the present disclosure. Note that a "subject" refers to a person or object included in each region 38; for example, as shown in FIG. 6, when one person is included across multiple regions 38, a portion of the person captured in each region 38 is the "subject."

[0031] First subject 46 is included in central region 42. Second subject 48A is included in peripheral region 44A. Second subject 48B is included in peripheral region 44B. Second subject 48C is included in peripheral region 44C. Second subject 48D is included in peripheral region 44D. Second subject 48E is included in peripheral region 44E. Second subject 48F is included in peripheral region 44F. Second subject 48G is included in peripheral region 44G. Second subject 48H is included in peripheral region 44H. Hereinafter, for ease of explanation, when there is no need to distinguish between second subjects 48A to 48H, they will be referred to as "second subjects 48."

[0032] The imaging device 10 performs distance measurement for the multiple regions 38. That is, the imaging device 10 calculates the distances from a reference position of the imaging device 10 (for example, an imaging surface 52A of an image sensor 50 described later) to the first object 46 and the multiple second objects 48. In the first embodiment, distance measurement is performed by a phase difference ranging method using phase difference pixels (for example, image plane phase difference pixels). Note that distance measurement by the phase difference ranging method using image plane phase difference pixels is merely an example, and distance measurement by a TOF (Time of Flight) method using a TOF sensor or distance measurement using a LiDAR (Light Detection and Ranging) scanner may also be used, and any distance measurement method may be used as long as it can realize distance measurement for the first object 46 and the multiple second objects 48.

[0033] As an example, as shown in FIG. 3 , the imaging device main body 18 includes an image sensor 50. The image sensor 50 includes a photoelectric conversion element 52. The photoelectric conversion element 52 has an imaging surface 52A. The photoelectric conversion element 52 has a phase difference pixel division area and a non-phase difference pixel division area. The phase difference pixel division area is a phase difference pixel group consisting of a plurality of phase difference pixels, which receives subject light and generates phase difference image data as an electrical signal corresponding to the amount of received light. The phase difference image data is used for distance measurement, for example. Distance measurement here refers to a process of calculating the distance from the imaging surface 52A to the subject (hereinafter also referred to as "subject distance") from a calculation result obtained by performing a correlation calculation using the phase difference image data. The non-phase difference pixel division area is a non-phase difference pixel group consisting of a plurality of non-phase difference pixels, which receives subject light and generates non-phase difference image data as an electrical signal corresponding to the amount of received light. The non-phase difference image data is, for example, image data that represents a visible light image, and is used as an image for recording or as an image for display (for example, a live view image 34 (see FIG. 1)).

[0034] The interchangeable lens 20 includes an imaging lens 54, a control device 56, and an actuator 58. The imaging lens 54 has an objective lens 54A, a focus lens 54B, etc. The objective lens 54A and the focus lens 54B are arranged in this order along the optical axis OA from the subject side (object side) to the imaging device body 18.

[0035] The control device 56 controls the entire interchangeable lens 20 in accordance with instructions from the imaging device body 18. The control device 56 is a device having a computer including, for example, a processor (e.g., a CPU (Central Processing Unit)), NVM (Non-volatile memory), RAM (Random Access Memory), etc. Note that while a computer is illustrated here, this is merely an example, and devices including an ASIC (Application Specific Integrated Circuit), FPGA (Field Programmable Gate Array), or PLD (Programmable Logic Device) may also be used. Furthermore, the control device 56 may be, for example, a device realized by a combination of hardware and software configurations.

[0036] The actuator 58 includes a focus slide mechanism (not shown) and a focus motor (not shown). The focus motor is connected to the control device 56, and the control device 56 controls the drive of the focus motor. The focus lens 54B is attached to the focus slide mechanism so as to be slidable along the optical axis OA. The focus motor is also connected to the focus slide mechanism, and the focus slide mechanism receives power from the focus motor to operate and move the focus lens 54B along the optical axis OA. In the imaging device 10, the imaging device body 18 calculates a focus position according to the subject distance (hereinafter also referred to as "AF calculation") and adjusts the focus by moving the focus lens 54B toward the calculated focus position. Here, the focus position refers to the position of the focus lens 54B on the optical axis OA when in focus.

[0037] The imaging device main body 18 includes a controller 60, an image memory 62, a UI (User Interface) device 64, an external I / F (Interface) 66, a photoelectric conversion element driver 70, and an input / output interface 72. The image sensor 50 also includes a signal processing circuit 74.

[0038] The input / output interface 72 is connected to the controller 60, the image memory 62, the UI device 64, the external I / F 66, the photoelectric conversion element driver 70, and the signal processing circuit 74. The input / output interface 72 is also connected to the control device 56 of the interchangeable lens 20.

[0039] The controller 60 includes a processor 76, an NVM 78, and a RAM 80. The processor 76, the NVM 78, and the RAM 80 are connected via a bus 82, which is connected to the input / output interface 72.

[0040] The NVM 78 is a non-transitory storage medium that stores various parameters and programs. For example, the NVM 78 is an EEPROM (Electrically Erasable Programmable Read-Only Memory). However, this is merely an example, and other types of non-volatile memory may also be used. The RAM 80 temporarily stores various types of information and is used as a work memory.

[0041] The processor 76 is an example of a "processor" according to the technology of the present disclosure, and includes a CPU and a GPU (Graphics Processing Unit). The GPU operates under the control of the CPU and is responsible for executing image-related processing. The processor 76 may be at least one CPU. Alternatively, the processor 76 may incorporate multiple GPUs. The processor 76 reads necessary programs from the NVM 78 and executes the read programs in the RAM 80. The processor 76 controls the entire imaging device 10 in accordance with the programs executed on the RAM 80. In the example shown in FIG. 3 , the control device 56, the image memory 62, the UI device 64, the external I / F 66, the photoelectric conversion element driver 70, and the signal processing circuit 74 are controlled by the processor 76.

[0042] Under the control of the photoelectric conversion element driver 70, the photoelectric conversion element 52 photoelectrically converts the subject light received by the imaging surface 52A and outputs an electrical signal corresponding to the amount of subject light to the signal processing circuit 74 as analog image data indicating the subject light.

[0043] The signal processing circuit 74 digitizes the analog image data read out from the photoelectric conversion element 52 to generate digital image data 84. The digital image data 84 includes the phase difference image data and non-phase difference image data described above.

[0044] The image memory 62 stores digital image data 84 generated by the signal processing circuit 74. That is, under the control of the processor 76, the signal processing circuit 74 stores the digital image data 84 in the image memory 62. The processor 76 acquires the digital image data 84 from the image memory 62 and performs various processes using the acquired digital image data 84.

[0045] The UI device 64 includes a display 30, and the processor 76 displays various types of information on the display 30. The UI device 64 also includes a reception device 86. The reception device 86 includes a touch panel 32 and a hard key unit 88. The hard key unit 88 is a plurality of hard keys including the dial 22, the release button 24, and the instruction keys 28 (see FIG. 1). The processor 76 operates in accordance with various instructions received by the reception device 86.

[0046] The external I / F 66 controls the exchange of various information with devices external to the imaging device 10 (hereinafter also referred to as "external devices"). An example of the external I / F 66 is a USB (Universal Serial Bus) interface. The USB interface is directly or indirectly connected to external devices (not shown), such as a smart device, a personal computer, a server, a USB memory, a memory card, or a printer. Note that in the first embodiment, the hard key unit 88 is included in the UI device 64, but the technology of the present disclosure is not limited to this. For example, the hard key unit 88 may be connected to the external I / F 66.

[0047] Incidentally, the imaging device 10 performs so-called zone AF. In zone AF, the area to be subjected to AF is divided into multiple zones, distance measurement is performed for each zone, and focusing is performed for the selected zone based on the distance measurement result (i.e., subject distance). Therefore, it is easier to capture the subject than AF for a single area that is not divided into multiple zones, and is also effective when capturing an image of a moving subject.

[0048] In conventional zone AF, a central zone is weighted higher than the surrounding zones, and AF is performed based on the average subject distance of all zones. However, in this case, the subject the user is focusing on may not be properly focused. Furthermore, there is a risk of the focus being blurred when a new subject enters the zone. If the focus is blurred, the subject the user is focusing on may not be properly focused.

[0049] A first conventional zone AF method is known in which a subject to be focused on is searched for by prioritizing a peripheral zone in front of the central zone (for example, a peripheral zone corresponding to peripheral zones 44A to 44C shown in FIG. 1) over a central zone. A second conventional zone AF method is known in which a subject to be focused on is searched for by prioritizing a central zone (for example, a central zone corresponding to central zone 42 shown in FIG. 1). However, even when the first method is used, if a subject the user is focusing on falls in a zone other than the peripheral zone in front, the subject intended by the user will not be in focus. Also, even when the second method is used, if a subject the user is focusing on falls in a zone other than the central zone, the subject intended by the user will not be in focus.

[0050] In view of these circumstances, the imaging device 10 is configured so that imaging processing (see FIGS. 4 to 12) is performed by the processor 76. As an example, as shown in FIG. 4, an imaging processing program 90 is stored in the NVM 78. The processor 76 reads the imaging processing program 90 from the NVM 78 and executes the read imaging processing program 90 on the RAM 80. The processor 76 performs imaging processing by operating as a first imaging control unit 76A, a first calculation unit 76B, a first identification unit 76C, a first selection unit 76D, and a display control unit 76E in accordance with the imaging processing program 90 executed on the RAM 80.

[0051] The processing performed by the first imaging control unit 76A is an example of a "first imaging step" according to the technology of the present disclosure. The processing performed by the first calculation unit 76B is an example of a "first calculation step" according to the technology of the present disclosure. The processing performed by the first identification unit 76C is an example of a "first identification step" according to the technology of the present disclosure. The processing performed by the first selection unit is an example of a "first selection step" according to the technology of the present disclosure.

[0052] 5, the accepting device 86 accepts instructions from a user or the like and outputs a live view imaging start signal to the first imaging control unit 76A in accordance with the accepted instructions. For example, when the operation mode of the imaging system is set, the accepting device 86 outputs the live view imaging start signal to the first imaging control unit 76A. When the live view imaging start signal is input, the first imaging control unit 76A controls the image sensor 50 via the photoelectric conversion element driver 70 to cause the image sensor 50 to perform live view imaging.

[0053] The receiving device 86 receives instructions from a user or the like and outputs an imaging preparation instruction signal to the first calculation unit 76B in accordance with the received instruction. For example, when the receiving device 86 receives an imaging preparation instruction, it outputs the imaging preparation instruction signal to the first calculation unit 76B. When the imaging preparation instruction signal is input, the first calculation unit 76B performs distance measurement for the central region 42 and the multiple peripheral regions 44. In this case, for example, the first calculation unit 76B acquires digital image data 84 from the image memory 62 and calculates a first distance, which is the subject distance to a first subject 46 (see FIG. 2) included in the central region 42, based on the phase difference image data included in the digital image data 84. Furthermore, for example, the first calculation unit 76B calculates multiple second distances based on the phase difference image data included in the digital image data 84. The multiple second distances are multiple subject distances to multiple second subjects 48 (see FIG. 2) included in the multiple peripheral regions 44.

[0054] In the first embodiment, distance measurement is performed on multiple locations on the first subject 46. Therefore, multiple subject distances are calculated for the first subject 46. The first calculation unit 76B acquires the shortest subject distance from the multiple subject distances for the first subject 46 as the first distance. Note that, although the shortest subject distance among the multiple subject distances for the first subject 46 is set as the first distance here, this is merely an example, and a representative subject distance for the first subject 46 may be set as the first distance. Examples of the representative subject distance for the first subject 46 include the average, median, or mode of the multiple subject distances for the first subject 46.

[0055] In the first embodiment, distance measurement is performed on multiple locations of multiple second subjects 48 for each of the multiple peripheral regions 44. Therefore, multiple subject distances are calculated for the multiple second subjects 48. The first calculation unit 76B acquires the shortest subject distance from the multiple subject distances for the multiple second subjects 48 as the second distance. Note that, although the shortest subject distance among the multiple subject distances for the second subjects 48 is set as the second distance here, this is merely an example, and a representative subject distance for the second subjects 48 may be set as the second distance. Examples of the representative subject distance for the second subjects 48 include the average, median, or mode of the multiple subject distances for the second subjects 48.

[0056] The display control unit 76E acquires the digital image data 84 used in the calculation by the first calculation unit 76B, and generates a live view image 34 based on the acquired digital image data 84. The display control unit 76E then causes the display to display the live view image 34 and also causes the AF frame 36 to be superimposed on the live view image 34. Note that, hereinafter, the live view image 34 with the AF frame 36 superimposed thereon is also referred to as the "live view image 34 with the AF frame 36 included."

[0057] As an example, as shown in FIG. 6, the first determination unit 76C acquires the first distance, a plurality of second distances, and digital image data 84 from the first calculation unit 76B. The first determination unit 76C determines whether or not there is a second distance that satisfies a first condition among the plurality of second distances. For example, the first condition is The second distance is This condition refers to a condition that the second distance is shorter than the first distance. Here, if a second distance that satisfies the first condition exists among the multiple second distances, the first identification unit 76C uses the digital image data 84 to identify a first identified region 92 corresponding to the second distance that satisfies the first condition from among the multiple surrounding regions 44. In the example shown in FIG. 6, each of the surrounding regions 44A to 44D is shown as a first identified region 92 corresponding to the second distance that satisfies the first condition.

[0058] 7, first selection unit 76D acquires digital image data 84 from first calculation unit 76B. When first identification unit 76C determines that there is no second distance that satisfies the first condition among the multiple second distances (i.e., when the multiple second distances are equal to or greater than the first distance), first selection unit 76D uses digital image data 84 to select first subject 46 included in central region 42 as first focused subject 94, which is the subject to be focused on.

[0059] On the other hand, when the first identification unit 76C identifies a first identified region 92 corresponding to the second distance that satisfies the first condition, as shown in FIG. 8 as an example, the first selection unit 76D acquires digital image data 84 from the first identification unit 76C. Then, the first selection unit 76D calculates a first ratio, which is the ratio of the first identified region 92 to the plurality of surrounding regions 44. For example, the first ratio is the number of first identified regions 92. However, this is merely an example, and the first ratio may be the ratio of the total area of ​​the plurality of surrounding regions 44 (peripheral regions 44A to 44D in the example shown in FIG. 8) that are identified as the first identified region 92 to the total area of ​​the plurality of surrounding regions 44, or any value corresponding to the number of first identified regions 92.

[0060] The first selection unit 76D uses the digital image data 84 to select a first focused subject 94 from the first subject 46 and the second subjects 48A-48H based on the first ratio. Specifically, the first selection unit 76D first determines whether the first ratio exceeds a first threshold. For example, the first threshold refers to the number of peripheral regions 44 located below the central region 42 in the up-down direction 40 (here, as an example, three peripheral regions 44A-44C). The first threshold is an example of a "threshold" according to the technology of the present disclosure.

[0061] When the first selection unit 76D determines that the first ratio exceeds the first threshold, it selects the second subject 48 in the first specific region 92 as the first focused subject 94. In other words, when the first ratio exceeds the first threshold, it is determined that there is a higher possibility that the user is paying attention to the second subject 48 in the first specific region 92 than when the first ratio is equal to or less than the first threshold, and the second subject 48 in the first specific region 92 is selected as the first focused subject 94.

[0062] In the example shown in FIG. 8, a second subject 48D included in a peripheral area 44D identified as the first identified area 92 is selected as the first focused subject 94. To explain in more detail, the subject distance (i.e., the second distance) of the person 14 who is the second subject 48D included in the peripheral area 44D is shorter than the subject distance (i.e., the first distance) of the road 16 included in the central area 42. In addition, the subject distance (i.e., the second distance) of the road 16 included in the peripheral areas 44B and 44C is shorter than the subject distance (i.e., the first distance) of the road included in the central area 42. twist In this case, there are four peripheral regions 44 (i.e., first specific regions 92) corresponding to second distances that satisfy the first condition that the second distance is shorter than the first distance, which exceeds the first threshold of three. Therefore, in the example shown in FIG. 8, the part of the head of person 14 that has the shortest subject distance is selected as first focused subject 94. In the example shown in FIG. 8, the part of the head of person 14 that overlaps with peripheral region 44D is selected as first focused subject 94 (see the hatched area in FIG. 8).

[0063] Note that, although an example is given here in which the second subject 48D included in the peripheral region 44D identified as the first specific region 92 is selected as the first focused subject 94, this is merely one example. For example, a location located at the median, average, or mode of the subject distance to the second subject 48 included in the first specific region 92 may be selected as the first focused subject 94. Furthermore, the first selector 76D may compare the medians of the subject distance between multiple peripheral regions 44 identified as the first specific region 92, and select the second subject 48 in the peripheral region 44 identified based on the comparison results as the first focused subject 94. For example, in this case, of the peripheral regions 44A to 44D identified as the first specific region 92, the peripheral region 44 with the smallest median of the subject distance is selected as the first focused subject 94. Here, the median is given as an example, but the average or mode may be used instead of the median.

[0064] 9 as an example, when the first selection unit 76D determines that the first ratio is equal to or less than the first threshold (for example, the number of first specific regions 92 is three or less), it selects the first subject 46 in the central region 42 as the first focused subject 94. In other words, when the first ratio is equal to or less than the first threshold, it is determined that the number of peripheral regions 44 that the user may be paying attention to is smaller than when the first ratio exceeds the first threshold, and that the user is more likely to be paying attention to the central region 42 than to the peripheral regions 44, and the first subject 46 in the central region 42 is selected as the first focused subject 94.

[0065] 10 as an example, when the first focused subject 94 is selected, the first selection unit 76D outputs first focused subject information 96, which is information related to the first focused subject 94, to the first imaging control unit 76A. The first focused subject information 96 includes position identification information that identifies the position of the first focused subject 94 selected by the first selection unit 76D. Here, the position of the first focused subject 94 refers to the position of the pixel corresponding to the first focused subject 94 within the image represented by the digital image data 84 used to select the first focused subject 94.

[0066] The first imaging control unit 76A acquires from the first calculation unit 76B the subject distance corresponding to the first focused subject information 96 input from the first selection unit 76D. For example, the subject distance corresponding to the first focused subject information 96 refers to the first distance or the second distance corresponding to the position of a pixel identified from the position identification information included in the first focused subject information 96, out of the first distance and multiple second distances calculated by the first calculation unit 76B.

[0067] Note that, although an example in which the subject distance is acquired from the first calculation unit 76B by the first imaging control unit 76A has been described here, this is merely one example. For example, the subject distance (first distance or second distance) corresponding to the first focused subject 94 in the image represented by the digital image data 84 used to select the first focused subject 94 may be included in the first focused subject information 96. In this case, the first imaging control unit 76A may acquire the subject distance from the first focused subject information 96 input from the first selection unit 76D.

[0068] The first imaging control unit 76A calculates the in-focus position using the subject distance corresponding to the first focused subject information 96. Then, the first imaging control unit 76A controls the actuator 58 via the control device 56 to move the focus lens 54B to the in-focus position. This allows the first focused subject 94 to be brought into focus.

[0069] Meanwhile, the first selection unit 76D outputs the digital image data 84 used to select the first focused subject 94 and the first focused subject information 96 to the display control unit 76E. The display control unit 76E causes the display 30 to display the live view image 34 with the AF frame 36 based on the digital image data 84 and the first focused subject information 96. The AF frame 36 highlights the area 38 including the first focused subject 94 selected by the first selection unit 76D. Highlighting refers to a display that allows the area 38 including the first focused subject 94 selected by the first selection unit 76D to be distinguished from the remaining areas 38. For example, highlighting is achieved by differentiating the thickness, darkness, color, line type, etc. of the outline of the area 38 including the first focused subject 94 selected by the first selection unit 76D from those of the remaining areas 38. In the example shown in FIG. 10 , the peripheral area 44D is highlighted.

[0070] When the first focused subject 94 is focused and an imaging instruction is received by the receiving device 86, the first imaging control unit 76A performs main exposure control on the photoelectric conversion element driver 70, as shown in FIG. 11 for example. Main exposure control refers to control that causes the image sensor 50 to perform imaging with main exposure. For example, imaging with main exposure refers to a process of obtaining digital image data 84 for all available photosensitive pixels included in the imaging surface 52A. The imaging with main exposure includes a process of exposing all available photosensitive pixels included in the imaging surface 52A, causing all exposed photosensitive pixels to output analog image data to the signal processing circuit 74, and causing the signal processing circuit 74 to generate the digital image data 84.

[0071] Next, an example of the flow of the imaging process performed by the processor 76 of the imaging device 10 will be described with reference to the flowchart shown in FIG.

[0072] 12, first, in step ST10, the first imaging control unit 76A controls the photoelectric conversion element driver 70 to cause the image sensor 50 to perform live view imaging and acquire digital image data 84. As a result, the digital image data 84 is stored in the image memory 62 (see FIG. 5). After the processing of step ST10 is executed, the imaging processing proceeds to step ST12.

[0073] In step ST12, the display control unit 76E acquires digital image data 84 from the image memory 62 and generates a live view image 34 based on the acquired digital image data 84. Then, the display control unit 76E causes the live view image 34 with the AF frame 36 included therein to be displayed on the display 30 (see FIG. 5). After the processing of step ST12 is executed, the imaging processing proceeds to step ST14.

[0074] In step ST14, first calculation unit 76B acquires digital image data 84 from image memory 62, and calculates a first distance related to first subject 46 (see FIG. 2) and a plurality of second distances related to a plurality of second subjects 48 (see FIG. 2) based on the acquired digital image data 84. After the processing of step ST14 is executed, the imaging processing proceeds to step ST16.

[0075] In step ST16, the first identification unit 76C determines whether or not a second distance that satisfies the first condition exists among the second distances, using the first distance calculated in step ST14 and the multiple second distances (see FIG. 6). In step ST16, if a second distance that satisfies the first condition does not exist among the multiple second distances, the determination is negative, and the imaging process proceeds to step ST18. In step ST16, if a second distance that satisfies the first condition exists among the multiple second distances, the determination is positive, and the imaging process proceeds to step ST20.

[0076] In step ST18, the first selection unit 76D selects the first subject 46 (see FIG. 2) in the central region 42 as the first focused subject 94 (see FIGS. 7 and 9). After the processing of step ST18 is executed, the imaging processing proceeds to step ST28.

[0077] In step ST20, the first identification unit 76C identifies a first identified region 92 corresponding to the second distance that satisfies the first condition from the plurality of surrounding regions 44 (see FIG. 6). After the processing of step ST20 is executed, the imaging processing proceeds to step ST22.

[0078] In step ST22, the first selection unit 76D calculates a first ratio (see FIG. 8). That is, the first selection unit 76D acquires the digital image data 84 in which the first specific region 92 is identified from the first identification unit 76C, and calculates the ratio of the first specific region 92 to the multiple surrounding regions 44 as the first ratio based on the acquired digital image data 84. After the processing of step ST22 is executed, the imaging processing proceeds to step ST24.

[0079] In step ST24, the first selection unit 76D determines whether the first ratio calculated in step ST22 exceeds the first threshold value (see FIGS. 8 and 9). If the first ratio is equal to or less than the first threshold value (see FIG. 9), the determination is negative, and the imaging process proceeds to step ST18. If the first ratio exceeds the first threshold value (see FIG. 8), the determination is positive, and the imaging process proceeds to step ST26.

[0080] In step ST26, the first selection unit 76D selects the second subject 48 in the first specific region 92 as the first focused subject 94 (see FIG. 8). After the processing of step ST26 is executed, the imaging processing proceeds to step ST28.

[0081] In step ST28, the first imaging control unit 76A focuses on the first focused subject 94 selected in step ST18 or ST26 (see FIG. 10). Furthermore, the display control unit 76E causes the display 30 to display the live view image 34 with the AF frame 36 inside, and also causes the area 38 corresponding to the first focused subject 94 to be highlighted (see FIG. 10). After the processing of step ST28 is executed, the imaging processing proceeds to step ST30.

[0082] In step ST30, the first imaging control unit 76A determines whether or not an imaging instruction has been accepted by the accepting device 86. If an imaging instruction has not been accepted by the accepting device 86 in step ST30, the determination is negative, and the imaging process proceeds to step ST10. If an imaging instruction has been accepted by the accepting device 86 in step ST30, the determination is positive, and the imaging process proceeds to step ST32.

[0083] In step ST32, the first imaging control unit 76A controls the photoelectric conversion element driver 70 to perform main exposure control, thereby causing the image sensor 50 to perform imaging with main exposure. As a result, digital image data 84 obtained by performing imaging with main exposure is stored in the image memory 62. After the processing of step ST32 is executed, the imaging processing proceeds to step ST34.

[0084] In step ST34, the first imaging control unit 76A determines whether or not a condition for terminating the imaging process (hereinafter referred to as an "imaging process termination condition") has been satisfied. A first example of the imaging process termination condition is that an instruction to terminate the imaging process has been accepted by the acceptance device 86. A second example of the imaging process termination condition is that a certain period of time (e.g., several tens of seconds) has elapsed without an imaging instruction being accepted by the acceptance device 86. If the imaging process termination condition has not been satisfied in step ST34, the determination is negative, and the imaging process proceeds to step ST10. If the imaging process termination condition has been satisfied in step ST34, the determination is positive, and the imaging process ends.

[0085] As described above, the imaging device 10 captures images of the first subject 46 and the second subjects 48A-48H included in the multiple regions 38. A first distance, which is a subject distance related to the first subject 46, and multiple second distances, which are multiple subject distances related to the second subjects 48A-48H, are calculated (see FIG. 5). A first specific region 92 corresponding to a second distance among the multiple second distances that satisfies a first condition is identified from the multiple surrounding regions 44 (see FIG. 6). A ratio of the first specific region 92 to the multiple surrounding regions 44 is calculated as a first ratio (see FIGS. 8 and 9).

[0086] Here, for example, if the first ratio is large (e.g., if the first ratio exceeds the first threshold), it is determined that the second subject 48 in the first specific region 92 is more likely to be noticed by the user than the first subject 46 in the central region 42. On the other hand, if the first ratio is small (e.g., if the first ratio is equal to or smaller than the first threshold), it is determined that the second subject 48 that is being noticed by the user is not present in the multiple peripheral regions 44. Therefore, if the first ratio is large, focusing on the second subject 48 in the first specific region 92 is more likely to achieve a focus that matches the user's intention than focusing on the first subject 46. Conversely, if the first ratio is small, focusing on the first subject 46 is more likely to achieve a focus that matches the user's intention than focusing on the second subject 48 in the first specific region 92. Therefore, in the imaging device 10, a first focused subject 94, which is a subject to be focused, is selected from the first subject 46 and the second subject 48 in the first specific area 92 based on the first ratio (see FIGS. 7 to 9).

[0087] This makes it easier to focus on a subject that the user is paying attention to. For example, if it is more likely that the user is paying attention to the first subject 46 than to the second subject 48, it is possible to focus on the first subject 46, and conversely, if it is more likely that the user is paying attention to the second subject 48 than to the first subject 46, it is possible to focus on the second subject 48 that the user is paying attention to (i.e., the second subject 48 within the first specific area 92). In other words, this means that it is more difficult to focus on a subject that the user is not paying attention to.

[0088] Furthermore, in the imaging device 10, a first specific region 92 corresponding to a second distance that is shorter than the first distance among the plurality of second distances is identified from among the plurality of peripheral regions 44 (see FIG. 6). As a result, focusing is performed on a second subject 48 in the peripheral region 44 whose subject distance is shorter than the subject distance of the first subject 46 in the central region 42. Therefore, when the subject that the user is paying attention to is located closer to the user (closer to the user) than the first subject 46 in the central region 42, it is possible to easily focus on the subject that the user is paying attention to.

[0089] Furthermore, in the imaging device 10, when the number of first specific regions 92 (see FIGS. 7, 8, and 9) is equal to or less than a first threshold (i.e., 3) corresponding to the number of peripheral regions 44A to 44C located below the central region 42 in the up-down direction 40, it is determined that there is a high possibility that the second subject 48 that the user is paying attention to is not present in the first specific region 92. Conversely, when the number of first specific regions 92 exceeds the first threshold, it is determined that there is a high possibility that the second subject 48 that the user is paying attention to is present in the first specific region 92. Therefore, in the imaging device 10, when the number of first specific regions 92 exceeds the first threshold, the second subject 48 in the first specific region 92 is selected as the first focused subject 94. Therefore, when the user is paying attention to the second subject 48 in the first specific region 92, it is possible to easily focus on the second subject 48 that the user is paying attention to.

[0090] Furthermore, in the imaging device 10, if the plurality of second distances corresponding to the peripheral regions 44A to 44H are longer than the first distance corresponding to the central region 42, it is determined that the first subject 46 in the central region 42 is more likely to attract the user's attention than the second subjects 48A to 48H in the peripheral regions 44A to 44H. Therefore, in the imaging device 10, if the plurality of second distances corresponding to the peripheral regions 44A to 44H are longer than the first distance corresponding to the central region 42, the first subject 46 in the central region 42 is selected as the first focused subject 94. Therefore, when the user is paying attention to the first subject 46 in the central region 42, it is possible to easily focus on the first subject 46 that the user is paying attention to.

[0091] In the first embodiment described above, an example was given in which each of the four adjacent peripheral regions 44A to 44D was identified as the first identified region 92 (see FIG. 6 ), but this is merely an example, and the technology of the present disclosure is not limited to this. For example, non-adjacent peripheral regions 44 may be identified as the first identified region 92. In the example shown in FIG. 13 , the first identification unit 76C identifies each of the peripheral regions 44A to 44C and 44H as the first identified region 92. The peripheral region 44H identified as the first identified region 92 includes a bird 98 as part of the second subject 48H.

[0092] In this way, even if the peripheral region 44H identified as the first identified region 92 is not adjacent to the other peripheral regions 44 identified as the first identified region 92 (in the example shown in FIG. 13, the peripheral regions 44A to 44C), the number of first identified regions 92 is determined to be "4." Then, the number of first identified regions 92, "4," is used as a first ratio and compared with a first threshold value. Then, if the same conditions as in the above embodiment are satisfied, a location within the first identified region 92 with the shortest subject distance to the second subject 48 is selected as the first focused subject 94.

[0093] [Second embodiment] In the first embodiment, an example was described in which the processor 76 performs imaging processing in accordance with an imaging processing program 90 (see FIG. 4), but in the second embodiment, a case will be described in which the processor 76 performs imaging processing in accordance with an imaging processing program 100 (see FIG. 14). Note that in the second embodiment, the same components as in the first embodiment are given the same reference numerals, and their description will be omitted, and the description will focus on the differences from the first embodiment.

[0094] 14 as an example, an imaging processing program 100 is stored in the NVM 78. The processor 76 reads the imaging processing program 100 from the NVM 78 and executes the read imaging processing program 100 on the RAM 80. The processor 76 operates as a first imaging control unit 76A, a first calculation unit 76B, a first identification unit 76C, a first selection unit 76D, a display control unit 76E, a second imaging control unit 76F, and a second selection unit 76G in accordance with the imaging processing program 100 executed on the RAM 80, thereby performing imaging processing according to the second embodiment.

[0095] The process performed by the second imaging control unit 76F is an example of a "second imaging step" according to the technology of the present disclosure. Also, the process performed by the second selection unit 76G is an example of a "second selection step" according to the technology of the present disclosure.

[0096] 15, when live view imaging for one frame has ended under the control of the first imaging control unit 76A, the second imaging control unit 76F determines whether the timing for performing live view imaging for the next frame (hereinafter also referred to as "live view imaging timing") has arrived. If the second imaging control unit 76F determines that the live view imaging timing has arrived, it causes the image sensor 50 to perform live view imaging. As a result, as in the first embodiment, images of the first subject 46 and second subjects 48A-48H (see FIG. 2) are captured, and digital image data 84 representing one frame of the live view image is stored in the image memory 62. Then, in the same manner as in the first embodiment, the first calculation unit 76B calculates a first distance and a plurality of second distances based on the digital image data 84.

[0097] 16, the second selection unit 76G acquires the first distance and the second distances from the first calculation unit 76B. Based on the first distance and the second distances acquired from the first calculation unit 76B, the second selection unit 76G predicts the in-focus positions of the first subject 46 included in the central region 42 and the second subjects 48A-48H included in the peripheral regions 44A-44H in each region 38.

[0098] Then, second selection unit 76G selects, from among the plurality of predicted focus positions (i.e., the plurality of focus positions for first subject 46 and second subjects 48A-48H), the subject whose distance between focus positions is the shortest from the current focus position, as second focused subject 102. In the example shown in Fig. 16, the location corresponding to the focus position based on the second distance, which is the shortest subject distance among the plurality of subject distances that are the results of distance measurement performed on the plurality of locations of second subject 48A (in the example shown in Fig. 16, the location that overlaps with peripheral area 44A of person 14) is selected as second focused subject 102.

[0099] 17 as an example, when the second focused subject 102 is selected, the second selection unit 76G outputs second focused subject information 104, which is information related to the second focused subject 102, to the second imaging control unit 76F. The second focused subject information 104 includes position specifying information that specifies the position of the second focused subject 102 selected by the second selection unit 76G. Here, the position of the second focused subject 102 refers to the position of the pixel corresponding to the second focused subject 102 in the image represented by the digital image data 84 used to select the second focused subject 102.

[0100] The second imaging control unit 76F acquires from the first calculation unit 76B the subject distance corresponding to the second focused subject information 104 input from the second selection unit 76G. For example, the subject distance corresponding to the second focused subject information 104 refers to the first distance or the second distance corresponding to the position of a pixel identified from the position identification information included in the second focused subject information 104, among the first distance and multiple second distances calculated by the first calculation unit 76B.

[0101] Note that, although an example in which the subject distance is acquired from the first calculation unit 76B by the second imaging control unit 76F has been described here, this is merely one example. For example, the subject distance (first distance or second distance) corresponding to the second focused subject 102 in the image represented by the digital image data 84 used to select the second focused subject 102 may be included in the second focused subject information 104. In this case, the second imaging control unit 76F may acquire the subject distance from the second focused subject information 104 input from the second selection unit 76G.

[0102] The second imaging control unit 76F calculates the in-focus position using the subject distance corresponding to the second focused subject information 104. Then, the second imaging control unit 76F controls the actuator 58 via the control device 56 to move the focus lens 54B to the in-focus position. This achieves focusing on the second focused subject 102.

[0103] Meanwhile, the second selection unit 76G outputs the digital image data 84 used to select the second focused subject 102 and the second focused subject information 104 to the display control unit 76E. The display control unit 76E displays the live view image 34 with the AF frame 36 on the display 30 based on the digital image data 84 and the second focused subject information 104. In the same manner as in the first embodiment, the area 38 including the second focused subject 102 selected by the second selection unit 76G is highlighted in the AF frame 36. In the example shown in FIG. 17, the surrounding area 44A is highlighted.

[0104] Next, an example of the flow of imaging processing according to the second embodiment, which is performed by the processor 76 of the imaging device 10, will be described with reference to the flowcharts shown in FIGS. 18A and 18B.

[0105] Note that, here, steps that perform the same processing as the processing shown in the flowchart shown in Fig. 12 are assigned the same step numbers as in the flowchart shown in Fig. 12, and descriptions thereof will be omitted. The imaging processing shown in Fig. 18A and Fig. 18B differs from the imaging processing shown in Fig. 12 in that the processing of step ST30A is applied instead of the processing of step ST30, and in that the processing of steps ST36 to ST50 is added.

[0106] 18A, the first imaging control unit 76A determines whether or not an imaging instruction has been accepted by the accepting device 86. If an imaging instruction has been accepted by the accepting device 86 in step ST30A, the determination is affirmative, and the imaging process proceeds to step ST32. If an imaging instruction has not been accepted by the accepting device 86 in step ST30A, the determination is negative, and the imaging process proceeds to step ST36 shown in FIG. 18B.

[0107] 18B, the second imaging control unit 76F determines whether or not the live view imaging timing has arrived. If the live view imaging timing has not arrived in step ST36, the determination is negative, and the imaging process proceeds to step ST48. If the live view imaging timing has arrived in step ST36, the determination is positive, and the imaging process proceeds to step ST38.

[0108] In step ST38, the second imaging control unit 76F controls the photoelectric conversion element driver 70 to cause the image sensor 50 to perform live view imaging and acquire digital image data 84. As a result, the digital image data 84 is stored in the image memory 62 (see FIG. 15). After the processing of step ST38 is executed, the imaging processing proceeds to step ST40.

[0109] In step ST40, first calculation unit 76B acquires digital image data 84 from image memory 62, and calculates a first distance related to first subject 46 (see FIG. 2) and a plurality of second distances related to a plurality of second subjects 48 (see FIG. 2) based on the acquired digital image data 84. After the processing of step ST40 is executed, the imaging processing proceeds to step ST42.

[0110] In step ST42, the second selection unit 76G predicts the in-focus position of each region 38 (see FIGS. 1 and 2), i.e., the first subject 46 included in the central region 42 and the second subjects 48A-48H included in the peripheral regions 44A-44H, based on the first distance and the plurality of second distances calculated in step ST40. After the processing of step ST42 is performed, the imaging processing proceeds to step ST44.

[0111] In step ST44, second selection unit 76G selects, from the plurality of focus positions predicted in step ST42 (i.e., the plurality of focus positions for first subject 46 and second subjects 48A to 48H), the subject whose distance between focus positions is shortest from the current focus position as second focused subject 102. After the processing of step ST44 is executed, the imaging processing proceeds to step ST46.

[0112] In step ST46, the second imaging control unit 76F focuses on the second focused subject 102 selected in step ST44 (see FIG. 17). Furthermore, the display control unit 76E causes the display 30 to display the live view image 34 with the AF frame 36 inside, and also causes the area 38 corresponding to the second focused subject 102 to be highlighted (see FIG. 17). After the processing of step ST46 is executed, the imaging processing proceeds to step ST48.

[0113] In step ST48, the second imaging control unit 76F determines whether or not an imaging instruction has been accepted by the accepting device 86. If an imaging instruction has been accepted by the accepting device 86 in step ST48, the determination is affirmative, and the imaging process proceeds to step ST36. If an imaging instruction has not been accepted by the accepting device 86 in step ST48, the determination is negative, and the imaging process proceeds to step ST50.

[0114] In step ST50, the second imaging control unit 76F controls the photoelectric conversion element driver 70 to perform main exposure control, thereby causing the image sensor 50 to perform imaging with main exposure. As a result, digital image data 84 obtained by performing imaging with main exposure is stored in the image memory 62. After the processing of step ST50 is executed, the imaging processing proceeds to step ST34 shown in FIG. 18A.

[0115] As described above, in imaging device 10 according to the second embodiment, live view imaging of one frame is performed in step ST10 (see FIG. 18A) included in the imaging process, and then live view imaging of the next frame is performed in step ST38 (see FIG. 18B). Performing live view imaging of the next frame in step ST38 after performing live view imaging of one frame means that live view imaging of the next frame is performed in a state where focus has been achieved on first focused object 94 (see step ST28 in FIG. 18A). The object currently in focus is likely to be the object attracting the user's attention. For the object currently in focus, the distance between the focus position in the next frame and that in the previous frame is likely to be close.

[0116] Therefore, in imaging device 10 according to the second embodiment, from first subject 46 and second subjects 48A to 48H imaged in step ST38, a subject whose distance between first focused subject 94 and its in-focus position is closest is selected as second focused subject 102 to be focused. Specifically, from first subject 46 and second subjects 48A to 48H imaged in step ST38, a subject whose distance between first focused subject 94 and its in-focus position is closest is selected as second focused subject 102. Then, focusing is performed on selected second focused subject 102 (see step ST46 in FIG. 18B). This makes it possible to continue focusing on a subject that the user is paying attention to across frames.

[0117] In the second embodiment, the focus is handed over from the first focused subject 94 to the second focused subject 102 at intervals of one frame, but this is merely an example, and the focus may be handed over from the first focused subject 94 to the second focused subject 102 at intervals of several frames to several tens of frames. Furthermore, the processes of steps ST36 to ST48 are performed at intervals of one frame, but these may also be performed at intervals of several frames to several tens of frames.

[0118] Furthermore, in the second embodiment described above, an example has been given in which a subject whose distance between the first focused subject 94 and the in-focus position is close from the first focused subject 46 and the second subjects 48A to 48H imaged in step ST38 is selected as the second focused subject 102, but this is merely one example. For example, from the first subject 46 and the second subjects 48A to 48H imaged in step ST38, a subject whose distance on a two-dimensional plane when successive frames are superimposed (for example, the subject at the shortest distance) is close to the first focused subject 94 may be selected as the second focused subject 102. Also, for example, from the first subject 46 and the second subjects 48A to 48H imaged in step ST38, a subject whose subject distance is close to the first focused subject 94 (for example, the subject at the shortest distance) may be selected as the second focused subject 102.

[0119] Furthermore, in the second embodiment described above, an example is given in which, of the plurality of predicted focus positions, a subject whose distance between focus positions is the shortest from the current focus position is selected as the second focused subject 102. However, the technology of the present disclosure is not limited to this. For example, of the plurality of predicted focus positions, a subject whose distance between focus positions is the shortest within a range of less than a predetermined distance (for example, several millimeters) from the current focus position may be selected as the second focused subject 102.

[0120] In this case, for example, as shown in FIG. 19, the process of step ST43 may be inserted between the process of step ST42 and the process of step ST44 in the imaging process. In step ST43, the second selection unit 76G determines whether or not there is a subject, among the multiple focus positions predicted in step ST42, whose distance between the focus positions is within a range of less than a predetermined distance from the current focus position (e.g., the focus position corresponding to the first focused subject 94 or the second focused subject 102 in the previous frame). In step ST43, if there is no subject, among the multiple focus positions predicted in step ST42, whose distance between the focus positions is within a range of less than the predetermined distance from the current focus position, whose distance between the focus positions is within a range of less than the predetermined distance from the current focus position, the determination is negative, and the imaging process proceeds to step ST48. In step ST43, if there is a subject, among the multiple focus positions predicted in step ST42, whose distance between the focus positions is within a range of less than the predetermined distance from the current focus position, whose distance is within a range of less than the predetermined distance from the current focus position, the determination is positive, and the imaging process proceeds to step ST44.

[0121] In this way, by performing the processing of step ST43 in the imaging processing, of the multiple focus positions predicted in step ST42, a subject corresponding to a focus position with the shortest distance within a range where the distance between the focus positions exceeds a predetermined distance from the current focus position is not selected as the second focused subject 102. In other words, a subject corresponding to a focus position that is significantly far from the current focus position is determined to be a subject that is unlikely to be noticed by the user, and is not selected as the second focused subject 102. Therefore, it is possible to prevent focusing on a subject that the user is not paying attention to.

[0122] [Third embodiment] In the first and second embodiments, an example using an AF frame 36 consisting of a 3×3 area 38 was described, but in this third embodiment, an example using an AF frame 41 (see FIG. 20) consisting of a 5×5 area 39 will be described. Note that in this third embodiment, the same components as in the first and second embodiments are denoted by the same reference numerals, and their description will be omitted, and the description will focus on differences from the first and second embodiments.

[0123] As an example, as shown in Fig. 20, the imaging device 10 according to the third embodiment has an AF frame 41 instead of the AF frame 36 described in the above embodiment. The AF frame 41 is a rectangular frame that is slightly larger than the AF frame 36. The AF frame 41 includes a plurality of regions 39. The plurality of regions 39 are an example of the "plurality of third regions" according to the technology of the present disclosure.

[0124] The multiple regions 39 are arranged in a 5×5 matrix. The multiple regions 39 included in the AF frame 41 are made up of a central region 42 and multiple peripheral regions 43. The multiple peripheral regions 43 are peripheral regions 43A to 43X. Each of the peripheral regions 43A to 43X includes a different third subject. The peripheral regions 44A to 44H are included in the peripheral regions 43A to 43X as peripheral regions 43G, 43H, 43I, 43L, 43M, 43P, 43Q, and 43R. That is, the multiple regions 39 include the multiple regions 38 (see FIGS. 1 and 2) arranged in a 3×3 matrix as multiple regions 39 arranged in a 3×3 matrix (i.e., the central region 42 and peripheral regions 43G, 43H, 43I, 43L, 43M, 43P, 43Q, and 43R).

[0125] In the AF frame 41, a subject to be focused is selected in two stages: a 5×5 area 39 and a 3×3 area 39. In order to select a subject to be focused in two stages: a 5×5 area 39 and a 3×3 area 39, an imaging processing program 106 is stored in the NVM 78, as shown in FIG. 21 as an example. The processor 76 reads the imaging processing program 106 from the NVM 78 and executes the read imaging processing program 106 on the RAM 80. The processor 76 operates as a first imaging control unit 76A, a first calculation unit 76B, a first identification unit 76C, a first selection unit 76D, a display control unit 76E, a second imaging control unit 76F, a second selection unit 76G, a second calculation unit 76H, a second identification unit 76I, and a third selection unit 76J in accordance with the imaging processing program 106 executed on the RAM 80, thereby performing imaging processing according to the third embodiment.

[0126] The process performed by the second calculation unit 76H is an example of a "second calculation step" according to the technology of the present disclosure. The process performed by the second identification unit 76I is an example of a "second identification step" according to the technology of the present disclosure. The process performed by the third selection unit 76J is an example of a "third selection step" according to the technology of the present disclosure.

[0127] As an example, as shown in FIG. 22 , when the receiving device 86 receives an imaging preparation instruction, it outputs an imaging preparation instruction signal to the second calculation unit 76H. The second calculation unit 76H performs distance calculation processing for the entire region 39 within the AF frame 41. The distance calculation processing is processing for measuring distances to the central region 42 and all peripheral regions 43. In this case, for example, the second calculation unit 76H calculates the first distance in the same manner as in the first embodiment. Also, for example, the second calculation unit 76H calculates multiple third distances based on phase difference image data included in the digital image data 84 in the same manner as calculating the first distance. The multiple third distances are multiple subject distances for all third subjects (see FIG. 20 ) included in all peripheral regions 43 within the AF frame 41.

[0128] In the third embodiment, distance measurement is performed on multiple locations of the third subject within the peripheral region 43. Therefore, multiple subject distances are calculated for the third subject within the peripheral region 43. The second calculation unit 76H acquires the shortest subject distance from the multiple subject distances for the third subject within the peripheral region 43 as the third distance. Note that, although the shortest subject distance among the multiple subject distances for the third subject within the peripheral region 43 is set as the third distance here, this is merely an example, and a representative subject distance for the third subject within the peripheral region 43 may be set as the third distance. Examples of the representative subject distance for the third subject within the peripheral region 43 include the average, median, or mode of the multiple subject distances for the third subject within the peripheral region 43.

[0129] The display control unit 76E acquires the digital image data 84 used in the calculation by the second calculation unit 76H, and generates a live view image 34 based on the acquired digital image data 84. The display control unit 76E then causes the display to display the live view image 34 and also causes the AF frame 41 to be superimposed on the live view image 34. Note that, hereinafter, the live view image 34 with the AF frame 41 superimposed thereon is also referred to as the "live view image 34 with the AF frame 41 included."

[0130] As an example, as shown in FIG. 23, the second calculation unit 76H determines whether the distance calculation process for the entire region 39 within the AF frame 41 has been successful (i.e., whether the first distance for the first subject 46 and multiple third distances for multiple third subjects have been calculated). If the distance calculation process for the entire region 39 within the AF frame 41 has been successful, the second determination unit 76I acquires the first distance, multiple third distances, and digital image data 84 from the second calculation unit 76H. The second determination unit 76I determines whether a third distance that satisfies a second condition exists among the multiple third distances. For example, the second condition is The third distance isThis refers to a condition that the distance is shorter than the first distance. Here, if a third distance that satisfies the second condition exists among the multiple third distances, the second identification unit 76I uses the digital image data 84 to identify a second identified region 108 corresponding to the third distance that satisfies the second condition from among the multiple surrounding regions 43. In the example shown in FIG. 23, each of the surrounding regions 43A to 43K is shown as a second identified region 108 corresponding to the third distance that satisfies the second condition.

[0131] On the other hand, if the distance calculation process for the entire area 39 within the AF frame 41 fails (i.e., if at least one of the first distance for the first subject 46 and the plurality of third distances for the plurality of third subjects is not calculated by the second calculation unit 76H), the second identification unit 76I does not identify the second identified area 108. Then, the processor 76 executes the same imaging process as in the first or second embodiment (i.e., imaging process using the 3×3 area 39).

[0132] When the second identification unit 76I identifies a second identified region 108 corresponding to the third distance that satisfies the second condition, as shown in FIG. 24 as an example, the third selection unit 76J acquires digital image data 84 from the second identification unit 76I. Then, the third selection unit 76J calculates a second ratio, which is the ratio of the second identified region 108 to the plurality of surrounding regions 43. For example, the second ratio is the number of second identified regions 108. However, this is merely an example, and the second ratio may be the ratio of the total area of ​​the plurality of surrounding regions 43 (peripheral regions 43A to 43K in the example shown in FIG. 8) that are identified as the second identified region 108 to the total area of ​​the plurality of surrounding regions 43, or any value corresponding to the number of second identified regions 108.

[0133] The third selection unit 76J selects a third focused object 110 to be focused from the first object 46 and the third object using the digital image data 84 based on the second ratio. Specifically, the third selection unit 76J first determines whether the second ratio exceeds a second threshold. For example, the second threshold refers to the number of peripheral areas 43 located below the central area 42 in the up-down direction 40 (here, as an example, 10 peripheral areas 43A to 43J). If the third selection unit 76J determines that the second ratio exceeds the second threshold, it selects the third object in the second specific area 108 as the third focused object 110. In other words, if the second ratio exceeds the second threshold, it is determined that the user is more likely to be paying attention to the third object in the second specific area 108 than if the second ratio is equal to or less than the second threshold, and the third object in the second specific area 108 is selected as the third focused object 110.

[0134] 25 as an example, when the third selection unit 76J determines that the second ratio is equal to or less than the second threshold, it selects the first subject 46 in the central region 42 as the third focused subject 110. In other words, when the second ratio is equal to or less than the second threshold, it is determined that the number of peripheral regions 43 that the user may be paying attention to is smaller than when the second ratio exceeds the second threshold, and that the user is more likely to be paying attention to the central region 42 than to the peripheral regions 43, and therefore the first subject 46 in the central region 42 is selected as the third focused subject 110.

[0135] 26 as an example, when the third focused subject 110 is selected, the third selection unit 76J outputs third focused subject information 112, which is information related to the third focused subject 110, to the first imaging control unit 76A. The third focused subject information 112 includes position specifying information that specifies the position of the third focused subject 110 selected by the third selection unit 76J. Here, the position of the third focused subject 110 refers to the position of the pixel corresponding to the third focused subject 110 in the image represented by the digital image data 84 used to select the third focused subject 110.

[0136] The first imaging control unit 76A acquires from the second calculation unit 76H the subject distance corresponding to the third focused subject information 112 input from the third selection unit 76J. For example, the subject distance corresponding to the third focused subject information 112 refers to the first distance or the third distance corresponding to the position of a pixel identified from the position identification information included in the third focused subject information 112, among the first distance and the multiple third distances calculated by the second calculation unit 76H.

[0137] Note that, although an example in which the subject distance is acquired from the second calculation unit 76H by the first imaging control unit 76A has been described here, this is merely one example. For example, the subject distance (first distance or second distance) corresponding to the third focused subject 110 in the image represented by the digital image data 84 used to select the third focused subject 110 may be included in the third focused subject information 112. In this case, the first imaging control unit 76A may acquire the subject distance from the third focused subject information 112 input from the third selection unit 76J.

[0138] The first imaging control unit 76A calculates the in-focus position using the subject distance corresponding to the third focused subject information 112. Then, the first imaging control unit 76A controls the actuator 58 via the control device 56 to move the focus lens 54B to the in-focus position. This allows the third focused subject 110 to be brought into focus.

[0139] Meanwhile, the third selection unit 76J outputs the digital image data 84 used to select the third focused subject 110 and the third focused subject information 112 to the display control unit 76E. The display control unit 76E displays the live view image 34 with the AF frame 41 on the display 30 based on the digital image data 84 and the third focused subject information 112. The AF frame 41 highlights an area 39 that includes the third focused subject 110 selected by the third selection unit 76J. In the example shown in FIG. 26, the peripheral area 43K is highlighted. Note that when the third focused subject 110 is focused and an imaging instruction is accepted by the accepting device 86, the first imaging control unit 76A performs main exposure control on the photoelectric conversion element driver 70 (see FIG. 11).

[0140] 27, when live view imaging for one frame has ended under the control of the first imaging control unit 76A, the second imaging control unit 76F determines whether the timing for live view imaging has arrived. If the second imaging control unit 76F determines that the timing for live view imaging has arrived, it causes the image sensor 50 to perform live view imaging. As a result, images of the first subject 46 and all third subjects (see FIG. 20) are captured, and digital image data 84 representing one frame of the live view image is stored in the image memory 62. Then, in a manner similar to the example shown in FIG. 22, the second calculation unit 76H performs distance calculation processing for the entire region 39 within the AF frame 41.

[0141] 28, the second calculation unit 76H determines whether the distance calculation process for the entire region 39 within the AF frame 41 has been successful. If the distance calculation process for the entire region 39 within the AF frame 41 has been successful, the second selection unit 76G acquires the first distance and a plurality of third distances from the second calculation unit 76H. Based on the first distance and the plurality of third distances acquired from the second calculation unit 76H, the second selection unit 76G predicts the focus positions of the first subject 46 included in the central region 42 and the third subjects (see FIG. 20) included in the peripheral regions 43A to 43X.

[0142] Then, second selection unit 76G selects, from among the plurality of predicted focus positions (i.e., the plurality of focus positions for first subject 46 and the plurality of third subjects), the subject whose distance between focus positions is the shortest from the current focus position, as fourth focused subject 114. In the example shown in Fig. 28, a location (in the example shown in Fig. 28, a location of person 14 that overlaps with peripheral region 43A) corresponding to the focus position based on the third distance, which is the shortest subject distance among multiple subject distances that are results of distance measurement performed on multiple locations of the third subject included in peripheral region 43A, is selected as fourth focused subject 114.

[0143] 28, if the distance calculation process for the entire area 39 within the AF frame 41 fails, the second selection unit 76G does not select the fourth focused object 114. Then, the processor 76 executes the same imaging process as in the first or second embodiment (i.e., imaging process using the 3×3 area 38).

[0144] 29, the second selection unit 76G outputs fourth focused subject information 116, which is information related to the fourth focused subject 114, to the second imaging control unit 76F. The fourth focused subject information 116 includes position specifying information that specifies the position of the fourth focused subject 114 selected by the second selection unit 76G. Here, the position of the fourth focused subject 114 refers to the position of the pixel corresponding to the fourth focused subject 114 in the image represented by the digital image data 84 used to select the fourth focused subject 114.

[0145] The second imaging control unit 76F acquires from the second calculation unit 76H the subject distance corresponding to the fourth focused subject information 116 input from the second selection unit 76G. For example, the subject distance corresponding to the fourth focused subject information 116 refers to the first distance or the third distance corresponding to the position of a pixel identified from the position identification information included in the fourth focused subject information 116, out of the first distance and multiple third distances calculated by the second calculation unit 76H.

[0146] Note that, although an example in which the subject distance is acquired from the second calculation unit 76H by the second imaging control unit 76F has been described here, this is merely one example. For example, the subject distance (first distance or third distance) corresponding to the fourth focused subject 114 in the image represented by the digital image data 84 used to select the fourth focused subject 114 may be included in the fourth focused subject information 116. In this case, the second imaging control unit 76F may acquire the subject distance from the fourth focused subject information 116 input from the second selection unit 76G.

[0147] The second imaging control unit 76F calculates the in-focus position using the subject distance corresponding to the fourth focused subject information 116. Then, the second imaging control unit 76F controls the actuator 58 via the control device 56 to move the focus lens 54B to the in-focus position. This allows the fourth focused subject 114 to be brought into focus.

[0148] Meanwhile, the second selection unit 76G outputs the digital image data 84 and fourth focused object information 116 used to select the fourth focused object 114 to the display control unit 76E. The display control unit 76E displays the live view image 34 containing the AF frame 41 on the display 30 based on the digital image data 84 and the fourth focused object information 116. In the same manner as in the first embodiment, the area 39 including the fourth focused object 114 selected by the second selection unit 76G is highlighted in the AF frame 41. In the example shown in FIG. 29 , the surrounding area 43A is highlighted.

[0149] Next, an example of the flow of imaging processing according to the third embodiment, which is performed by the processor 76 of the imaging device 10, will be described with reference to the flowcharts shown in FIGS. 30A to 30C.

[0150] Note that, here, steps that perform the same processing as the processing shown in the flowchart shown in Fig. 12 are assigned the same step numbers as in the flowchart shown in Fig. 12, and descriptions thereof will be omitted. The imaging processing shown in Fig. 30A to Fig. 30C differs from the imaging processing shown in Fig. 12 in that processing of steps ST60 to ST102 is inserted before processing of step ST10, processing of step ST30B is applied instead of processing of step ST30, processing of step ST32 is omitted, and processing of step ST34 is omitted.

[0151] 30A, first, in step ST60, the first imaging control unit 76A controls the photoelectric conversion element driver 70 to cause the image sensor 50 to perform live view imaging and acquire digital image data 84. As a result, the digital image data 84 is stored in the image memory 62 (see FIG. 22). After the processing of step ST60 is executed, the imaging processing proceeds to step ST62.

[0152] In step ST62, the display control unit 76E acquires digital image data 84 from the image memory 62, and generates a live view image 34 based on the acquired digital image data 84. Then, the display control unit 76E causes the live view image 34 with the AF frame 41 included therein to be displayed on the display 30 (see FIG. 22). After the processing of step ST62 is executed, the imaging processing proceeds to step ST64.

[0153] In step ST64, the second calculation unit 76H acquires the digital image data 84 from the image memory 62, and executes distance calculation processing for the entire area 39 within the AF frame 41 based on the acquired digital image data 84 (see FIG. 22). After the processing of step ST64 is executed, the imaging processing proceeds to step ST66.

[0154] In step ST66, the second calculation unit 76H determines whether the distance calculation process for the entire region 39 within the AF frame 41 has been successful (see FIG. 23). If the distance calculation process for the entire region 39 within the AF frame 41 has failed in step ST66, the determination is negative, and the imaging process proceeds to step ST10 shown in FIG. 30C. If the distance calculation process for the entire region 39 within the AF frame 41 has been successful in step ST66, the determination is positive, and the imaging process proceeds to step ST68.

[0155] In step ST68, the second specifying unit 76I determines whether or not a third distance that satisfies the second condition exists among the third distances, using the first distance and the multiple third distances calculated by executing the distance calculation process in step ST64 (see FIG. 23). In step ST68, if a third distance that satisfies the second condition does not exist among the multiple third distances, the determination is negative, and the imaging process proceeds to step ST10 shown in FIG. 30C. In step ST68, if a third distance that satisfies the second condition exists among the multiple third distances, the determination is positive, and the imaging process proceeds to step ST70.

[0156] In step ST70, the second identification unit 76I identifies a second identified region 108 corresponding to the third distance that satisfies the second condition from the plurality of surrounding regions 43. After the processing of step ST70 is executed, the imaging processing proceeds to step ST72.

[0157] In step ST72, the third selection unit 76J calculates the second ratio (see FIG. 24). That is, the third selection unit 76J acquires the digital image data 84 in which the second specific region 108 is identified from the second identification unit 76I, and calculates the ratio of the second specific region 108 to the multiple surrounding regions 43 as the second ratio based on the acquired digital image data 84. After the processing of step ST72 is executed, the imaging processing proceeds to step ST74.

[0158] In step ST74, the third selection unit 76J determines whether the second ratio calculated in step ST72 exceeds the second threshold value (see FIGS. 24 and 25). If the second ratio is equal to or less than the second threshold value (see FIG. 25), the determination is negative, and the imaging process proceeds to step ST76. If the second ratio exceeds the second threshold value (see FIG. 24), the determination is positive, and the imaging process proceeds to step ST78.

[0159] In step ST76, the third selection section 76J selects the first subject 46 in the central region 42 as the third focused subject 110 (see FIG. 25). After the processing of step ST76 is executed, the imaging processing proceeds to step ST80.

[0160] In step ST78, third selection section 76J selects a third subject within second specific region 108 as third focused subject 110 (see FIG. 24). After the processing of step ST78 is executed, the imaging processing proceeds to step ST80.

[0161] In step ST80, the first imaging control unit 76A focuses on the third focused subject 110 selected in step ST76 or ST78 (see FIG. 26). Furthermore, the display control unit 76E causes the display 30 to display the live view image 34 with the AF frame 41 inside, and also causes the area 39 corresponding to the third focused subject 110 to be highlighted (see FIG. 26). After the processing of step ST80 is executed, the imaging processing proceeds to step ST82.

[0162] In step ST82, the first imaging control unit 76A determines whether or not an imaging instruction has been accepted by the accepting device 86. If an imaging instruction has not been accepted by the accepting device 86 in step ST82, the determination is negative, and the imaging process proceeds to step ST88 shown in Fig. 30B. If an imaging instruction has been accepted by the accepting device 86 in step ST82, the determination is positive, and the imaging process proceeds to step ST84.

[0163] In step ST84, the first imaging control unit 76A controls the photoelectric conversion element driver 70 to perform main exposure control, thereby causing the image sensor 50 to perform imaging with main exposure. As a result, digital image data 84 obtained by performing imaging with main exposure is stored in the image memory 62. After the processing of step ST84 is executed, the imaging processing proceeds to step ST86.

[0164] 30B, the second imaging control unit 76F determines whether or not the live view imaging timing has arrived. If the live view imaging timing has not arrived in step ST88, the determination is negative, and the imaging process proceeds to step ST102. If the live view imaging timing has arrived in step ST88, the determination is positive, and the imaging process proceeds to step ST90.

[0165] In step ST90, the second imaging control unit 76F controls the photoelectric conversion element driver 70 to cause the image sensor 50 to perform live view imaging and acquire digital image data 84. As a result, the digital image data 84 is stored in the image memory 62 (see FIG. 27). After the processing of step ST90 is executed, the imaging processing proceeds to step ST92.

[0166] In step ST92, the second calculation unit 76H acquires the digital image data 84 from the image memory 62, and executes distance calculation processing for the entire area 39 within the AF frame 41 based on the acquired digital image data 84 (see FIG. 27). After the processing of step ST92 is executed, the imaging processing proceeds to step ST94.

[0167] In step ST94, the second calculation unit 76H determines whether or not the distance calculation process for the entire region 39 within the AF frame 41 has been successful (see FIG. 28). If the distance calculation process for the entire region 39 within the AF frame 41 has failed in step ST94, the determination is negative, and the imaging process proceeds to step ST10 shown in FIG. 30C. If the distance calculation process for the entire region 39 within the AF frame 41 has been successful in step ST94, the determination is positive, and the imaging process proceeds to step ST96.

[0168] In step ST96, the second selection unit 76G acquires the first distance and the plurality of third distances obtained by executing the distance calculation process in step ST92, and predicts the in-focus positions of the first subject 46 included in the central region 42 and the plurality of third subjects included in the peripheral regions 43A to 43X in each region 39 (see FIG. 20) based on the acquired first distance and the plurality of third distances. After the process of step ST96 is executed, the imaging process proceeds to step ST98.

[0169] In step ST98, the second selection unit 76G selects, from the plurality of focus positions predicted in step ST96 (i.e., the plurality of focus positions for the first subject 46 and the plurality of third subjects), the subject whose distance between focus positions is the shortest from the current focus position as the fourth focused subject 114 (see FIG. 28). After the processing of step ST98 is executed, the imaging processing proceeds to step ST100.

[0170] In step ST100, the second imaging control unit 76F focuses on the fourth focused subject 114 selected in step ST98 (see FIG. 29). Furthermore, the display control unit 76E causes the display 30 to display the live view image 34 containing the AF frame 41, and also causes the area 39 corresponding to the fourth focused subject 114 to be highlighted (see FIG. 29). After the processing of step ST100 is executed, the imaging processing proceeds to step ST102.

[0171] In step ST102, the second imaging control unit 76F determines whether or not an imaging instruction has been accepted by the accepting device 86. If an imaging instruction has been accepted by the accepting device 86 in step ST102, the determination is affirmative, and the imaging process proceeds to step ST84 shown in Fig. 30A. If an imaging instruction has not been accepted by the accepting device 86 in step ST102, the determination is negative, and the imaging process proceeds to step ST88.

[0172] 30C, the processes of steps ST10 to ST28 described in the first embodiment are performed by the processor 76. In step ST30B, ​​the first imaging control unit 76A determines whether or not an imaging instruction has been accepted by the accepting device 86. If an imaging instruction has not been accepted by the accepting device 86 in step ST30B, ​​the determination is negative, and the imaging processing proceeds to step ST18. If an imaging instruction has been accepted by the accepting device 86 in step ST30B, ​​the determination is positive, and the imaging processing proceeds to step ST84 shown in FIG. 30A.

[0173] 30A, the first imaging control unit 76A determines whether or not the imaging process termination condition is satisfied. If the imaging process termination condition is not satisfied in step ST86, the determination is negative, and the imaging process proceeds to step ST60. If the imaging process termination condition is satisfied in step ST86, the determination is positive, and the imaging process ends.

[0174] As described above, in the imaging device 10 according to the third embodiment, a first distance related to a first subject 46 in a central region 42 included in an AF frame 41 (see FIG. 20) that is wider than the AF frame 36 (see FIGS. 1 and 2) and a plurality of third distances related to a plurality of third subjects in peripheral regions 43A to 43X included in the AF frame 41 are calculated. Then, a second specific region 108 corresponding to a third distance that satisfies a second condition among the plurality of third distances is identified from among the plurality of regions 39 (see FIG. 23). Then, a ratio of the second specific region 108 to the plurality of peripheral regions 43 is calculated as a second ratio (see FIGS. 24 and 25).

[0175] Here, for example, if the second ratio is large (e.g., if the second ratio exceeds the second threshold), it is determined that the third subject in the second specific region 108 is more likely to be noticed by the user than the first subject 46 in the central region 42. On the other hand, if the second ratio is small (e.g., if the second ratio is equal to or smaller than the second threshold), it is determined that the third subject that is being noticed by the user is not present in the multiple peripheral regions 43. Therefore, if the second ratio is large, focusing on the third subject in the second specific region 108 is more likely to achieve a focus that matches the user's intention than on the first subject 46. Conversely, if the second ratio is small, focusing on the first subject 46 is more likely to achieve a focus that matches the user's intention than on the third subject in the second specific region 108. Therefore, in the imaging device 10, third focused subject 110, which is the subject to be focused, is selected from the first subject 46 and the third subject in the second specific area 108 based on the second ratio (see FIGS. 24 and 25).

[0176] This makes it easier to focus on a subject that the user is paying attention to within the AF frame 41 (see FIG. 20), which is wider than the AF frame 36 (see FIGS. 1 and 2). For example, if it is highly likely that the user is paying attention to the first subject 46 rather than the third subject, it is possible to focus on the first subject 46, and conversely, if it is highly likely that the user is paying attention to the third subject rather than the first subject 46, it is possible to focus on the third subject that the user is paying attention to (i.e., the third subject within the second specific area 108). In other words, this means that it is more difficult to focus on a subject that the user is not paying attention to within the AF frame 41, which is wider than the AF frame 36.

[0177] Furthermore, in the imaging device 10 according to the third embodiment, a second specific region 108 corresponding to a third distance that is shorter than the first distance among the plurality of third distances is specified from among the plurality of peripheral regions 43 (see FIG. 23). As a result, focusing is performed on a third subject in the peripheral region 43 whose subject distance is shorter than the subject distance of the first subject 46 in the central region 42. Therefore, when a subject that the user is paying attention to is located closer to the user (closer to the user) than the first subject 46 in the central region 42 within the AF frame 41 (see FIG. 20) that is wider than the AF frame 36 (see FIGS. 1 and 2), it is possible to easily focus on the subject that the user is paying attention to.

[0178] Furthermore, the imaging device 10 according to the third embodiment uses an AF frame 41 that is wider than the AF frame 36. Therefore, distance measurement for all regions 39 within the AF frame 41 is less likely to be successful than distance measurement for all regions 38 within the AF frame 36. If focusing is always performed on the central region 42 when distance measurement for all regions 39 within the AF frame 41 is unsuccessful, focusing on a subject not being focused on by the user will occur if the subject the user is focusing on is not present in the central region 42. Therefore, in the imaging device 10 according to the third embodiment, if the second specific region 108 is not identified due to a failure in distance calculation processing for all regions 39, the imaging process described in the first or second embodiment (e.g., the processes shown in steps ST10 to ST28 in FIG. 30C ) is performed. The imaging process described in the first or second embodiment uses an AF frame 36 that is narrower than the AF frame 41. Therefore, even if the second specific area 108 is not identified due to a failure in the distance calculation process for the entire area 39, if the subject the user is focusing on is within the peripheral area 44 within the AF frame 36, it is possible to focus on the second subject 48 within the peripheral area 44, rather than the first subject 46 within the central area 42. As a result, it is easier to focus on the subject the user is focusing on, compared to when imaging processing is performed using only the AF frame 41.

[0179] Furthermore, in the imaging device 10 according to the third embodiment, imaging processing is performed in two stages: imaging processing using a plurality of regions 39 arranged in a 5×5 matrix, and imaging processing using a plurality of regions 38 arranged in a 3×3 matrix. Therefore, even if the second specific region 108 is not identified due to a failure in the distance calculation processing for the plurality of regions 39, if the subject the user is paying attention to is included in the plurality of regions 38, it is possible to focus on the second subject 48 in the peripheral region 44, rather than the first subject 46 in the central region 42. As a result, it is easier to focus on the subject the user is paying attention to, compared to when imaging processing is performed using only the plurality of regions 39 arranged in a 5×5 matrix.

[0180] Although the third embodiment exemplifies a plurality of regions 39 arranged in a 5×5 matrix and a plurality of regions 38 arranged in a 3×3 matrix, the technology of the present disclosure is not limited to this. For example, imaging processing using a plurality of regions arranged in a 7×7 matrix and imaging processing using a plurality of regions 39 arranged in a 5×5 matrix may be performed. In other words, when N is an odd number greater than or equal to 3, imaging processing using a plurality of regions arranged in an N×N matrix and imaging processing using a plurality of regions arranged in an (N+2)×(N+2) matrix may be performed.

[0181] Furthermore, when M is an even number greater than or equal to 2, imaging processing using multiple regions arranged in an N×N matrix and imaging processing using multiple regions arranged in an (N+M)×(N+M) matrix may be performed.

[0182] In the third embodiment, the imaging process proceeds to step ST34 in Fig. 30A when the determination in step ST30B in Fig. 30C is negative. However, the technology of the present disclosure is not limited to this. For example, when the determination in step ST30B in Fig. 30C is negative, the processor 76 may perform the process shown in the flowchart in Fig. 18B or 19.

[0183] [Fourth embodiment] In the fourth embodiment, an example will be described in which continuous shooting is performed by the imaging device 10 (i.e., a continuous shooting mode is set for the imaging device 10). Note that in the fourth embodiment, the same components as those in the first to third embodiments are given the same reference numerals, and their description will be omitted, and the description will focus on differences from the first to third embodiments.

[0184] First, an example of the flow of a conventionally known continuous shooting process will be described with reference to Fig. 31. As an example, as shown in Fig. 31, live view imaging is performed during a live view imaging period. During the live view imaging period, live view imaging is performed, and non-phase difference image data included in digital image data 84 is stored in image memory 62. Then, processor 76 reads the non-phase difference image data from image memory 62, and an image represented by the read non-phase difference image data is displayed on display 30 as a live view image.

[0185] During the live view imaging period, the live view imaging is performed, and phase-contrast image data included in the digital image data 84 is stored in the image memory 62. The processor 76 reads the phase-contrast image data from the image memory 62 and calculates the subject distance related to the focus target area based on the read phase-contrast image data. The focus target area is, for example, the area within the AF frame 36, the area within the AF frame 41, or an area specified by the user via the reception device 86.

[0186] The focus target area may be a fixed area, or an area whose position changes within the imaging range, such as an area that tracks a specific moving object (e.g., a specific person, a specific car, a specific bicycle, or a specific aircraft) recognized by image recognition processing based on image data, etc., performed by processor 76.

[0187] During the live view imaging period, processor 76 performs AF calculations based on the calculated subject distance. Also during the live view imaging period, processor 76 predicts the focus position of focus lens 54B relative to the focus target area at the timing when main exposure for the first frame of continuous shooting begins, based on the focus position obtained by performing the AF calculations. The focus position prediction is performed, for example, based on the focus positions obtained by the most recent AF calculations (e.g., the two most recent AF calculations tracing back from the current time) and the elapsed time from the completion of the prediction for the first frame of continuous shooting to the current time. Processor 76 controls actuator 58 via control device 56 to move focus lens 54B along optical axis OA toward the predicted focus position.

[0188] When the release button 24 is fully pressed and the fully pressed state continues for a certain period of time or more, the timing to start continuous shooting (hereinafter also referred to as the "continuous shooting start timing") arrives. When the continuous shooting start timing arrives, the live view image on the display 30 is hidden. In other words, the display area where the live view image is displayed is blacked out. Furthermore, when the continuous shooting start timing arrives, continuous shooting begins.

[0189] The processor 76 stops the focus lens 54B when the main exposure starts. If the focus lens 54B moves during the main exposure, the movement of the focus lens 54B will cause distortion in the captured image. Once the focus lens 54B has stopped, the main exposure for the first frame of continuous shooting starts.

[0190] While the main exposure for the first frame of continuous shooting is being performed, the processor 76 predicts the in-focus position of the focus lens 54B with respect to the focus target area at the timing when the main exposure for the second frame of continuous shooting is being performed, based on the latest in-focus position obtained by performing AF calculation. Live View shooting periodThis is done based on the multiple focus positions obtained by the latest multiple AF calculations and the elapsed time from the completion of the prediction of the first frame of continuous shooting to the current time.

[0191] When the main exposure for the first frame of continuous shooting is completed, reading of the digital image data 84 for the first frame of continuous shooting begins. Here, reading of the digital image data 84 refers to the process from storing the digital image data for the first frame of continuous shooting in the image memory 62 to reading the digital image data 84 from the image memory 62 by the processor 76 and storing it in a predetermined storage area (here, NVM 78 as an example).

[0192] When the main exposure for the first frame of continuous shooting is completed, the processor 76 calculates the subject distance based on the phase difference image data obtained by the main exposure, and performs AF calculation based on the calculated subject distance. Then, based on the latest focus position obtained by performing AF calculation, the processor 76 predicts the focus position of the focus lens 54B with respect to the focus target area at the timing when the main exposure for the second frame of continuous shooting is performed.

[0193] Furthermore, when the main exposure of the first frame of continuous shooting is completed, focus lens 54B starts moving toward the predicted in-focus position. When readout of the digital image data is completed, live view imaging for three frames is performed, and an image represented by the non-phase contrast image data obtained thereby is displayed as a live view image on display 30. Note that although live view imaging for three frames is illustrated here, this is merely one example, and live view imaging for one or two frames, or live view imaging for four or more frames may also be performed, and live view imaging is performed for the number of frames determined according to the frame rate of live view imaging.

[0194] Furthermore, each time live view imaging is performed, AF calculation is performed by processor 76 based on the phase difference image data obtained by performing live view imaging. Then, each time AF calculation is performed, processor 76 predicts the in-focus position of focus lens 54B with respect to the focus target area at the timing when main exposure of the next frame in continuous shooting is performed, based on the multiple in-focus positions obtained from the latest multiple AF calculations.

[0195] Meanwhile, even while live view imaging for three frames is being performed, focus lens 54B continues to move toward the in-focus position predicted during the main exposure for the first frame of continuous shooting. In other words, processor 76 utilizes the time while live view imaging for three frames is being performed to continue moving focus lens 54B toward the latest predicted in-focus position.

[0196] When the live view imaging of the third frame is completed, the processor 76 controls the actuator 58 via the control device 56 to move the focus lens 54B along the optical axis OA toward the latest focusing position predicted as the live view imaging of the third frame is performed.

[0197] For each frame from the second frame onwards in the continuous shooting, the same processing as that for the first frame in the continuous shooting after the timing to start continuous shooting arrives is repeated until the release button 24 is released from the fully pressed state.

[0198] Generally, the main exposure for continuous shooting is performed at regular intervals. For example, the main exposure is performed once for each of a plurality of consecutive frame periods, and live view imaging is performed for several frames (three frames in the example shown in FIG. 31) after the main exposure within each frame period.

[0199] However, when the frame period is fixed, it may not be possible to move focus lens 54B to the predicted latest in-focus position by the time the main exposure for the next frame period begins, because the predicted latest in-focus position is too far from the current in-focus position when the final live view image capture within the frame period is performed.

[0200] If focusing is prioritized over the release interval for continuous shooting (i.e., the time interval between main exposures for continuous shooting), the frame period can be extended without limit to allow focus lens 54B to reach the predicted latest in-focus position. However, doing so naturally results in fewer frames per unit time obtained by continuous shooting than if the release interval for continuous shooting were prioritized.

[0201] In view of these circumstances, the imaging device 10 according to the fourth embodiment is configured so that continuous shooting control processing (see FIGS. 32 to 38C) is performed by the processor 76. As an example, as shown in FIG. 32, a continuous shooting control processing program 118 is stored in the NVM 78. The processor 76 reads the continuous shooting control processing program 118 from the NVM 78 and executes the read continuous shooting control processing program 118 on the RAM 80. The processor 76 performs continuous shooting control processing by operating as a focus position calculation unit 76K, a focus position prediction unit 76L, and a control unit 76M in accordance with the continuous shooting control processing program 118 executed on the RAM 80.

[0202] The processes performed by the focus position calculation unit 76K and the focus position prediction unit 76L are examples of a "first calculation step," a "second calculation step," and a "selection step" according to the technology of the present disclosure. The processes performed by the control unit 76M are examples of a "first movement step" and an "imaging step" according to the technology of the present disclosure.

[0203] 33 , the control unit 76M controls the image sensor 50 to perform various types of imaging, such as live view imaging and continuous shooting, via the photoelectric conversion element driver 70. By performing imaging in this manner, digital image data 84 is stored in the image memory 62. The control unit 76M acquires non-phase contrast image data included in the digital image data 84 from the image memory 62 as live view image data. The control unit 76M causes the display 30 to display an image indicated by the live view image data as a live view image.

[0204] During the period from the live view imaging period until the timing to start continuous shooting arrives, the focus position calculation unit 76K acquires the latest phase difference image data from the image memory 62 and calculates the subject distance related to the focusing target area based on the acquired phase difference image data. Then, the focus position calculation unit 76K performs AF calculation based on the calculated subject distance to calculate the current focusing position of the focus lens 54B with respect to the focusing target area (hereinafter referred to as the "current focusing position").

[0205] The RAM 80 stores focus position time series information. The focus position time series information is information indicating the time series of the current focus position obtained each time an AF calculation is performed. The time series of the current focus position is, for example, the time series of the current focus position obtained by the most recent three AF ​​calculations. The focus position calculation unit 76K updates the focus position time series information by storing the latest calculated current focus position in the RAM 80 each time the current focus position is calculated. Here, the time series of the current focus position is illustrated as the time series of the current focus position obtained by the most recent three AF ​​calculations, but this is merely an example. The time series of the current focus position may be any time series of the current focus position obtained by multiple past AF calculations, and it is even better if the multiple past AF calculations are multiple AF calculations performed close to the current time.

[0206] Before continuous shooting is started by image sensor 50, focus position prediction unit 76L predicts the focus position of focus lens 54B with respect to the focus target area of ​​the first frame of continuous shooting. Furthermore, after continuous shooting is started by image sensor 50, focus position prediction unit 76L predicts the focus position of focus lens 54B with respect to the focus target area of ​​a subsequent frame (e.g., the next frame) for each frame of continuous shooting. Specifically, focus position prediction unit 76L acquires focus position time-series information from RAM 80, and predicts the focus position of focus lens 54B with respect to the focus target area of ​​a subsequent frame (e.g., the next frame) based on the acquired focus position time-series information (hereinafter also referred to as the "subsequent frame focus position").

[0207] The control unit 76M controls the movement of the focus lens. The control unit 76M generates a lens control signal that instructs the focus lens 54B to move to the focus position predicted by the focus position prediction unit 76L or that instructs the focus lens 54B to stop moving, and outputs the signal to the control device 56. In the example shown in FIG. 33, the focus position prediction unit 76L predicts the focus position for the subsequent frame, so the lens control signal that is generated and output by the control unit 76M is a signal that instructs the focus lens 54B to move to the focus position for the subsequent frame predicted by the focus position prediction unit 76L. The control device 56 operates the actuator 58 in response to the lens control signal input from the control unit 76M, thereby moving the focus lens 54B along the optical axis OA toward the focus position for the subsequent frame.

[0208] 34, the control unit 76M calculates a focus movement amount based on the current focus position calculated by the focus position calculation unit 76K and the focus position of the subsequent frame predicted by the focus position prediction unit 76L. The focus movement amount is the amount of movement of the focus lens 54B along the optical axis OA. The focus movement amount corresponds to the amount of blur of the image captured by the image sensor 50.

[0209] The control unit 76M determines whether the focus movement amount exceeds a first reference value. The first reference value is an example of a "threshold value" according to the technology of the present disclosure. For example, the first reference value corresponds to the amount of blur at which back focus may occur. Focus movement amount This is a value determined in advance as . When the focus movement amount exceeds the first reference value, the control unit 76M outputs a lens control signal to the control device 56 to stop the focus lens 54B for a certain period of time. The reason for stopping the focus lens 54B for a certain period of time is to wait for a change in the subject's situation. Depending on the change in the subject's situation, it is possible to escape from the state in which back focus occurs.

[0210] On the condition that the focus lens 54B has stopped for a certain period of time, the focus position calculation unit 76K calculates the subject distance and calculates the current focus position based on the calculated subject distance. The focus position calculation unit 76K also updates the focus position time-series information using the current focus position. The focus position prediction unit 76L then predicts the focus position of the subsequent frame using the focus position time-series information.

[0211] When the latest focus movement amount is equal to or less than a first reference value, the control unit 76M determines whether the focus movement amount exceeds a second reference value. The second reference value is a value smaller than the first reference value. The second reference value may be a fixed value determined in advance based on the frame rate of continuous shooting, the movement speed of the focus lens 54B, and the like, or may be a variable value that is changed according to instructions given by a user or the like. When the focus movement amount exceeds the second reference value, the control unit 76M outputs a lens control signal to the control device 56 to move the focus lens 54B along the optical axis OA within a limited range. On the other hand, when the focus movement amount is equal to or less than the second reference value, the control unit 76M outputs a lens control signal to the control device 56 to move the focus lens 54B along the optical axis OA to a focus position for the subsequent frame.

[0212] If the focus lens 54B is moved along the optical axis OA using a focus movement amount that exceeds the second reference value, the focus lens 54B may fall outside the limited range or may deviate from the focus position of the subsequent frame. Therefore, when the focus lens 54B is moved along the optical axis OA within the limited range, the focus movement amount is adjusted so that the focus lens 54B does not fall outside the limited range or deviate from the focus position of the subsequent frame. As an example, as shown in FIG. 35 , when the focus lens 54B is moved along the optical axis OA within the limited range, the control unit 76M obtains a coefficient from function 120 and adjusts the focus movement amount by multiplying the obtained coefficient by the focus movement amount. Function 120 defines the correlation between the amount of blur and the coefficient. The coefficient is a value less than 1, and the amount of blur decreases linearly as the amount of blur increases, and remains constant above a certain value.

[0213] After adjusting the focus movement amount, the control unit 76M outputs a lens control signal to the control device 56, thereby moving the focus lens 54B along the optical axis OA by the adjusted focus movement amount.

[0214] As an example, as shown in FIG. 36, in continuous shooting mode, a release priority range, a focusing priority range, and a standby priority range are defined as ranges of focus movement amounts. The release priority range is a range in which continuous shooting at a predetermined time interval (for example, a time defined according to the default frame rate for continuous shooting) is prioritized. The focusing priority range is a range in which focusing is prioritized even if continuous shooting at the predetermined time interval is not possible. The standby priority range is a range in which standby of the focus lens 54B is prioritized. In the imaging device 10, when continuous shooting is performed, the processor 76 performs the processes shown in FIGS. 34 and 35, thereby moving the focus lens 54B along the optical axis OA in the release priority range, focusing priority range, or standby priority range.

[0215] The release priority range is roughly divided into a range with a small focus movement amount and a range with a large focus movement amount. When moving the focus lens 54B in the release priority range, the control unit 76M adjusts the focus movement amount using the coefficient of the linearly decreasing range in the function 120 (see FIG. 35) according to the amount of blur, and moves the focus lens 54B along the optical axis OA by the adjusted focus movement amount. In the range of the release priority range with a small focus movement amount, the control unit 76M moves the focus lens 54B to the in-focus position of the subsequent frame within a predetermined time. In the range of the release priority range with a large focus movement amount, the control unit 76M moves the focus lens 54B to the in-focus position of the subsequent frame within a predetermined time. Frame Move as far as possible towards the in-focus position.

[0216] When control unit 76M moves focus lens 54B within the focusing priority range, it adjusts the focus movement amount using a fixed coefficient in function 120 within a range in which the amount of blur is equal to or greater than a fixed value, and moves focus lens 54B along optical axis OA by the adjusted focus movement amount. Within the focusing priority range, control unit 76M moves focus lens 54B to the in-focus position for the subsequent frame beyond the preset time (i.e., ignoring the preset time).

[0217] In the standby priority range, the amount of blur is large and back focus is expected, so control unit 76M stops focus lens 54B for a certain period of time to wait for the subject situation to change (i.e., to wait for the subject situation to change so that back focus does not occur).

[0218] Fig. 37 shows an example of the flow of continuous shooting processing when continuous shooting control processing is executed by processor 76. The live view imaging period and the continuous shooting period up to the first frame shown in Fig. 37 are the same as the live view imaging period and the first frame shown in Fig. 31. In the example shown in Fig. 37, in the second frame of continuous shooting, during the main exposure period, processor 76 predicts the focus position of the subsequent frame based on the focus position time-series information. Then, when the main exposure for the second frame of continuous shooting is completed, processor 76 moves focus lens 54B toward the predicted latest focus position of the subsequent frame.

[0219] When reading of the digital image data 84 obtained by the main exposure is completed, the processor 76 calculates the subject distance based on the phase difference image data included in the latest digital image data 84, and performs AF calculation based on the calculated subject distance. The processor 76 updates the focus position time-series information using the current focus position obtained by performing the AF calculation. The processor 76 then predicts the focus position of the subsequent frame based on the latest focus position time-series information, and continues moving the focus lens 54B toward the predicted latest focus position of the subsequent frame.

[0220] Thereafter, for the second frame of the continuous shooting, live view imaging is performed for a predetermined number of frames (e.g., three frames). Processor 76 calculates the subject distance based on phase difference image data included in the latest digital image data 84 obtained each time live view imaging is performed, and performs AF calculation based on the calculated subject distance. Processor 76 updates the focus position time-series information using the current focus position obtained by performing AF calculation. Processor 76 then predicts the focus position of the subsequent frame based on the latest focus position time-series information, and calculates the focus movement amount from the predicted focus position of the latest subsequent frame and the current focus position.

[0221] Here, the processor 76 controls the movement of the focus lens 54B within the release priority range, the focusing priority range, or the standby priority range by executing the processes shown in FIGS. 34 and 35 using the latest focus movement amount obtained after live view imaging for the preset number of frames has ended. If the focus lens 54B is moved within the release priority range, the second frame of continuous shooting will be completed within the preset time. If the focus lens 54B is moved within the focusing priority range, movement of the focus lens 54B toward the in-focus position for the subsequent frame will continue, and live view imaging will also continue. In the example shown in FIG. 37, live view imaging is not continued for the first frame of continuous shooting, but is continued for the second frame of continuous shooting. As a result, the number of frames in the live view image for the first frame of continuous shooting is "3," while the number of frames in the second frame of continuous shooting is "1." eye The number of frames in the live view image is set to "7".

[0222] Next, an example of the flow of continuous shooting control processing performed by the processor 76 of the imaging device 10 according to the fourth embodiment will be described with reference to the flowcharts shown in FIGS. 38A to 38D.

[0223] 38A, in step ST200, the control unit 76M determines whether or not the live view imaging timing has arrived. If the live view imaging timing has not arrived in step ST200, the determination is negative, and the continuous shooting control processing proceeds to step ST212. If the live view imaging timing has arrived in step ST200, the determination is positive, and the continuous shooting control processing proceeds to step ST202.

[0224] In step ST202, the control unit 76M causes the image sensor 50 to perform live view imaging. After the processing of step ST202 is executed, the continuous shooting control processing proceeds to step ST204.

[0225] In step ST204, the focus position calculation unit 76K calculates the subject distance based on the phase difference image data included in the digital image data 84 obtained by performing the live view imaging in step ST202. The subject distance calculated in step ST204 is an example of the "first distance, which is the distance of the first subject included in the first frame data of the first frame period" according to the technology of the present disclosure. The processing of step ST204 is also an example of the "first calculation step" according to the technology of the present disclosure. After the processing of step ST204 is executed, the continuous shooting control processing proceeds to step ST206.

[0226] In step ST206, the in-focus position calculation unit 76K updates the in-focus position time-series information by calculating the current in-focus position based on the subject distance calculated in step ST204 and storing the calculated current in-focus position in RAM 80. After the processing of step ST206 is executed, the continuous shooting control processing proceeds to step ST208.

[0227] In step ST208, the focus position predicting section 76L predicts the focus position of the subsequent frame based on the focus position time-series information. After the process of step ST208 is executed, the continuous shooting control process proceeds to step ST210.

[0228] In step ST210, the control unit 76M moves the focus lens 54B toward the subsequent frame in-focus position predicted in step ST208. The process of step ST210 is an example of a "first movement step" according to the technique of the present disclosure. After the process of step ST210 is executed, the continuous shooting control process proceeds to step ST212.

[0229] In step ST212, the control unit 76M determines whether or not the timing to start continuous shooting has arrived. If the timing to start continuous shooting has not arrived in step ST212, the determination is negative, and the continuous shooting control process proceeds to step ST200. If the timing to start continuous shooting has arrived in step ST212, the determination is positive, and the continuous shooting control process proceeds to step ST214.

[0230] The period from when the process of step ST200 is executed until the determination of step ST212 is affirmative is an example of a "first frame period" according to the technology of the present disclosure. Also, the digital image data 84 obtained by performing live view imaging in step ST202 is an example of "first frame data" according to the technology of the present disclosure.

[0231] In step ST214, the control unit 76M stops the focus lens 54B. After the process of step ST214 is executed, the continuous shooting control process proceeds to step ST216.

[0232] In step ST216, the control unit 76M starts the main exposure for the image sensor 50. After the process of step ST216 is executed, the continuous shooting control process proceeds to step ST218.

[0233] In step ST218, the focus position prediction section 76L acquires the focus position time-series information from the RAM 80. After the process of step ST218 is executed, the continuous shooting control process proceeds to step ST220.

[0234] In step ST220, the focus position predicting section 76L predicts the focus position of the subsequent frame based on the focus position time-series information acquired in step ST218. After the process of step ST220 is executed, the continuous shooting control process proceeds to step ST222.

[0235] In step ST222, the control unit 76M determines whether or not the main exposure has ended. If the main exposure has not ended in step ST222, the determination is negative, and the determination of step ST222 is made again. If the main exposure has ended in step ST222, the determination is positive, and the continuous shooting control process proceeds to step ST224.

[0236] In step ST224, the control unit 76M reads out the digital image data 84 from the image sensor 50 and stores it in the image memory 62. After the process of step ST224 is executed, the continuous shooting control process proceeds to step ST226.

[0237] In step ST226, the control unit 76M starts moving the focus lens 54B toward the subsequent frame in-focus position predicted in step ST220. After the process of step ST226 is executed, the continuous shooting control process proceeds to step ST228 shown in FIG. 38B.

[0238] In step ST228, the control unit 76M determines whether or not the timing for live view imaging has arrived. If the timing for live view imaging has not arrived in step ST228, the determination is negative, and the determination of step ST228 is made again. If the timing for live view imaging has arrived in step ST228, the determination is positive, and the continuous shooting control processing proceeds to step ST230.

[0239] In step ST230, the control unit 76M causes the image sensor 50 to perform live view imaging. After the processing of step ST230 is executed, the continuous shooting control processing proceeds to step ST232.

[0240] In step ST232, the in-focus position calculation unit 76K calculates the subject distance based on the phase difference image data included in the digital image data 84 obtained by performing the live view imaging in step ST230. After the processing of step ST232 is executed, the continuous shooting control processing proceeds to step ST234.

[0241] In step ST234, the in-focus position calculation unit 76K updates the in-focus position time-series information by calculating the current in-focus position based on the subject distance calculated in step ST232 and storing the calculated current in-focus position in RAM 80. After the processing of step ST234 is executed, the continuous shooting control processing proceeds to step ST236.

[0242] In step ST236, the in-focus position prediction section 76L acquires the in-focus position time-series information from the RAM 80. After the process of step ST236 is executed, the continuous shooting control process proceeds to step ST238.

[0243] In step ST238, the focus position predicting section 76L predicts the focus position of the subsequent frame based on the focus position time-series information acquired in step ST236. After the process of step ST238 is executed, the continuous shooting control process proceeds to step ST240.

[0244] In step ST240, the control unit 76M determines whether or not a condition for ending live view imaging (hereinafter referred to as a "live view imaging end condition") has been satisfied. One example of the live view imaging end condition is a condition in which live view imaging has been performed for a predetermined number of frames. If the live view imaging end condition has not been satisfied in step ST240, the determination is negative, and the continuous shooting control processing proceeds to step ST228. If the live view imaging end condition has been satisfied in step ST240, the determination is positive, and the continuous shooting control processing proceeds to step ST242 shown in FIG. 38C.

[0245] In step ST242 shown in FIG. 38C, the control unit 76M determines whether the timing for starting the main exposure (hereinafter referred to as the "main exposure timing") has been met. An example of the main exposure timing is the timing when the reset of the photoelectric conversion element 52 is completed. If the main exposure timing has not been met in step ST242, the determination is negative, and the determination of step ST242 is made again. If the main exposure timing has been met in step ST242, the determination is positive, and the continuous shooting control process proceeds to step ST244.

[0246] In step ST244, control unit 76M stops focus lens 54B. The position of focus lens 54B stopped by first executing the process of step ST244 is an example of the "first position" according to the technique of the present disclosure. After executing the process of step ST244, the continuous shooting control process proceeds to step ST246.

[0247] In step ST246, the control unit 76M starts the main exposure for the image sensor 50. After the process of step ST246 is executed, the continuous shooting control process proceeds to step ST248.

[0248] In step ST248, the in-focus position prediction section 76L acquires the in-focus position time-series information from the RAM 80. After the process of step ST248 is executed, the continuous shooting control process proceeds to step ST250.

[0249] In step ST250, the focus position predicting unit 76L predicts the focus position of the subsequent frame based on the focus position time-series information acquired in step ST248. After the process of step ST250 is executed, the continuous shooting control process proceeds to step ST252.

[0250] In step ST252, the control unit 76M determines whether or not the main exposure has ended. If the main exposure has not ended in step ST252, the determination is negative, and the determination of step ST252 is made again. If the main exposure has ended in step ST252, the determination is positive, and the continuous shooting control process proceeds to step ST254.

[0251] In step ST254, the control unit 76M reads out the digital image data 84 from the image sensor 50 and stores it in the image memory 62. After the process of step ST254 is executed, the continuous shooting control process proceeds to step ST256.

[0252] In step ST256, the control unit 76M determines whether or not the live view imaging timing has arrived. If the live view imaging timing has not arrived in step ST256, the determination is negative, and the determination of step ST256 is made again. If the live view imaging timing has arrived in step ST256, the determination is positive, and the continuous shooting control processing proceeds to step ST258.

[0253] In step ST258, the control unit 76M causes the image sensor 50 to perform live view imaging. After the processing of step ST258 is executed, the continuous shooting control processing proceeds to step ST260.

[0254] In step ST260, the focus position calculation unit 76K calculates the subject distance based on the phase difference image data included in the digital image data 84 obtained by performing the live view imaging in step ST258. The subject distance calculated in step ST260 is an example of the "second distance, which is the distance to the second subject included in the second frame data of the second frame period after the first frame period" according to the technology of the present disclosure. The processing of step ST260 is also an example of the "second calculation step" according to the technology of the present disclosure. After the processing of step ST260 is executed, the continuous shooting control processing proceeds to step ST262.

[0255] In step ST262, the in-focus position calculation unit 76K updates the in-focus position time-series information by calculating the current in-focus position based on the subject distance calculated in step ST260 and storing the calculated current in-focus position in RAM 80. After the processing of step ST262 is executed, the continuous shooting control processing proceeds to step ST264.

[0256] In step ST264, the in-focus position predicting section 76L acquires the in-focus position time-series information from the RAM 80. After the process of step ST264 is executed, the continuous shooting control process proceeds to step ST266.

[0257] In step ST266, the focus position predicting section 76L predicts the focus position of the subsequent frame based on the focus position time-series information acquired in step ST264. After the process of step ST266 is executed, the continuous shooting control process proceeds to step ST268.

[0258] In step ST268, the control unit 76M determines whether or not the live view imaging end condition is satisfied. If the live view imaging end condition is not satisfied in step ST268, the determination is negative, and the continuous shooting control processing proceeds to step ST256. If the live view imaging end condition is satisfied in step ST268, the determination is positive, and the continuous shooting control processing proceeds to step ST270 shown in FIG. 38D.

[0259] In step ST270 shown in Fig. 38D, the control unit 76M calculates the focus movement amount based on the current in-focus position and the in-focus position of the subsequent frame predicted in step ST266. The focus movement amount calculated in step ST270 is an example of the "movement amount" according to the technique of the present disclosure. After the processing of step ST270 is executed, the continuous shooting control processing proceeds to step ST272.

[0260] In step ST272, the control unit 76M determines whether the focus movement amount calculated in step ST270 or ST284 exceeds the first reference value. If the focus movement amount calculated in step ST270 or ST284 does not exceed the first reference value in step ST270, the determination is negative, and the continuous shooting control process proceeds to step ST286. If the focus movement amount calculated in step ST270 or ST284 exceeds the first reference value in step ST272, the determination is positive, and the continuous shooting control process proceeds to step ST274.

[0261] In step ST274, the control unit 76M stops the focus lens 54B for a certain period of time. After the process of step ST274 is executed, the continuous shooting control process proceeds to step ST276.

[0262] In step ST276, the control unit 76M causes the image sensor 50 to perform live view imaging. Then, the focus position calculation unit 76K calculates the subject distance based on the phase difference image data included in the digital image data 84 obtained by performing live view imaging. After the processing of step ST276 is executed, the continuous shooting control processing proceeds to step ST278.

[0263] In step ST278, the in-focus position calculation unit 76K updates the in-focus position time-series information by calculating the current in-focus position based on the subject distance calculated in step ST276 and storing the calculated current in-focus position in RAM 80. After the processing of step ST278 is executed, the continuous shooting control processing proceeds to step ST280.

[0264] In step ST280, the focus position prediction section 76L acquires the focus position time-series information from the RAM 80. After the process of step ST280 is executed, the continuous shooting control process proceeds to step ST282.

[0265] In step ST282, the focus position predicting section 76L predicts the focus position of the subsequent frame based on the focus position time-series information acquired in step ST280. After the process of step ST282 is executed, the continuous shooting control process proceeds to step ST284.

[0266] In step ST284, the control unit 76M calculates the focus movement amount based on the current in-focus position and the in-focus position of the subsequent frame predicted in step ST282. The focus movement amount calculated in step ST284 is an example of the "movement amount" according to the technique of the present disclosure. After the processing of step ST284 is executed, the continuous shooting control processing proceeds to step ST272.

[0267] In step ST286, it is determined whether the focus movement amount calculated in step ST270 or ST284 exceeds the second reference value. If the focus movement amount calculated in step ST270 or ST284 exceeds the second reference value in step ST286, the determination is affirmative, and the continuous shooting control process proceeds to step ST288. If the focus movement amount calculated in step ST270 or ST284 does not exceed the second reference value in step ST286, the determination is negative, and the continuous shooting control process proceeds to step ST290.

[0268] In step ST288, the control unit 76M starts moving the focus lens 54B within the limited range. That is, the control unit 76M starts moving the focus lens 54B within a predetermined time to the focus position for the subsequent frame predicted in step ST266 or ST282. Here, the focus movement amount used in moving the focus lens 54B is the focus movement amount adjusted by a coefficient obtained from function 120 according to the amount of blur. By performing the process of step ST288, the focus lens 54B does not reach the focus position for the subsequent frame predicted in step ST266 or ST282, but reaches a position closer to the focus position for the subsequent frame predicted in step ST266 or ST282 than the position of the focus lens 54B where it stopped in step ST244. The position to which the focus lens 54B moves by performing the process of step ST288 (for example, the position of the focus lens 54B where it stopped in step ST244 shown in FIG. 38C) is an example of the "third position" according to the technology of the present disclosure. After the process of step ST288 is executed, the continuous shooting control process proceeds to step ST292.

[0269] In step ST290, the control unit 76M starts moving the focus lens 54B to the focus position for the subsequent frame predicted in step ST266 or ST282. Here, the focus movement amount used in moving the focus lens 54B is the focus movement amount adjusted by a coefficient obtained from function 120 according to the amount of blur. By executing the process of step ST290, the focus lens 54B reaches the focus position for the subsequent frame predicted in step ST266 or ST282. The position to which the focus lens 54B moves by executing the process of step ST290 (for example, the position of the focus lens 54B stopped in step ST244 shown in FIG. 38C) is an example of the "second position" according to the technique of the present disclosure. After executing the process of step ST290, the continuous shooting control process proceeds to step ST292.

[0270] In the continuous shooting control process, the position to which the focus lens 54B is to be moved is selected by executing the process of step ST270 or the process of step ST284 and the process of step ST286. The process of step ST270, the process of step ST284, and the process of step ST286 are examples of a "selection process" according to the technology of the present disclosure. Furthermore, the process of step ST288, the process of step ST290, and the process of step ST246 are examples of an "imaging process" according to the technology of the present disclosure.

[0271] In step ST292, control unit 76M determines whether or not a condition for ending the continuous shooting control process (hereinafter referred to as a "continuous shooting control process ending condition") has been satisfied. One example of a continuous shooting control process ending condition is that the continuous shooting mode has been released. If the continuous shooting control process ending condition has not been satisfied in step ST292, the determination is negative, and the continuous shooting control process proceeds to step ST242 shown in FIG. 38C. If the continuous shooting control process ending condition has been satisfied in step ST292, the determination is positive, and the continuous shooting control process ends.

[0272] As described above, in imaging device 10 according to the fourth embodiment, the subject distance is calculated based on digital image data 84 obtained by live view imaging during the live view imaging period, which is the preceding stage of the continuous shooting period (see step ST204). Then, during the continuous shooting period, focus lens 54B is moved toward the subsequent frame in-focus position (see step ST220) predicted based on the subject distance calculated during the live view imaging period. If the frame interval for continuous shooting is determined based on a time interval that prioritizes release, the main exposure may begin before focus lens 54B reaches the subsequent frame in-focus position, resulting in a blurred image. On the other hand, if the frame interval for continuous shooting is ignored and focusing is prioritized, an image with less blur will be obtained, but the number of frames obtained by continuous shooting will be reduced.

[0273] Therefore, in imaging device 10 according to the fourth embodiment, for example, the subject distance is calculated based on digital image data 84 obtained by live view imaging of the second frame of continuous shooting, and the focus movement amount is calculated based on the calculated subject distance. Then, depending on whether the focus movement amount exceeds a second reference value, it is selected whether to cause focus lens 54B to reach the predicted focus position of the subsequent frame or to bring focus lens 54B as close as possible to the predicted focus position of the subsequent frame.

[0274] For example, if the focus movement amount exceeds the second reference value, it is determined that the focus lens 54B cannot reach the predicted focus position for the subsequent frame within the predetermined time. In this case, the option of bringing the focus lens 54B as close as possible to the focus position for the subsequent frame is selected (see step ST288). If the focus movement amount is equal to or less than the second reference value, it is determined that the focus lens 54B can reach the predicted focus position for the subsequent frame within the predetermined time. In this case, the option of bringing the focus lens 54B to the predicted focus position for the subsequent frame is selected (see step ST290).

[0275] If the main exposure is performed after the focus lens 54B has reached the predicted focus position for the subsequent frame, the main exposure can be performed in a focused state without increasing the release interval. Furthermore, if the main exposure is performed after the lens is brought as close as possible to the predicted focus position for the subsequent frame, the frame interval for continuous shooting does not increase too much, and the main exposure can be performed in a state close to the focused state. Therefore, a good balance can be achieved between release and focusing. As a result, for example, in continuous shooting mode, images with little blur can be obtained without excessively slowing down the continuous shooting speed.

[0276] Furthermore, in the imaging device 10 according to the fourth embodiment, if the calculated focus movement amount is too large, it becomes difficult to focus within the predetermined time. Therefore, if the focus movement amount exceeds the first reference value, the focus lens 54B is stopped for a certain period of time. If the subject's condition changes during this period, it is expected that the newly calculated focus movement amount will become smaller. If the focus movement amount is reduced, it is possible to achieve a main exposure in a state where the subject is in focus within the predetermined time, or a state close to the state where the subject is in focus within the predetermined time.

[0277] Although the fourth embodiment has been described above with reference to the continuous shooting mode, the technology disclosed herein is not limited to this. For example, the technology disclosed in the fourth embodiment can be applied to image capture performed to continuously capture multiple frames, such as image capture performed to capture moving images for recording.

[0278] Furthermore, in the above-described embodiments, various programs are stored in the NVM 78. However, the technology of the present disclosure is not limited to this. For example, the various programs may be stored in a portable, computer-readable, non-transitory storage medium such as an SSD (Solid State Drive) or a USB memory. The various programs stored in the non-transitory storage medium are installed in the imaging device 10. The processor 76 executes the various processes described in the above-described embodiments in accordance with the various programs.

[0279] In addition, various programs may be stored in a storage device such as another computer or server device connected to the imaging device 10 via a network, and the various programs may be downloaded and installed in the imaging device 10 in response to a request from the imaging device 10.

[0280] It is not necessary to store all of the various programs in a storage device such as another computer or server device connected to the imaging device 10, or in the NVM 78; only some of the various programs may be stored therein.

[0281] Furthermore, although the imaging device 10 shown in FIG. 3 has a built-in controller 60, the technology of the present disclosure is not limited to this. For example, the controller 60 may be provided outside the imaging device 10.

[0282] In the above embodiments, the technology of the present disclosure has been described by way of example in which it is realized by a software configuration, but the technology of the present disclosure is not limited to this and may be applied to devices including ASIC, FPGA, or PLD. Also, a combination of a hardware configuration and a software configuration may be used.

[0283] The hardware resources for executing the various processes described in the above embodiments can be various processors, as follows: Examples of processors include a CPU, which is a general-purpose processor that functions as a hardware resource for executing various processes by executing software, i.e., a program. Examples of processors include dedicated electronic circuits, such as FPGAs, PLDs, or ASICs, which are processors with a circuit configuration designed specifically for executing specific processes. Each processor has built-in or connected memory, and each processor uses the memory to execute various processes.

[0284] The hardware resources that execute various processes may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resources that execute various processes may be a single processor.

[0285] As an example of a system configured with one processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes various processes. Second, there is a system that uses a processor that realizes the functions of the entire system, including multiple hardware resources that execute various processes, on a single IC (Integrated Circuit) chip, as typified by SoC (System-on-a-chip). In this way, various processes are realized using one or more of the above-mentioned various processors as hardware resources.

[0286] Furthermore, the hardware structure of these various processors can be, more specifically, electronic circuits that combine circuit elements such as semiconductor devices. The various processes described above are merely examples. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the order of processes may be rearranged, without departing from the spirit of the invention.

[0287] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[0288] In this specification, the grammatical concept of "A or B" includes not only the concept of "either one of A or B," but also a concept synonymous with "at least one of A and B." In other words, "A or B" includes the meaning that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A or B" is also applied when three or more things are expressed by connecting them with "or."

[0289] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference. [Explanation of symbols]

[0290] 10. Imaging device 12 Imaging target area 14 People 16 Road 18 Imaging device body 20 Interchangeable Lenses 22 Dial 24 Release button 26 Touch Panel Display 28 Instruction keys 30 Display 30A screen 30A1 short side 30A2 long side 30B central part 32 Touch Panel 34 Live View images 36,41 AF frame 38,39 area 40 Up and down direction 42 Central area 43, 43A~43X, 44, 44A~44H Surrounding area 46 First Subject 48,48A~48H 2nd subject 50 Image Sensor 52 Photoelectric conversion element 52A imaging surface 54 Imaging lens 54A objective lens 54B Focus Lens 56 Control device 58 Actuator 60 Controller 62 Image Memory 64 UI devices 66 External I / F 70 Photoelectric conversion element driver 72 Input / Output Interface 74 Signal Processing Circuit 76 processors 76A First imaging control unit 76B 1st calculation part 76C 1st Specific Part 76D First Selection Section 76E Display control unit 76F Second imaging control unit 76G Second Selection Section 76H 2nd calculation part 76I Second Specific Part 76J Third Selection Section 76K Focus position calculation section 76L Focus position prediction unit 76M Control Unit 78 NVM 80 RAM 82 Bus 84 Digital Image Data 86 Reception Device 88 Hard key section 90,100,106 Image processing program 92 1st specific area 94 1st focus subject 96 1st focus subject information 98 Birds 102 Second focus subject 104 2nd focus subject information 108 Second specific area 110 3rd focus subject 112 3rd focus subject information 114 4th focused subject 116 4th focused subject information 118 Continuous shooting control processing program 120 Functions OA optical axis

Claims

1. a first imaging step of imaging a subject included in a plurality of candidate areas including a first area and a plurality of second areas; a first calculation step of calculating a first distance that is a distance to a first object in the first region and a plurality of second distances that are distances to a plurality of second objects in the plurality of second regions; a first identification step of identifying a first identified area from among a plurality of second distances, the first identified area corresponding to the second distance that satisfies a first condition; a first selection step of selecting a first focused subject to be focused from the first subject and the second subject within the first specific region based on a first ratio that is a ratio of the first specific region to the plurality of second regions, the first condition is a condition that the second distance is shorter than the first distance, the first region is a central region; the second region is a peripheral region, the first ratio is a value corresponding to the number of the first specific regions, The first selection step is a step of selecting the second object as the first focused object when the value exceeds a threshold value. How to select.

2. The threshold value corresponds to the number of the peripheral regions located below the central region in a vertical direction that is fixed in advance for the plurality of candidate regions. The selection method according to claim 1 .

3. The first selection step is a step of selecting the first object as the first focused object when the plurality of second distances are longer than the first distance. The selection method according to claim 1 or 2.

4. a second imaging step of imaging the first subject and the plurality of second subjects after the first imaging step; a second selection step of selecting, from the first subject and the plurality of second subjects imaged in the second imaging step, a subject that is close to the first focused subject as a second focused subject to be focused. The selection method according to any one of claims 1 to 3.

5. The second selection step is a step of selecting, as the second focused subject, a subject that is close to the first focused subject within a range less than a predetermined distance from the first subject and the plurality of second subjects imaged in the second imaging step. The selection method according to claim 4.

6. the plurality of candidate regions include a plurality of third regions; the plurality of third regions include the plurality of second regions, a second calculation step of calculating the first distance and a plurality of third distances which are distances to a plurality of third subjects in the plurality of third regions; a second identification step of identifying a second identified area corresponding to the third distance that satisfies a second condition for the plurality of third distances; a third selection step of selecting a third focused object to be focused from the first object and the third object in the second specific area based on a second ratio that is a ratio of the second specific area to the plurality of third areas, The second condition is that the third distance is shorter than the first distance. The selection method according to any one of claims 1 to 5.

7. When the second specified region is not specified in the second specifying step, the first specifying step and the first selecting step are performed. The selection method according to claim 6.

8. If N is an odd number greater than or equal to 3, the plurality of second regions are a plurality of regions arranged in an N×N matrix, The plurality of third regions are a plurality of regions arranged in a matrix of (N+2)×(N+2). The selection method according to claim 6 or 7.

9. An image sensor; a processor, The processor: causing the image sensor to capture an image of a subject included in a plurality of candidate areas including a first area and a plurality of second areas; calculating a first distance that is a distance to a first object in the first region and a plurality of second distances that are distances to a plurality of second objects in the plurality of second regions; Identifying a first specific area corresponding to a second distance that satisfies a first condition among the plurality of second distances from the plurality of second areas; selecting a first focused subject to be focused from the first subject and the second subject within the first specific region based on a first ratio that is a ratio of the first specific region to the plurality of second regions; the first condition is a condition that the second distance is shorter than the first distance, the first region is a central region; the second region is a peripheral region, the first ratio is a value corresponding to the number of the first specific regions, The processor selects the second object as the first focused object if the value exceeds a threshold. Imaging device.

Images