Imaging apparatus

Abstract

To provide an imaging apparatus capable of easily realizing a focusing operation that tracks a subject from a desired area.SOLUTION: An imaging device (100) includes: an imaging unit (115) that captures an image of a subject formed through an optical system (110) and generates image data; and a control unit (135) for controlling the focusing operation of an optical system. The control unit is configured so as to, before detecting a subject in a focus area (61) previously arranged in the captured image indicated by the image data, control the optical system to perform a focusing operation on the basis of the arranged focus area, and after detecting the subject in the focus area in the arranged focus area, control the optical system to perform the focusing operation to track a subject far from the arranged focus area.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present disclosure relates to an imaging device that performs a focusing operation. [Background technology]

[0002] Patent Document 1 discloses an imaging device capable of adjusting the focus of an arbitrarily settable subject. The imaging device includes an imaging optical system and a color information calculation unit that calculates color information for each of a plurality of areas from an image signal. The imaging device selects at least one area based on the result of comparing preset reference color information with each piece of color information sequentially calculated by the color information calculation unit, and calculates focus information of the imaging optical system for the selected area. The reference color information is color information calculated by the color information calculation unit for a user-specified area from an image signal captured in advance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2006-72332 Summary of the Invention [Problem to be solved by the invention]

[0004] The present disclosure provides an imaging device that can easily achieve a focusing operation that tracks a subject from a desired area. [Means for solving the problem]

[0005] The imaging device according to the present disclosure includes an imaging unit that captures an image of a subject formed via an optical system and generates image data, and a control unit that controls a focusing operation by the optical system. Before detecting a subject in a focus area pre-arranged in advance in a captured image represented by the image data, the control unit causes the optical system to perform a focusing operation based on the pre-arranged focus area, and after detecting the subject in the pre-arranged focus area, causes the optical system to perform a focusing operation so as to track the subject over a range away from the pre-arranged focus area. [Effects of the Invention]

[0006] The imaging device according to the present disclosure can facilitate a focusing operation that tracks a subject from a desired area. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a diagram showing the configuration of a digital camera according to a first embodiment of the present disclosure. [Figure 2] A diagram showing an example of the AF mode setting menu display on a digital camera [Figure 3] FIG. 1 is a diagram illustrating the operation of a standby tracking mode in a digital camera. [Figure 4] 1 is a flowchart illustrating an example of an operation in a standby tracking mode in a digital camera according to a first embodiment; [Figure 5] FIG. 1 is a diagram for explaining a target subject detection process in a digital camera. [Figure 6] A diagram to explain AF tracking when the target subject is lost during image recognition in a digital camera [Figure 7] A diagram showing an example of the display of the standby AF area setting screen on a digital camera. [Figure 8] FIG. 10 is a diagram showing an example of a display of a target subject setting screen on a digital camera. [Figure 9] 10 is a flowchart illustrating an example of the operation of the standby tracking mode in the digital camera of the second embodiment. [Figure 10]FIG. 10 is a diagram for explaining an example of operation in standby tracking mode in the digital camera of the second embodiment; [Figure 11] FIG. 10 is a diagram illustrating a modified example of the setting of a target subject in a digital camera. DETAILED DESCRIPTION OF THE INVENTION

[0008] Hereinafter, embodiments will be described in detail with reference to the drawings as appropriate. However, more detailed description than necessary may be omitted. For example, detailed description of already well-known matters or redundant description of substantially identical configurations may be omitted. This is to avoid unnecessary redundancy in the following description and to facilitate understanding by those skilled in the art. Note that the inventor(s) provide the accompanying drawings and the following description to enable those skilled in the art to fully understand the present disclosure, and are not intended to limit the subject matter described in the claims.

[0009] (Embodiment 1) In the first embodiment, a digital camera will be described as an example of an imaging device according to the present disclosure.

[0010] 1. Configuration The configuration of the digital camera according to the first embodiment will be described with reference to FIG.

[0011] 1 is a diagram showing the configuration of a digital camera 100 according to this embodiment. The digital camera 100 of this embodiment includes an image sensor 115, an image processing engine 120, a display monitor 130, and a control unit 135. The digital camera 100 also includes a buffer memory 125, a card slot 140, a flash memory 145, an operation unit 150, a communication module 155, and a microphone 160. The digital camera 100 also includes, for example, an optical system 110 and a lens drive unit 112.

[0012] The optical system 110 includes a focus lens, a zoom lens, an optical image stabilization lens (OIS), an aperture, a shutter, etc. The focus lens is a lens for changing the focus state of the subject image formed on the image sensor 115. The zoom lens is a lens for changing the magnification of the subject image formed by the optical system. Each of the focus lens, etc. is composed of one or more lenses.

[0013] Lens driving unit 112 drives the focus lens and the like in optical system 110. Lens driving unit 112 includes a motor, and moves the focus lens along the optical axis of optical system 110 under the control of control unit 135. The configuration for driving the focus lens in lens driving unit 112 can be realized by a DC motor, a stepping motor, a servo motor, an ultrasonic motor, or the like.

[0014] The image sensor 115 captures an image of a subject formed via the optical system 110 and generates imaging data. The imaging data constitutes image data representing an image captured by the image sensor 115. The image sensor 115 generates new frame image data at a predetermined frame rate (e.g., 30 frames / second). The timing of generating imaging data and the electronic shutter operation in the image sensor 115 are controlled by the control unit 135. The image sensor 115 can be any of a variety of image sensors, such as a CMOS image sensor, a CCD image sensor, or an NMOS image sensor.

[0015] The image sensor 115 performs operations such as capturing still images and through images. Through images are mainly moving images, and are displayed on the display monitor 130 so that the user can determine the composition for capturing the still image. The through images and still images are each an example of a captured image in this embodiment. The image sensor 115 is an example of an imaging unit in this embodiment.

[0016] The image processing engine 120 performs various processes on the imaging data output from the image sensor 115 to generate image data, and performs various processes on the image data to generate an image to be displayed on the display monitor 130. The various processes include, but are not limited to, white balance correction, gamma correction, YC conversion processing, electronic zoom processing, compression processing, and expansion processing. The image processing engine 120 may be configured with a hardwired electronic circuit, or may be configured with a microcomputer, processor, or the like using a program.

[0017] In this embodiment, the image processing engine 120 includes an image recognition unit 122 that realizes a function for identifying subjects including people by image recognition of a captured image. The image recognition unit 122 will be described in detail later.

[0018] The display monitor 130 is an example of a display unit that displays various information. For example, the display monitor 130 displays an image (through image) represented by image data captured by the image sensor 115 and processed by the image processing engine 120. The display monitor 130 also displays a menu screen or the like that enables the user to make various settings for the digital camera 100. The display monitor 130 can be configured, for example, by a liquid crystal display device or an organic EL device. The digital camera 100 may further include a connection unit, such as an HDMI (registered trademark) terminal, for connection to an external display unit.

[0019] Operation unit 150 is a general term for hard keys such as operation buttons and operation levers provided on the exterior of digital camera 100, and is an example of an input unit that accepts operations by the user. Operation unit 150 includes, for example, a release button, a mode dial, and a touch panel. When operation unit 150 accepts an operation by the user, it transmits an operation signal corresponding to the user operation to control unit 135.

[0020] The control unit 135 controls the overall operation of the digital camera 100. The control unit 135 includes a CPU and the like, and the CPU executes a program (software) to realize predetermined functions. Instead of a CPU, the control unit 135 may include a processor configured with a dedicated electronic circuit designed to realize the predetermined functions. In other words, the control unit 135 can be realized by various processors such as a CPU, MPU, GPU, DSU, FPGA, ASIC, etc. The control unit 135 may be configured with one or more processors. Furthermore, the control unit 135 may be configured on a single semiconductor chip together with the image processing engine 120, etc.

[0021] The buffer memory 125 is a recording medium that functions as a work memory for the image processing engine 120 and the control unit 135. The buffer memory 125 is realized by a DRAM (Dynamic Random Access Memory) or the like. The flash memory 145 is a non-volatile recording medium. Although not shown, the control unit 135 may have various types of internal memory, for example, a built-in ROM. The ROM stores various programs executed by the control unit 135. The control unit 135 may also have a built-in RAM that functions as a work area for the CPU.

[0022] The card slot 140 is a means for inserting a removable memory card 142. The card slot 140 can electrically and mechanically connect the memory card 142. The memory card 142 is an external memory equipped with a recording element such as a flash memory inside. The memory card 142 can store data such as image data generated by the image processing engine 120.

[0023] The communication module 155 is a communication module (circuit) that performs communication in accordance with the communication standard IEEE802.11 or the Wi-Fi standard. The digital camera 100 can communicate with other devices via the communication module 155. The digital camera 100 may communicate with other devices directly via the communication module 155, or may communicate via an access point. The communication module 155 may be connectable to a communication network such as the Internet. The communication module 155 may also function as a connection unit that connects to an external display unit.

[0024] The microphone 160 is an example of an input unit that includes, for example, one or more microphone elements built into the digital camera 100. The microphone 160 outputs an audio signal indicating the picked-up sound to the control unit 135. The digital camera 100 may also use an external microphone. Instead of or in addition to the built-in microphone 160, the digital camera 100 may also include a connection unit such as a terminal for connecting to an external microphone.

[0025] 1-1. Image Recognition Unit The image recognition unit 122 in this embodiment will be described in detail below.

[0026] The image recognition unit 122 employs a trained model based on a neural network such as a convolutional neural network. The image recognition unit 122 receives information indicating an image captured by the image sensor 115 and executes image recognition processing using the model. The image recognition unit 122 may be configured by the image processing engine 120 and the control unit 135 working together.

[0027] The processing of the trained model in the image recognition unit 122, for example, involves outputting as output information an area (i.e., an object area) in an input image that shows an object classified into one of a plurality of preset types, in association with the type. The plurality of types indicates classifications of various object categories, such as people, animals, and vehicles. The object area is defined by horizontal and vertical coordinates on the image to be processed, for example, so as to surround the recognized object in a rectangular shape.

[0028] Various categories can be used as categories in the image recognition unit 122. For example, the above-mentioned animal category may be further classified according to the type of animal, and for example, categories such as dogs, cats, and birds may be set separately. Furthermore, the vehicle category may be classified into trains, motorcycles, and automobiles. Furthermore, the person category may be classified by individual, gender, age, nationality, and the like. Furthermore, the image recognition unit 122 may perform image recognition to identify the shooting scene of an input image by, for example, categorizing a plurality of shooting scenes into categories set in advance.

[0029] The trained model of the image recognition unit 122 as described above can be obtained, for example, by supervised learning using, as training data, image data associated with correct labels that identify images showing various types of subjects as correct answers. The trained model may generate confidence or likelihood for each type of recognition result. Furthermore, the subject region recognized by the image recognition unit 122 is not limited to a rectangular shape and may have various shapes. For example, the image recognition unit 122 may use a segmentation technique for image recognition to recognize a region that follows the outline of the subject as the subject region.

[0030] The trained model of the image recognition unit 122 is not limited to a neural network, and may be various machine learning models related to image recognition. Furthermore, the image recognition unit 122 is not limited to machine learning, and various image recognition algorithms may be employed. Furthermore, the image recognition unit 122 may be configured so that recognition of some types, such as a human face and eyes, is performed by rule-based image recognition processing. The image recognition unit 122 may be configured, for example, by a DSP or the like. Furthermore, the image recognition unit 122 may be configured separately from the image processing engine 120, or may be configured integrally with the control unit 135.

[0031] 1-2.About AF mode The digital camera 100 of this embodiment has a plurality of AF modes with different characteristics for performing autofocus (AF) operations, and is provided with a setting menu for setting various AF modes by, for example, user operation. An example of the configuration of the AF mode setting menu for such digital camera 100 will be described with reference to FIG. 2.

[0032] In the example of FIG. 2, the display monitor 130 of the digital camera 100 displays an AF mode setting menu, which includes an AF mode selection field 50, an AF area setting button 51, an automatic recognition setting button 52, and a confirmation button 53 for confirming the AF mode setting.

[0033] The control unit 135 of the digital camera 100 accepts user operations on the display screen of such setting menus at an operation unit 150 such as a touch panel or operation buttons. The user can input to the digital camera 100, for example, by touching various parts on various display screens or by operating corresponding physical operation buttons. The operation unit 150 is an example of a setting unit in the digital camera 100.

[0034] The AF mode selection field 50 accepts a user operation, such as a touch operation, to select an AF mode to be set in the digital camera 100 from various AF mode options such as "single-point AF," "multi-area AF," "tracking," and "area start." The various AF modes in the selection field 50 are examples of multiple operating modes of the digital camera 100.

[0035] The AF area setting button 51 accepts a user operation to set, on a through-the-lens image, the arrangement of various areas (e.g., AF areas) used for the AF mode selected in the AF mode selection field 50 (see FIG. 7). For example, the AF area is an area to be focused on in the AF operation of the digital camera 100, and is made visible to the user by a frame display on the through-the-lens image, for example. The AF area setting button 51 may be omitted, for example, depending on the AF mode options.

[0036] The automatic recognition setting button 52 accepts a user operation for setting, for example, a function for automatically recognizing a specific subject by the image recognition unit 122, i.e., for setting ON / OFF (enable / disable) of the automatic recognition function. The automatic recognition function may be set by a user operation in each AF mode, or may be set by the user in a specific AF mode. When the automatic recognition setting button 52 is ON, the digital camera 100 accepts a user operation for detailed settings, such as selecting the type of subject (hereinafter referred to as "target subject") to be targeted by the automatic recognition function (see FIG. 8).

[0037] In the AF mode selection field 50, "1-point AF" is an AF mode option that performs AF operation to focus in a single AF area that is preset, for example, using the AF area setting button 51. In this AF mode, if the auto-recognition function is ON and a target subject is detected in the preset AF area, the detection result is used for AF operation. For example, in this AF mode, if the target subject moves away from the preset AF area, the AF mode returns to AF operation based on that AF area.

[0038] "Multi-area AF" is an AF mode option that performs AF operation by switching the AF area as needed from multiple areas that are pre-arranged across the entire through-the-lens image 60. In this AF mode, if automatic recognition is ON, a specific subject is detected across the entire through-the-lens image, and the AF area is changed based on the detection results. The arrangement of multiple areas is not limited to the entire through-the-lens image, and may be partial.

[0039] "Tracking" is an AF mode option that performs AF operation while moving the AF area to track the subject. This AF mode is executed, for example, at the start of AF operation, to track a subject located within a predetermined area on the through-the-lens image. The predetermined area can be set in various ways, for example, using the AF area setting button 51. For example, when the automatic recognition function is ON, if the target subject is within the predetermined area at the start of AF operation, AF operation is performed to track the subject. Even if the subject moves outside the predetermined area, subject detection and AF operation continue. On the other hand, if the target subject is not within the predetermined area, the digital camera 100 automatically determines the target to track, and the focus may shift outside the predetermined area. Furthermore, for example, if the target subject is outside the predetermined area at the start of AF operation, AF operation may be performed to track the subject from outside the predetermined area.

[0040] "Area Start" is an option that indicates, as an AF mode, a new operating mode provided in the digital camera 100 of this embodiment. The digital camera 100 of this embodiment provides a new operating mode (hereinafter referred to as "standby tracking mode") in which the user waits for a subject desired by the user in a pre-arranged AF area, and performs AF operation to start tracking the subject from that AF area. The standby tracking mode of this embodiment makes it easier to perform AF operation suited to the shooting scene, such as tracking a subject from an AF area desired by the user, than the above-mentioned AF modes (details will be described later).

[0041] In this embodiment, the AF mode of the digital camera 100 may be switched depending on the setting of still image shooting or video shooting, or whether AFC (continuous AF) or AFS (single AF) is selected. For example, the standby tracking mode of this embodiment may be available in the AFC setting for still image shooting or when shooting video.

[0042] 2.Operation The operation of the digital camera 100 configured as above will now be described.

[0043] Digital camera 100 generates imaging data by capturing an image of a subject formed via optical system 110 with image sensor 115. Image processing engine 120 generates image data by performing various processes on the imaging data generated by image sensor 115. Control unit 135 records the image data generated by image processing engine 120 on memory card 142 inserted in card slot 140, for example, during an operation to capture a still image or a moving image.

[0044] Furthermore, during the operation of capturing a through image, digital camera 100 displays the through image on display monitor 130. The user can check the composition for capturing an image by looking at the through image on display monitor 130. Control unit 135 controls the AF operation in which lens drive unit 112 drives the focus lens of optical system 110 to automatically focus on the subject, for example, in response to the user operating the release button.

[0045] 2-1. Overview of operation An outline of the operation of the standby tracking mode in the digital camera 100 of this embodiment will be described with reference to FIGS.

[0046] 3(A) to 3(C) show a series of example operations in which the standby tracking mode of this embodiment is applied to a shooting scene in which a target subject 6 desired by the user moves in from outside the angle of view range of the digital camera 100. FIG. 3(A) shows an example of a display of a through image 60 before the target subject 6 appears in the digital camera 100 of this embodiment. FIG. 3(B) shows an example of a display of a through image 60 when the target subject 6 appears after FIG. 3(A). FIG. 3(C) shows an example of a display of a through image 60 when the target subject 6 moves following FIG. 3(B).

[0047] When the digital camera 100 of this embodiment initially operates in, for example, standby tracking mode, it places an AF area 61 at a preset initial position on a through image 60 on the display monitor 130, as shown in FIG. 3A. Such an AF area 61 in the initial state of the standby tracking mode will hereinafter be referred to as the "standby AF area 61." For example, the user can set the standby AF area 61 at a position on the through image 60 of the digital camera 100 where the desired target subject 6 is expected to appear.

[0048] In this initial state, the digital camera 100 of this embodiment performs an AF operation in parallel with the detection process of the target subject 6 by, for example, image recognition, based on the standby AF area 61 arranged on the through image 60. For example, in the example of FIG. 3A, the target subject 6 is not yet captured in the through image 60, and the digital camera 100 continues to focus on the background in the standby AF area 61.

[0049] In Figure 3(B), target subject 6 enters standby AF area 61 after Figure 3(A). Digital camera 100 then detects target subject 6 and displays the recognition result of target subject 6 through image recognition on display monitor 130 as AF area 62 (hereinafter referred to as "recognized AF area 62"). At this time, digital camera 100 performs AF operation based on the recognized AF area 62 of target subject 6. In this way, digital camera 100 of this embodiment can quickly change focus from the background in standby AF area 61 to target subject 6.

[0050] Once digital camera 100 of this embodiment detects target subject 6 in standby AF area 61, it performs AF operation to track target subject 6 across the entire through-the-lens image 60. In the example of FIG. 3(C), target subject 6 has moved since FIG. 3(B) and is now out of standby AF area 61. Even in such a case, digital camera 100 of this embodiment can continue to focus on target subject 6 by performing AF operation based on, for example, recognized AF area 62 of target subject 6.

[0051] As described above, the standby tracking mode of digital camera 100 in this embodiment allows the user to, for example, wait for the target subject 6 to appear, and easily obtains AF operation that follows the movement of target subject 6 from the standby AF area 61 where it is expected to appear.

[0052] 2-2.Details of operation The operation of the standby tracking mode in digital camera 100 of this embodiment as described above will be described in detail with reference to FIGS.

[0053] Fig. 4 is a flowchart illustrating the operation of the standby tracking mode in the digital camera 100 of the first embodiment. The flow in Fig. 4 is started when the digital camera 100 is set to the standby tracking mode, for example, in the setting menu in Fig. 2. This flow is executed by the control unit 135 in parallel with the operation of capturing the through image 60 for each frame in the digital camera 100, for example.

[0054] First, the control unit 135 of the digital camera 100 acquires setting information for executing the standby tracking mode (S1). For example, the setting information includes information related to the arrangement, such as the position and size of the standby AF area 61, and information indicating the target subject 6 to be tracked (for example, type).

[0055] In step S1, control unit 135 may acquire setting information according to user settings, or may acquire setting information that has been set in advance by the user from flash memory 145, etc. Details of such user settings for the standby follow mode will be described later.

[0056] Next, control unit 135 receives an instruction to start an AF operation in response to, for example, a user operation on operation unit 150 (S2). The AF start instruction that is the target of step S2 is, for example, a half-press of the release button in the case of still image shooting, or an operation of the video button to start shooting in the case of video shooting.

[0057] When an AF start instruction is input (YES in S2), for example, the control unit 135 first causes the image recognition unit 122 to start image recognition of the target subject 6 (S3). For example, the image recognition unit 122 executes image recognition processing for each frame of the through images 60 captured sequentially by the image sensor 115, and outputs output information of the recognition results to the control unit 135. The start of image recognition (S3) is not limited to the start of the AF operation, and may be executed, for example, before proceeding to YES in step S2.

[0058] Next, the control unit 135 performs a detection process to determine whether or not the target subject 6 is in the standby AF area 61 in the current through image 60, for example, based on the output information of the image recognition unit 122 (S4). The detection process of step S4 will be described with reference to FIGS. 5(A) and 5(B).

[0059] Fig. 5(A) illustrates a through image 60 when the target subject 6 is not detected (NO in S4). Fig. 5(B) illustrates a through image 60 when the target subject 6 is detected (YES in S4). For ease of explanation, Figs. 5(A) and (B) illustrate an example in which the arrangement of the standby AF area 61 is different from the example in Figs. 3(A) and (B).

[0060] 5A and 5B illustrate an example of a subject area 65 indicating the recognition result of the target subject 6 by the image recognition unit 122. In step S4, the control unit 135 performs a detection process for the target subject 6 in the waiting AF area 61 by, for example, comparing the position of the subject area 65 indicated by the output information of the image recognition unit 122 with the position of the waiting AF area 61.

[0061] For example, as shown in Fig. 5(A), if there is no overlap between the subject area 65 and the standby AF area 61, the control unit 135 does not detect the target subject 6 in the standby AF area 61 (NO in S4). In this case, for example, the subject area 65 is not particularly displayed on the display monitor 130. Also, if the output information of the image recognition unit 122 does not include the subject area 65 and the target subject 6 is not recognized, the control unit 135 proceeds to NO in step S4 (see Fig. 3(A)).

[0062] On the other hand, when there is overlap between the subject area 65 and the standby AF area 61, as shown in Fig. 5(B), for example, the control unit 135 detects the target subject 6 in the standby AF area 61 (YES in S4). At this time, the subject area 65 is adopted as, for example, the recognition AF area 62 (Fig. 3(B)) and displayed on the display monitor 130. The subject area 65 and the recognition AF area 62 do not need to exactly match, and may have an appropriate tolerance.

[0063] Returning to FIG. 4, if the target subject 6 is not detected in the standby AF area 61 (NO in S4), the control unit 135 performs various controls to perform AF operation based on the standby AF area 61, for example, as shown in FIG. 3(A) (S5).

[0064] In step S5, for example, the control unit 135 calculates an AF evaluation value such as a contrast value by detecting the standby AF area 61 (or an area nearby). Next, the control unit 135 controls the lens driving unit 112 to determine the focus lens position in the optical system 110 based on the calculated AF evaluation value. In this embodiment, the AF operation of the digital camera 100 is not limited to this contrast method, and in addition to or instead of this, for example, an image plane phase difference method or a DFD may be adopted.

[0065] After step S5, the control unit 135 again performs the detection process (S4) of the target subject 6 in the standby AF area 61 based on the output information of the image recognition unit 122 for the new frame of the through image 60. The detection process of step S4 is repeatedly executed in a cycle of, for example, one or more predetermined number of frame periods. In steps S4 and S5, the control unit 135 continues to display, for example, the standby AF area 61 that was initially arranged.

[0066] If the target subject 6 is detected in the standby AF area 61 (YES in S4), the control unit 135 performs various controls to execute an AF operation based on the recognized AF area 62 of the target subject 6, for example, as shown in Fig. 3(B) (S6). At this time, the control unit 135 causes the display monitor 130 to display, for example, a subject area 65 (Fig. 5(B)) as the recognized AF area 62.

[0067] The AF operation in step S6 is performed in the same manner as in step S5, using, for example, the recognition AF area 62 instead of the standby AF area 61. In step S6, the control unit 135 may also extract information on feature amounts such as color information of the target subject 6. In the AF operations in steps S5 and S6, various parameter settings for executing the AF operations other than those for the AF areas 61 and 62 may be common settings or different settings.

[0068] After starting AF control (S6) for the detected target subject 6, the control unit 135 determines, for example, sequentially based on output information of the image recognition result of the through image 60 of a new frame, whether or not the target subject 6 has been recognized by the image recognition unit 122 in that frame (S7). For example, the control unit 135 makes the determination in step S7 depending on whether or not the object area 65 of the target subject 6 is included in the output information from the image recognition unit 122.

[0069] When the target subject 6 is recognized by the image recognition unit 122 (YES in S7), the control unit 135 updates the recognized AF area 62 to the newly recognized subject area 65 and performs AF control equivalent to step S6 (S8). In this way, the digital camera 100 of this embodiment can perform AF operation by moving the recognized AF area 62 to follow the target subject 6 even if the target subject 6 moves out of the standby AF area 61, as shown in Fig. 3(C) for example.

[0070] On the other hand, when the target subject 6 is not recognized by the image recognition unit 122 (NO in S7), the digital camera 100 of this embodiment controls the AF operation to track the target subject 6 by a means other than the image recognition that led to the target subject 6 being lost (S9). The processing of step S9 will be described with reference to FIG.

[0071] 6 illustrates a through-the-lens image 60 in which only a portion of the target subject 6 is captured due to an obstacle, resulting in the target subject 6 being lost during image recognition (NO in S7). In step S9, for example, the control unit 135 first determines an AF area 63 that is estimated as a result of tracking the target subject 6, as shown in FIG. 6, for example, based on feature amounts such as color information or motion vectors of the portion of the target subject 6 in the through-the-lens image 60 before and after the target subject 6 is lost. Hereinafter, this AF area 63 will be referred to as an "estimated AF area 63."

[0072] For example, in step S9, the control unit 135 can determine an area having the color information of the target subject 6 as the estimated AF area 63 by comparing the color information extracted when the target subject 6 was detected (YES in S4) with the color information in the current through image 60. Alternatively, the control unit 135 may refer to the motion vector of the subject area 65 in the through image 60 immediately before the target subject 6 was lost, and determine an area in the current through image 60 that is predicted to correspond to the target subject 6 as the estimated AF area 63.

[0073] 6, the control unit 135 displays the estimated AF area 63 on the display monitor 130 and performs AF control based on the estimated AF area 63 (S9). The AF operation in step S9 is performed in the same manner as step S8, for example, using the estimated AF area 63 instead of the recognized AF area 62. In this way, the digital camera 100 of this embodiment can perform AF operation by tracking the target subject 6 in the estimated AF area 63 even when the image recognition unit 122 cannot recognize the target subject 6 (NO in S7) (S9).

[0074] For example, after AF operation (S8, S9) using recognized AF area 62 or estimated AF area 63, control unit 135 receives an instruction to end AF operation in response to a user operation on operation unit 150 (S10). The AF end instruction that is the target of step S10 is, for example, releasing the halfway press of the release button in the case of still image shooting, or operating the video button to end shooting in the case of video shooting. The halfway press release may also be completing a full press of the release button, in which case digital camera 100 shoots a still image and then cancels the AF operation.

[0075] If an AF end instruction has not been input (NO in S10), the control unit 135 performs the processes from step S7 onwards again. In this way, the digital camera 100 of this embodiment can cause the recognized AF area 62 or the estimated AF area 63 to track the target subject 6 until an instruction to end the AF operation is received (S7 to S9). Note that the process shown in this flow may be automatically ended when the process of step S9 has been performed a predetermined number of times. The predetermined number of times may be, for example, multiple times or just one time.

[0076] On the other hand, if an AF end instruction is input (YES in S10), the control unit 135 ends the processing illustrated in Fig. 4. Note that even if an AF end instruction is input while the processing of steps S4 to S5 is being repeated, the digital camera 100 can end the processing of this flow.

[0077] According to the above-described standby tracking mode processing, digital camera 100 of this embodiment first performs AF control and detection processing for target subject 6 in standby AF area 61 (S4 to S5). In this way, digital camera 100 of this embodiment can wait for target subject 6 by continuing to focus on the background, etc., of standby AF area 61 until target subject 6 is detected, as exemplified in FIG. 3(A).

[0078] Thereafter, when the target subject 6 is detected in the standby AF area 61 (YES in S4), the control unit 135 tracks the target subject 6 using the recognized AF area 62 by the image recognition unit 122 (S5 to S8), as illustrated in Figures 3(B) and (C). In this way, the digital camera 100 of this embodiment can easily achieve the AF operation that tracks the target subject 6 from the standby AF area 61.

[0079] Furthermore, even if the target subject 6 is lost during image recognition (NO in S7), the digital camera 100 of this embodiment can complement the tracking of the target subject 6 by using an estimated AF area 63 based on features such as color information or motion vectors instead of the recognized AF area 62, as illustrated in FIG.

[0080] Although the above description has explained one example of the detection process (S4) of the target subject 6, the detection process of step S4 in the digital camera 100 of this embodiment is not limited to the above example. For example, if the size of the overlap between the subject area 65 and the standby AF area 61 is within a predetermined error range, the control unit 135 may proceed to NO in step S4.

[0081] Furthermore, the detection process in step S4 is not particularly limited to overlap between areas, and may be performed based on various positional relationships, such as an inclusion relationship in which the standby AF area 61 encompasses the subject area 65, or the distance between the respective center positions. In this embodiment, the control unit 135 can perform detection process (S4) of the target subject 6 depending on whether the subject area 65 is located within various predetermined ranges assumed to be near the standby AF area 61.

[0082] Furthermore, in the digital camera 100 of this embodiment, the subject area 65 of the image recognition result may be displayed on the display monitor 130 regardless of the result of the detection process (S4). The subject area 65 and the recognition AF area 62 may be displayed in the same manner, or may have different display manners.

[0083] 2-2-1. Setting the standby tracking mode In the digital camera 100 of this embodiment, the setting information (S1) for the standby tracking mode is set in response to a user operation from, for example, the setting menu (FIG. 2). The setting of the standby tracking mode will be described with reference to FIGS. 7 and 8.

[0084] 7 shows an example of a setting screen for the standby AF area 61 in the digital camera 100. For example, when the AF area setting button 51 is operated in a state in which "Area Start" indicating the standby tracking mode is selected in the selection field 50 in the AF mode setting menu as in the example of FIG. 2, the control unit 135 transitions the display monitor 130 to the setting screen in FIG.

[0085] The control unit 135 causes the display monitor 130 to display a setting area 64 superimposed on the through image 60 on the setting screen of Fig. 7, for example, and receives various user operations on the setting area 64 using the operation unit 150. The setting area 64 is an area that is to be set as the standby AF area 61 in the standby tracking mode, for example. The operation unit 150 is an example of a setting unit in this embodiment.

[0086] For example, the control unit 135 changes the position of the setting area 64 in response to a touch operation such as dragging the setting area 64 by the user or an operation of the up, down, left, and right direction keys. The control unit 135 may also change the size of the setting area 64 by a touch operation such as pinching in / out on the setting area 64. The user may place the setting area 64 at an expected position where the target subject 6 will appear on the through image 60, or may place it in various positions on the through image 60 at which the user wishes to start tracking the target subject 6.

[0087] On this standby AF area 61 setting screen (FIG. 7), the control unit 135 sets the final arrangement of the setting area 64 to the arrangement of the standby AF area 61 in response to, for example, the operation of the back button 66, and returns the display monitor 130 to the setting menu in FIG. 2. The arrangement of the standby AF area 61 set in this way is stored as setting information in, for example, the flash memory 145 of the digital camera 100.

[0088] Fig. 8 illustrates an example of a setting screen for the target subject 6 in the digital camera 100. For example, when the automatic recognition setting button 52 is operated to the ON state in the setting menu state illustrated in Fig. 2 as described above, the control unit 135 transitions the display monitor 130 to the setting screen in Fig. 8.

[0089] 8 includes a category selection field 71 that includes categories such as "people," "animals," "vehicles," and "moving objects" as options, and a selection field 72 for the type of subject included in the selected category. The control unit 135 accepts a user operation to select an option in each of the selection fields 71 ​​and 72, for example, using the operation unit 150. The control unit 135 sets the type of target subject 6 in response to, for example, the operation of the back button 66 in the same manner as above, and stores the set information in the flash memory 145 or the like.

[0090] In the example of FIG. 8, the type "car" included in the category "vehicle" is selected as the type of target subject 6. Types such as dogs, cats, or birds may be classified under "animals." Adults or children, or men or women may be classified under "people." Furthermore, "moving object" is an option for setting a moving subject in general as the target subject 6 without classifying the subject desired by the user into any other category (or type). In the digital camera 100 of this embodiment, the type of target subject 6 does not need to be classified by category on the setting screen for the target subject 6.

[0091] Furthermore, the digital camera 100 of this embodiment may accept a user operation to change the shape of the standby AF area 61, such as changing the aspect ratio of the setting area 64, on a setting screen for the standby AF area 61 (FIG. 7). Furthermore, in the digital camera 100 of this embodiment, the arrangement of the standby AF area 61 is not necessarily limited to a user operation, but may be set automatically. For example, the control unit 135 of the digital camera 100 may automatically set the standby AF area 61 for the target subject 6 on the through image 60 based on the setting of the target subject 6 and the through image 60, or may present this to the user.

[0092] 3. Summary As described above, the digital camera 100 of this embodiment includes an image sensor 115, which is an example of an imaging unit, and a control unit 135. The image sensor 115 captures an image of a subject formed via the optical system 110 and generates image data. The control unit 135 controls the image sensor 115 that generates the image data and the focusing operation of the optical system 110. Before the control unit 135 detects the target subject 6 in the standby AF area 61, which is an example of a first focusing area that has been pre-arranged in the through-the-lens image 60 represented by the image data (NO in S4), the control unit 135 causes the optical system 110 to perform a focusing operation based on the arranged standby AF area 61 (S5). After the control unit 135 detects the target subject 6 in the arranged standby AF area 61 (YES in S4), the control unit 135 causes the optical system 110 to perform a focusing operation so as to track the target subject 6 over a range away from the arranged standby AF area 61 (S6). This makes it easier for the digital camera 100 of this embodiment to achieve a focusing operation that tracks a subject from a desired area.

[0093] In the digital camera 100 of this embodiment, the control unit 135 may control the display monitor 130 to display a through image 60, which is an example of a captured image represented by the image data. The control unit 135 causes the display monitor 130 to display a standby AF area 61, which is an example of a first focusing area, arranged in advance in the through image 60, and before detecting a target subject 6, which is an example of a subject, in the standby AF area 61 (NO in S4), causes the optical system 110 to perform an AF operation, which is an example of a focusing operation, based on the standby AF area 61 (S5). After detecting the target subject 6 in the standby AF area 61 (YES in S4), the control unit 135 causes the display monitor 130 to display a recognition AF area 62, which is an example of a second focusing area that tracks the target subject 6 over a range away from the standby AF area 61 (S6).

[0094] According to the above-described digital camera 100, for example, the standby AF area 61 and the recognition AF area 62 displayed on the through image 60 can facilitate focusing operations that track a subject from a desired area such as the standby AF area 61.

[0095] In digital camera 100 of this embodiment, after detecting target subject 6 in standby AF area 61 (YES in S4), control unit 135 causes optical system 110 to perform AF operation based on recognition AF area 62 so as to track target subject 6 over a range away from standby AF area 61 (S6). This makes it easier for digital camera 100 of this embodiment to achieve AF operation that tracks a subject from a desired area.

[0096] The digital camera 100 of this embodiment further includes an image recognition unit 122 that recognizes, based on image data, a subject area 65 in which the target subject 6 is located in the through-the-lens image 60. Based on the recognition result of the image recognition unit 122, the control unit 135 does not detect the target subject 6 when the subject area 65 is not within a predetermined range from the standby AF area 61 (NO in S4). The control unit 135 detects the target subject 6 when the subject area 65 is within a predetermined range from the standby AF area 61 (YES in S4). The digital camera 100 of this embodiment detects the target subject 6 in the standby AF area 61 in this way, making it easier to achieve AF operation that tracks the target subject 6 from the standby AF area 61. The predetermined range is, for example, a range in which the subject area 65 overlaps with the standby AF area 61.

[0097] In the digital camera 100 of this embodiment, after detecting the target subject 6 (YES in S4), if the image recognition unit 122 recognizes the subject area 65 (YES in S7), the control unit 135 displays the recognized AF area 62 to track the target subject 6 based on the recognized subject area 65 (S8). After detecting the target subject 6 (YES in S4), if the image recognition unit 122 does not recognize the subject area 65 (NO in S7), the control unit 135 displays the estimated AF area 63, an example of a second focusing area, to track the target subject 6 based on a predetermined feature amount in the through-the-lens image 60 (S9). This allows the digital camera 100 of this embodiment to easily achieve AF operation that tracks the target subject 6 from the standby AF area 61 by image recognition and, even if the target subject 6 is lost during image recognition, tracks the target subject 6 based on the feature amount. The predetermined feature amount includes, for example, at least one of color information and a motion vector.

[0098] The digital camera 100 of this embodiment further includes an operation unit 150, which is an example of a setting unit that sets, in response to a user operation, at least one of the arrangement of the standby AF area 61 in the through image 60 and the target subject 6 to be detected. This makes it easier for the digital camera 100 of this embodiment to achieve a focusing operation that tracks a specific subject from a specific area as desired by the user. In this embodiment, the setting unit of the digital camera 100 may set either the arrangement of the standby AF area 61 or the target subject 6 in response to a user operation.

[0099] In digital camera 100 of this embodiment, control unit 135 has, for example, a plurality of AF modes as a plurality of operation modes that respectively control the focusing operation (see FIG. 2). When set to a standby tracking mode, which is an example of a specific operation mode among the plurality of operation modes, control unit 135 displays a standby AF area 61, and after detecting a target subject 6 in standby AF area 61, displays a recognition AF area 62 (see FIG. 3). This standby tracking mode makes it easy for digital camera 100 of this embodiment to achieve AF operation that tracks a subject from a desired area.

[0100] The digital camera 100 of this embodiment further includes a display monitor 130 that displays a through image 60 indicated by the image data and each in-focus area. This makes the various AF areas 61 to 63 visible to the user, facilitating the focusing operation to track the subject. In the digital camera 100 of this embodiment, the control unit 135 may control the display on the display monitor of the digital camera 100, or may additionally or alternatively control an external display unit via a connection unit provided on the digital camera 100, such as an HDMI terminal.

[0101] (Embodiment 2) A second embodiment of the present disclosure will be described below with reference to Figures 9 and 10. In the first embodiment, an example of the operation of the digital camera 100 in standby tracking mode has been described. In the second embodiment, an example of the operation of the digital camera 100 that selectively tracks a subject desired by the user when, for example, there are multiple subjects will be described.

[0102] Below, the description of the configuration and operation that are the same as those of the digital camera 100 according to the first embodiment will be omitted as appropriate, and the digital camera 100 according to this embodiment will be described.

[0103] Fig. 9 is a flowchart illustrating an example of operation in the standby tracking mode in the digital camera 100 of embodiment 2. Fig. 10 is a diagram for explaining an example of operation in the standby tracking mode in the digital camera 100 of this embodiment. In this modification, the control unit 135 of the digital camera 100 performs the same processes as in embodiment 1, steps S1 to S10, and also receives a user instruction to correct the tracking target (S11), for example, as shown in Fig. 9.

[0104] 10(A), in digital camera 100 of this modified example, multiple subjects 6A, 6B are captured near standby AF area 61 on through image 60. At this time, control unit 135 of digital camera 100 detects one of subjects 6A as the target subject (YES in S4) and displays recognition AF area 62 on display monitor 130 so as to track subject 6A (S6). In such a case, it is conceivable that the user would like to photograph subject 6B, which is different from subject 6A that is being tracked by automatic detection by digital camera 100.

[0105] Therefore, while digital camera 100 of this embodiment is tracking subject 6A (S6 to S9), for example, it receives an instruction to correct the tracking target (S11) through various input units such as operation unit 150 or microphone 160. The instruction to correct the tracking target that is the subject of step S11 may be, for example, an operation of the up, down, left, and right direction keys on operation unit 150, or may be a voice input such as "right" or "up" through microphone 160.

[0106] Fig. 10(B) shows an example of a display of a through image 60 when digital camera 100 responds to an instruction to correct the tracking target from the state of Fig. 10(A). When an instruction to correct the tracking target is input (YES in S11), control unit 135 of digital camera 100 changes the tracking target in accordance with the correction instruction and updates recognition AF area 62 with subject area 65 (Fig. 10(A)) of the recognition result of subject 6B of the new tracking target (S6). In this way, after the correction instruction (YES in S11), digital camera 100 of this embodiment can perform AF operation to track the user's desired subject 6B (S6 to S9), as shown in Fig. 10(B) as an example.

[0107] As described above, digital camera 100 of this embodiment may further include an input unit for inputting user instructions. Control unit 135 changes the target subject 6 to be tracked by recognition AF area 62 in response to the user's instruction via the input unit (YES in S11, S6). As a result, even if digital camera 100 of this embodiment erroneously detects subject 6A that is not the user's desired subject 6B, it can correct this in response to the user's instruction, making it easier to track the user's desired subject 6B.

[0108] (Other embodiments) As described above, the first and second embodiments have been described as examples of the technology disclosed in the present application. However, the technology in the present disclosure is not limited to these, and can be applied to embodiments in which appropriate modifications, substitutions, additions, omissions, etc. are made. Furthermore, it is also possible to combine the components described in the first and second embodiments to create new embodiments.

[0109] In the above-described first and second embodiments, an example of an operation for correcting erroneous detection of a target subject desired by the user by the digital camera 100 has been described. The digital camera 100 of this embodiment may be configured to allow setting of information for making it easier to avoid such erroneous detection of a target subject. Such a modification will be described with reference to FIG. 11.

[0110] 11 shows a modified example of the target subject setting screen in digital camera 100. Digital camera 100 of this embodiment may register an image of the target subject in addition to or instead of the type of target subject as setting information for the standby tracking mode, for example.

[0111] Fig. 11(A) shows a display example of a registration screen for a target subject in this modified example. In this modified example, the display monitor 130 of the digital camera 100 displays a registration screen such as that shown in Fig. 11(A) instead of, or subsequent to, the setting screen of Fig. 8, for example. The control unit 135, in the operation unit 150 serving as a setting unit, accepts a user operation to select an image of the target subject 6 using the target capture button 73 and the target read button 74 displayed on this screen.

[0112] 11(B) shows a display example of a target photographing screen transitioned from the target photographing button 73 in FIG. 11(A). The control unit 135 prompts the user to photograph an image of the target subject 6 on this photographing screen, and registers image data of the photographed image in the setting information. Such image registration of the target subject 6 is not limited to image photographing, and may be performed from pre-recorded image data.

[0113] Fig. 11(C) shows a display example of a target reading screen to which transition is made from the target reading button 74 in Fig. 11(A). The control unit 135 may read image data recorded in the memory card 142, for example, and display the list on this reading screen, accept a user operation to select an image to be registered, and register the selected image data in the setting information.

[0114] As described above, in digital camera 100 of this embodiment, the setting information that sets target subject 6 for detection in response to user operation in the setting unit is not limited to the type of target subject 6, but may also be image data of target subject 6. Furthermore, in digital camera 100 of this embodiment, such setting information is not limited to the above, and may also be, for example, color information of target subject 6, an identification number of target subject 6, or characteristic information about the appearance of target subject 6, and such various information may be set in digital camera 100 from the setting unit. Such setting information is set in image recognition unit 122 so as to be reflected in the image recognition processing from step S3 onwards, for example.

[0115] In the above-described embodiments, examples have been described in which setting information for the target subject 6 is set in advance in the image recognition unit 122. In the digital camera 100 of this embodiment, such pre-setting of the target subject 6 does not have to be performed. For example, when the type "moving object" is selected on the setting screen of FIG. 8 , the above-described various setting information may not be set in the image recognition unit 122. In such a case, in the detection process of step S4, the control unit 135 of the digital camera 100 may detect a moving subject (i.e., a moving object) in the standby AF area 61 or its vicinity based on changes in the through-the-lens image 60. At this time, the image recognition unit 122 may perform image recognition processing for each recognizable type and generate output information. Thereafter, when a moving object is detected, the target subject may be dynamically set based on the image at the time of detection, etc.

[0116] In the above-described embodiments, examples have been described in which the AF areas 61 to 63 are displayed during operation in standby tracking mode, but the use of such information is not limited to live view display. For example, in the digital camera 100 of this embodiment, various pieces of information during operation in standby tracking mode may be output as metadata. For example, the control unit 135 may output data including information on the various AF areas 61 to 63 used during shooting or information on the focus position in the metadata of a still image or video captured in standby tracking mode. Such metadata can be used, for example, as training data for machine learning related to the AF operation of the digital camera 100.

[0117] In the above-described embodiments, various rectangular AF areas 61 to 63 are exemplified (FIGS. 3 and 6, etc.). In the digital camera 100 of this embodiment, the AF areas 61 to 63 are not limited to a rectangle and may have various shapes. For example, the recognition AF area 62 may have a shape that follows the outline of the subject through image recognition using segmentation technology. Furthermore, the standby AF area 61 may be set to a shape desired by the user in advance settings of the standby mode of the digital camera 100 (see FIG. 7). Focusing areas such as the AF areas 61 to 63 may be areas that indicate the target of a focusing operation in various aspects.

[0118] In the above embodiments, examples have been described in which the standby tracking mode is provided as one of a plurality of AF modes presented in the selection field 50 on the AF mode setting screen, but the digital camera 100 of the present embodiment is not limited to this. For example, in the digital camera 100 of the present embodiment, the standby tracking mode may be an operating mode that is provided when the automatic recognition function is ON in an AF mode such as "single-point AF" or "tracking." When the automatic recognition function of such an AF mode is ON, an additional option such as "area start" may be presented.

[0119] In addition, in each of the above embodiments, the digital camera 100 is illustrated as including the optical system 110 and the lens driving unit 112. The imaging device of this embodiment does not need to include the optical system 110 and the lens driving unit 112, and may be, for example, an interchangeable lens camera.

[0120] In addition, although a digital camera has been described as an example of an imaging device in each of the above embodiments, the imaging device is not limited to this. The imaging device of the present disclosure may be any electronic device having an image capturing function (for example, a video camera, a smartphone, a tablet terminal, etc.).

[0121] (Example) Various aspects of the present disclosure will be exemplified below.

[0122] A first aspect of the present disclosure is an imaging device including an imaging unit that captures an image of a subject formed via an optical system and generates image data, and a control unit that controls a focusing operation by the optical system. Before detecting a subject in a first focusing area pre-arranged in a captured image represented by the image data, the control unit causes the optical system to perform a focusing operation based on the first focusing area, and after detecting the subject in the arranged focusing area, causes the optical system to perform a focusing operation so as to track the subject over a range away from the arranged focusing area.

[0123] A second aspect is an imaging device including a control unit that controls a display unit that displays a captured image represented by image data. The control unit causes the display unit to display a first focus area that is pre-arranged in the captured image, causes the optical system to perform a focusing operation based on the first focus area before detecting a subject in the first focus area, and causes the display unit to display a second focus area that tracks the subject over a range away from the first focus area after detecting the subject in the first focus area.

[0124] In a third aspect, the imaging device according to the first or second aspect further includes an image recognition unit that recognizes, based on image data, a subject area in which the subject is located in the captured image. The control unit does not detect the subject when the subject area is not within a predetermined range from the first focusing area, based on the recognition result of the image recognition unit, and detects the subject when the subject area is within the predetermined range from the first focusing area.

[0125] In a fourth aspect, in the imaging device according to the third aspect, when the image recognition unit recognizes a subject area after detecting the subject, the control unit displays a second focusing area to track the subject based on the recognized subject area. When the image recognition unit does not recognize a subject area after detecting the subject, the control unit displays a second focusing area to track the subject based on a predetermined feature amount in the captured image.

[0126] In a fifth aspect, the imaging device described in any of the first to fourth aspects further includes a setting unit that sets at least one of the placement of the first focusing area in the captured image and the subject to be detected in accordance with user operation.

[0127] In a sixth aspect, in the imaging device according to any one of the first to fifth aspects, the control unit has a plurality of operation modes for controlling the focusing operation, and when a specific operation mode of the plurality of operation modes is set, the control unit displays a first focusing area, and after detecting a subject in the first focusing area, displays a second focusing area.

[0128] In a seventh aspect, the imaging device according to any one of the first to sixth aspects further includes an input unit for inputting a user's instruction, and the control unit changes the subject to be tracked by the second focusing area in response to the user's instruction on the input unit.

[0129] In an eighth aspect, the imaging device according to any one of the first to seventh aspects further comprises a display unit that displays the captured image indicated by the image data and each in-focus area.

[0130] As described above, the embodiments have been described as examples of the technology in the present disclosure, and for that purpose, the accompanying drawings and detailed description have been provided.

[0131] Therefore, the components shown in the accompanying drawings and detailed description may include not only essential components for solving the problem, but also components that are not essential for solving the problem in order to illustrate the above technology. Therefore, the fact that these non-essential components are shown in the accompanying drawings or detailed description should not be interpreted as immediately indicating that these non-essential components are essential.

[0132] Furthermore, since the above-described embodiments are intended to illustrate the technology of the present disclosure, various modifications, substitutions, additions, omissions, etc. may be made within the scope of the claims or their equivalents. [Industrial Applicability]

[0133] The present disclosure is applicable to imaging devices that perform focusing operations such as autofocus. [Explanation of symbols]

[0134] 100 digital cameras 110 Optical system 112 Lens drive unit 115 Image Sensor 122 Image Recognition Unit 130 Display Monitor 135 Control Unit 150 Operation section

Claims

1. an imaging unit that captures an object image formed via an optical system and generates image data; a control unit that controls a focusing operation by the optical system; Equipped with The control unit before detecting a subject in a first focusing area arranged in advance in a captured image represented by the image data, making the optical system perform the focusing operation based on the arranged focusing area; After detecting the subject in the first focusing area, the optical system is caused to perform the focusing operation so as to track the subject over a range away from the positioned focusing area. Imaging device.

2. an image recognition unit that recognizes a subject area in which the subject is located in the captured image based on the image data; The control unit, based on the recognition result of the image recognition unit, not detecting the object when the object area is not within a predetermined range from the first focusing area; The object is detected when the object area is within the predetermined range from the first focus area. The imaging device according to claim 1 .

3. The control unit displaying a first focusing area arranged in advance in the captured image on a display unit that displays the captured image indicated by the image data; before detecting a subject in the first focusing area, the optical system is caused to perform a focusing operation based on the first focusing area; After the subject is detected in the first focusing area, a second focusing area that tracks the subject over a range away from the first focusing area is displayed on the display unit. The imaging device according to claim 1 .

4. an image recognition unit that recognizes a subject area in which the subject is located in the captured image based on the image data; The control unit, based on the recognition result of the image recognition unit, not detecting the object when the object area is not within a predetermined range from the first focusing area; The object is detected when the object area is within the predetermined range from the first focus area. After detecting the subject, the control unit: When the image recognition unit recognizes the subject area, the second focusing area is displayed so as to track the subject based on the recognized subject area; When the image recognition unit does not recognize the subject area, the second focusing area is displayed so as to track the subject based on a predetermined feature amount in the captured image. The imaging device according to claim 3 .

5. the control unit has a plurality of operation modes for controlling the focusing operation, When a specific operation mode of the plurality of operation modes is set, the control unit displays the first focus area, and after the subject is detected in the first focus area, displays the second focus area. The imaging device according to claim 3 .

6. further comprising an input unit for inputting a user's instruction; The control unit changes the subject to be tracked by the second focusing area in response to a user instruction on the input unit. The imaging device according to claim 3 .

7. The image processing device further includes a display unit that displays the captured image indicated by the image data and each in-focus area. The imaging device according to claim 3 .

8. The imaging device further includes a setting unit that sets at least one of the location of the first focusing area in the captured image and the subject to be detected in response to a user operation. The imaging device according to claim 1 .

Images