Electronic device, electronic device control method, program, and storage medium

Abstract

To make it possible to set an optimal tracking start location.SOLUTION: A control method for an electronic device includes a control step for controlling a first process and a second process. The first process is for setting a tracking start location at a location where tracking was performed until immediately before the tracking was stopped. The second process is for setting a tracking start location at a tracking start location predetermined in advance at the time of tracking stop.SELECTED DRAWING: Figure 11

Description

[Technical field]

[0001] The present invention relates to an electronic device, a control method for an electronic device, a program, and a storage medium. [Background technology]

[0002] In recent years, electronic devices such as digital cameras have been developed that are equipped with a function to automatically detect and track a subject to be tracked. In such devices, an indicator (frame display, etc.) showing the position and size of the subject displayed on the display screen is updated as needed to show the tracking status to the user.

[0003] In particular, imaging devices such as digital cameras equipped with a focus lens may have a function for tracking a subject and continuously adjusting the focus by controlling the focus while automatically tracking the subject with an AF area (AF frame).

[0004] In addition to the function of automatically detecting and tracking a subject, a function is also known in which the user can set the position where tracking will start in advance and perform a tracking start operation to track a subject near the set position, allowing tracking to start at a time preferred by the user.

[0005] In Patent Document 1, when AF frame automatic tracking is not being performed, the AF frame is fixed at the center of the captured image. When a user wants to perform AF frame automatic tracking with a specific subject as the tracking target, the user operates the camera's shooting angle of view so that the subject is included in the range of the central AF frame, and if the user instructs to start tracking, AF frame automatic tracking will start with the subject as the tracking target. Then, when the user instructs to stop tracking, the AF frame automatic tracking process is stopped, the AF frame is returned to and fixed at the center of the imaging range, and AF frame automatic tracking is no longer performed. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2010-141820 A Summary of the Invention [Problem to be solved by the invention]

[0007] However, with the method of Patent Document 1, when the user instructs the camera to stop tracking, the tracking start position returns to the original center AF frame position, which can interrupt the continuity of tracking and result in the shutter opportunity being missed.

[0008] Therefore, an object of the present invention is to make it possible to set an optimal tracking start position. [Means for solving the problem]

[0009] The technical features of the present invention include a tracking step of tracking a target in an image; , additional Tracking from the start position Target A tracking initiation step of starting tracking; Target A tracking stopping step of stopping the tracking, A setting step of setting different tracking start positions depending on whether a shooting preparation instruction for starting shooting preparation has been given or not. It is characterized by: Effect of the Invention

[0010] According to the present invention, an optimal tracking start position can be set. [Brief description of the drawings]

[0011] [Figure 1] FIG. 1 is an external view of a digital camera. [Diagram 2] FIG. 1 is a block diagram showing an example of the configuration of a digital camera. [Diagram 3] FIG. 11 is a diagram relating to a menu for changing a setting value. [Figure 4] This is a diagram showing a menu for setting button customization functions for activating tracking and calling functions. [Diagram 5] FIG. 4 is a diagram showing icons indicating shooting information display and setting values. [Figure 6] This is a diagram showing the frame display before and after AF (operation) is activated. [Figure 7] FIG. 13 is a diagram showing frame display depending on a combination of AF area and tracking settings. [Figure 8] FIG. 13 is a diagram showing state transitions in the case of servo AF. [Figure 9] FIG. 13 is a diagram showing state transitions in the case of one-shot AF. [Figure 10] 11 is a flowchart showing control in the case of servo AF. [Figure 11] 11 is a flowchart showing control in the case of one-shot AF. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0012] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0013] ●Digital camera configuration 1(a) and (b) show external views of a digital camera 100 as an example of a device (electronic device) to which the present invention can be applied. FIG. 1(a) is a front perspective view of the digital camera 100, and FIG. 1(b) is a rear perspective view of the digital camera 100. In FIG. 1, a display unit 28 is a display unit provided on the rear surface of the camera that displays images and various information. A touch panel 70a can detect a touch operation on the display surface (operation surface) of the display unit 28. An outside-finder display unit 43 is a display unit provided on the top surface of the camera, and displays various settings of the camera, including shutter speed and aperture. A shutter button 61 is an operation unit for issuing shooting instructions. A mode change switch 60 is an operation unit for switching between various modes. A terminal cover 40 is a cover that protects a connector (not shown) that connects a connection cable with an external device to the digital camera 100.

[0014] The main electronic dial 71 is a rotary operation member, and by rotating this main electronic dial 71, the setting values ​​such as the shutter speed and the aperture can be changed. The power switch 72 is an operation member for switching the power of the digital camera 100 ON and OFF. The sub electronic dial 73 is a rotary operation member for moving the selection frame and forwarding images. The cross key 74 is a cross key operation member (four-way key) having push buttons that can be pressed in four directions, up, down, left, and right. The operation corresponding to the part pressed in the direction pressed on the cross key 74 is possible. The SET button 75 is a push button, and is mainly used for deciding the selection item. The movie button 76 is used to instruct the start and stop of movie shooting (recording). The AE lock button 77 can fix the exposure state by pressing it in the shooting standby state. The enlargement button 78 is an operation button for turning the enlargement mode ON and OFF in the live view display in the shooting mode. The live view image can be enlarged and reduced by operating the main electronic dial 71 after turning on the enlargement mode. In the playback mode, it functions as a magnification button for enlarging the playback image and increasing the magnification ratio. The playback button 79 is an operation button for switching between the shooting mode and the playback mode. By pressing the playback button 79 during the shooting mode, the mode is switched to the playback mode, and the latest image among the images recorded on the recording medium 200 can be displayed on the display unit 28. By pressing the menu button 81, a menu screen in which various settings can be made is displayed on the display unit 28. The user can intuitively make various settings using the menu screen displayed on the display unit 28, the cross key 74, the SET button 75, or the multi-controller (hereinafter, MC) 65. The MC 65 can accept directional instructions in eight directions and a push operation on the center part.

[0015] The communication terminal 10 is a communication terminal that enables the digital camera 100 to communicate with a lens unit 150 (detachable) described below. The eyepiece 16 is the eyepiece of an eyepiece finder (a peer-type finder), and the user can view an image displayed on an internal EVF (Electric View Finder) 29 through the eyepiece 16. The eyepiece detection unit 57 is an eyepiece detection sensor that detects whether or not the user has placed his or her eye close to the eyepiece 16. The lid 202 is the lid of a slot that stores the recording medium 200.

[0016] Grip section 90 is a holding section shaped to be easily held in the right hand when the user holds digital camera 100. In a state in which the digital camera is held by gripping grip section 90 with the little finger, ring finger, and middle finger of the right hand, shutter button 61 and main electronic dial 71 are located at positions that can be operated with the index finger of the right hand. In the same state, sub electronic dial 73 is located at a position that can be operated with the thumb of the right hand.

[0017] FIG. 2 is a block diagram showing an example of the configuration of a digital camera 100 according to this embodiment. In FIG. 2, a lens unit 150 is a lens unit equipped with an interchangeable photographing lens. The lens 103 is usually composed of multiple lenses, but here, for simplicity, only one lens is shown. A communication terminal 6 is a communication terminal for the lens unit 150 to communicate with the digital camera 100. The lens unit 150 communicates with the system control unit 50 via this communication terminal 6 and the above-mentioned communication terminal 10, and controls the aperture 1 via the aperture drive circuit 2 by the internal lens system control circuit 4. Thereafter, the lens 103 is displaced via the AF drive circuit 3 to adjust the focus.

[0018] The shutter 101 is a focal plane shutter that can freely control the exposure time of the imaging unit 22 under the control of the system control unit 50 .

[0019] The imaging unit 22 is an imaging element that converts an optical image into an electrical signal and is composed of a CCD, a CMOS element, etc. The A / D converter 23 is used to convert an analog signal output from the imaging unit 22 into a digital signal.

[0020] The image processing unit 24 performs predetermined pixel interpolation, resizing such as reduction, and color conversion processing on the data from the A / D converter 23 or data from the memory control unit 15 described later. The image processing unit 24 also performs predetermined arithmetic processing using the captured image data. The system control unit 50 performs exposure control and focus adjustment control based on the arithmetic results obtained by the image processing unit 24. This allows TTL (through-the-lens) type AF (autofocus) processing, AE (autoexposure) processing, and EF (flash pre-flash) processing to be performed. The image processing unit 24 also performs predetermined arithmetic processing using the captured image data, and performs TTL type AWB (auto white balance) processing based on the arithmetic results obtained.

[0021] The memory control unit 15 controls data transmission and reception between the A / D converter 23, the image processing unit 24, and the memory 32. The output data from the A / D converter 23 is written into the memory 32 via the image processing unit 24 and the memory control unit 15, or directly via the memory control unit 15.

[0022] The memory 32 stores image data obtained by the imaging unit 22 and converted into digital data by the A / D converter 23. The memory 32 has a storage capacity sufficient to store a predetermined number of still images and a predetermined period of moving images and audio. The memory 32 also serves as a memory for displaying images (video memory). The image data for display written in the memory 32 is displayed by the display unit 28 and the EVF 29 via the memory control unit 15. The display unit 28 and the EVF 29 perform display on a display device such as an LCD or an organic EL in response to a signal from the memory control unit 15. The data A / D converted by the A / D converter 23 and stored in the memory 32 is sequentially transferred to the display unit 28 or the EVF 29 for display, thereby performing a live view display (LV display). Hereinafter, an image displayed in live view is referred to as a live view image (LV image).

[0023] The infrared light emitting diode 166 is a light emitting element for detecting the position of the user's line of sight within the viewfinder screen, and irradiates infrared light onto the user's eyeball (eye) 161 placed against the eyepiece 16. The infrared light emitted from the infrared light emitting diode 166 is reflected by the eyeball (eye) 161, and the reflected infrared light reaches the dichroic mirror 162. The dichroic mirror 162 reflects only the infrared light and transmits visible light. The reflected infrared light, whose optical path has been changed, forms an image on the imaging surface of the line of sight detection sensor 164 via the imaging lens 163. The imaging lens 163 is an optical member that constitutes the line of sight detection optical system. The line of sight detection sensor 164 is composed of an imaging device such as a CCD image sensor.

[0024] The gaze detection sensor 164 photoelectrically converts the incident infrared reflected light into an electric signal and outputs it to the gaze detection circuit 165. The gaze detection circuit 165 includes at least one processor, and detects the user's gaze position from the image or movement of the user's eyeball (eye) 161 based on the output signal from the gaze detection sensor 164, and outputs the detection information to the system control unit 50. In this manner, the dichroic mirror 162, the imaging lens 163, the gaze detection sensor 164, the infrared light emitting diode 166, and the gaze detection circuit 165 constitute a gaze detection block 160.

[0025] In this embodiment, the gaze detection block 160 is used to detect the gaze by a method called the corneal reflex method. The corneal reflex method is a method for detecting the direction and position of the gaze from the positional relationship between the light reflected by the cornea of ​​the eyeball (eye) 161 and the pupil of the eyeball (eye) 161, and infrared light emitted from the infrared light emitting diode 166. There are also various other methods for detecting the direction and position of the gaze, such as a method called the scleral reflex method that utilizes the difference in light reflectance between the black and white of the eye. Note that a gaze detection means other than the above may be used as long as it can detect the direction and position of the gaze.

[0026] Various camera settings such as shutter speed and aperture are displayed on the outside viewfinder liquid crystal display 43 via an outside viewfinder display drive circuit 44 .

[0027] The non-volatile memory 56 is an electrically erasable and recordable memory, and may be, for example, a Flash-ROM. Constants, programs, and the like for the operation of the system control unit 50 are stored in the non-volatile memory 56. The programs referred to here are computer programs for executing various flowcharts described later in this embodiment.

[0028] The system control unit 50 is a control unit consisting of at least one processor or circuit, and controls the entire digital camera 100. Each process of this embodiment, which will be described later, is realized by executing a program recorded in the nonvolatile memory 56 described above. The system memory 52 may be, for example, a RAM, in which constants and variables for the operation of the system control unit 50, programs read from the nonvolatile memory 56, and the like are loaded. The system control unit 50 also performs display control by controlling the memory 32, the display unit 28, and the like.

[0029] The system timer 53 is a timing unit that measures the time used for various controls and the time of a built-in clock.

[0030] The various operation members as input units that accept operations from the user include at least the following operation units: Operation unit 70 includes the shutter button 61, MC 65, touch panel 70a, main electronic dial 71, sub electronic dial 73, cross key 74, SET button 75, movie button 76, AE lock button 77, enlarge button 78, playback button 79, and menu button 81. In addition, the mode change switch 60 and power switch 72 are also operation members that accept operations from the user.

[0031] The operation unit 70 , the mode changeover switch 60 , and the power switch 72 function as operation means for inputting various operational instructions to the system control unit 50 .

[0032] The mode changeover switch 60 changes the operation mode of the system control unit 50 to one of a still image shooting mode, a video shooting mode, etc. Modes included in the still image shooting mode include an auto shooting mode, an auto scene determination mode, a manual mode, an aperture priority mode (Av mode), a shutter speed priority mode (Tv mode), and a program AE mode (P mode). In addition, there are various scene modes and custom modes that are shooting settings according to shooting scenes. The mode changeover switch 60 allows the user to directly switch to one of these modes. Alternatively, after switching to a list screen of shooting modes with the mode changeover switch 60, one of the displayed modes may be selected and switched using other operating members. Similarly, the video shooting mode may also include multiple modes.

[0033] The shutter button 61 is a two-stage switch consisting of a first shutter switch 62 and a second shutter switch 64 .

[0034] The first shutter switch 62 is turned on and generates a first shutter switch signal SW1 when the shutter button 61 provided on the digital camera 100 is pressed halfway (instruction to prepare for shooting) during operation of the shutter button 61. The first shutter switch signal SW1 starts shooting preparation operations such as AF (autofocus) processing, AE (auto exposure) processing, AWB (auto white balance) processing, and EF (pre-flash) processing.

[0035] The second shutter switch 64 is turned on when the shutter button 61 is fully pressed (photographing instruction) and generates a second shutter switch signal SW2. The system control unit 50 starts a series of photographing processing operations, from reading out a signal from the imaging unit 22 to writing the captured image to the recording medium 200 as an image file, in response to the second shutter switch signal SW2.

[0036] The power supply control unit 80 is composed of a battery detection circuit, a DC-DC converter, a switch circuit for switching between blocks to which electricity is applied, etc., and detects whether a battery is attached, the type of battery, and the remaining battery power. The power supply control unit 80 also controls the DC-DC converter based on the detection results and instructions from the system control unit 50, and supplies the necessary voltage for the necessary period to each unit including the recording medium 200. The power supply unit 30 is composed of primary batteries such as alkaline batteries and lithium batteries, secondary batteries such as NiCd batteries, NiMH batteries, and Li batteries, an AC adapter, etc.

[0037] The recording medium I / F 18 is an interface with a recording medium 200 such as a memory card or a hard disk. The recording medium 200 is a recording medium such as a memory card for recording captured images, and is composed of a semiconductor memory, a magnetic disk, or the like.

[0038] The communication unit 54 is connected wirelessly or via a wired cable, and transmits and receives video signals and audio signals. The communication unit 54 can also be connected to a wireless LAN (Local Area Network) or the Internet. The communication unit 54 can also communicate with external devices via Bluetooth (registered trademark) or Bluetooth Low Energy. The communication unit 54 can transmit images (including live view images) captured by the imaging unit 22 and images recorded on the recording medium 200, and can also receive images and various other information from external devices.

[0039] The attitude detection unit 55 detects the attitude of the digital camera 100 with respect to the direction of gravity. Based on the attitude detected by the attitude detection unit 55, it is possible to determine whether the image captured by the imaging unit 22 was captured with the digital camera 100 held horizontally or vertically. The system control unit 50 can add orientation information corresponding to the attitude detected by the attitude detection unit 55 to the image file of the image captured by the imaging unit 22, or rotate and record the image. An acceleration sensor, a gyro sensor, or the like can be used as the attitude detection unit 55. It is also possible to detect the movement of the digital camera 100 (panning, tilting, lifting, whether it is stationary, etc.) using the acceleration sensor or gyro sensor that is the attitude detection unit 55.

[0040] The eye contact detection unit 57 is an eye contact detection sensor that detects the approach (eye contact) and departure (eye separation) of the eye (object) 161 to the eyepiece unit 16 of the finder (approach detection). The system control unit 50 switches between display (display state) and non-display (non-display state) of the display unit 28 and the EVF 29 according to the state detected by the eye contact detection unit 57. More specifically, when at least the digital camera 100 is in a shooting standby state and the switching setting of the display destination of the live view image captured by the imaging unit 22 is the automatic switching setting, the display destination is set to the display unit 28 and the display is turned on and the EVF 29 is turned off while the eye is not placed in contact. Also, when the eye is placed in contact, the display destination is set to the EVF 29 and the display is turned on and the display unit 28 is turned off. The eye contact detection unit 57 can be, for example, an infrared proximity sensor, and can detect the approach of some object to the eyepiece unit 16 of the finder that has the EVF 29 built in. When an object approaches, the infrared light projected from the light projecting section (not shown) of the eyepiece detection section 57 is reflected and received by the light receiving section (not shown) of the infrared proximity sensor. The amount of infrared light received can determine how close the object is to the eyepiece section 16 (eyepiece distance). In this manner, the eyepiece detection section 57 performs eyepiece detection to detect the proximity of the object to the eyepiece section 16. In this embodiment, the light projecting section and the light receiving section of the eyepiece detection section 57 are separate devices from the infrared light emitting diode 166 and the line of sight detection sensor 164 described above. However, the infrared light emitting diode 166 may also serve as the light projecting section of the eyepiece detection section 57. The line of sight detection sensor 164 may also serve as the light receiving section. When an object is detected approaching within a predetermined distance from the eyepiece section 16 from a non-eyepiece state (non-approaching state), it is detected that the eye has been placed in contact with the object. When an object that has been detected as approaching moves away from the eye-closed state (approaching state) by a distance greater than a predetermined distance, it is detected that the eye has been removed. The threshold for detecting eye-closedness and the threshold for detecting eye-removal may be different, for example, by providing hysteresis. In addition, after eye-closedness is detected, the eye-closed state is maintained until eye-removal is detected. After eye-removal is detected, the non-eye-closed state is maintained until eye-closedness is detected. Note that the infrared proximity sensor is only one example, and other sensors may be used for the eye-closedness detection unit 57 as long as they can detect the approach of an eye or object that can be considered as an eye-closed state.

[0041] The system control unit 50 can detect the following operations or states based on the output from the line of sight detection block 160. The gaze of the user who has placed his / her eye close to the eyepiece unit 16 has been newly input (detected). In other words, gaze input has started. The user is receiving gaze input by placing his / her eye on the eyepiece unit 16. The user is holding the eyepiece 16 close to the object and gazing at it. The user who placed his / her eye close to the eyepiece unit 16 moves his / her gaze away from the eye. In other words, the gaze input ends. A state in which the user has placed their eye in the eyepiece 16 but is not making any gaze input.

[0042] The term "gazing" as used herein refers to a case where the user's gaze position does not move beyond a predetermined amount within a predetermined period of time.

[0043] The touch panel 70a and the display unit 28 can be configured as one unit. For example, the touch panel 70a is configured so that the light transmittance does not interfere with the display of the display unit 28, and is attached to the upper layer of the display surface of the display unit 28. Then, input coordinates on the touch panel 70a are associated with display coordinates on the display screen of the display unit 28. This makes it possible to provide a GUI (Graphical User Interface) that allows the user to directly operate the screen displayed on the display unit 28. The system control unit 50 can detect the following operations or states on the touch panel 70a. A finger or pen that has not been touching the touch panel 70a touches the touch panel 70a again, that is, the start of touching (hereinafter referred to as touch-down). The touch panel 70a is in a state of being touched with a finger or a pen (hereinafter, referred to as Touch-On). Touching the touch panel 70a with a finger or a pen and moving it (hereinafter referred to as Touch-Move). The finger or pen that has been touching the touch panel 70a is released, that is, the touch ends (hereinafter, referred to as "touch-up"). A state in which nothing is being touched on the touch panel 70a (hereinafter referred to as Touch-Off).

[0044] When touch-down is detected, touch-on is also detected at the same time. After touch-down, touch-on will usually continue to be detected unless touch-up is detected. Touch-move is also detected while touch-on is detected. Even if touch-on is detected, touch-move will not be detected if the touch position has not moved. After it is detected that all fingers or pens that were touching have touched up, touch-off occurs.

[0045] These operations and states, as well as the position coordinates of the finger or pen touching the touch panel 70a, are notified to the system control unit 50 via the internal bus. The system control unit 50 determines what kind of operation (touch operation) has been performed on the touch panel 70a based on the notified information. For touch moves, the direction of movement of the finger or pen moving on the touch panel 70a can also be determined for each vertical and horizontal component on the touch panel 70a based on the change in the position coordinates. If a touch move of a predetermined distance or more is detected, it is determined that a slide operation has been performed. An operation in which a finger is touched on the touch panel, quickly moved a certain distance, and then released is called a flick. In other words, a flick is an operation in which a finger is quickly traced on the touch panel 70a as if flicking it. If a touch move of a predetermined distance or more at a predetermined speed or more is detected and a touch up is detected immediately, it can be determined that a flick has been performed (it can be determined that a flick has occurred following a slide operation). Furthermore, a touch operation in which multiple points (for example, two points) are touched simultaneously and the touch positions are brought closer together is called pinch in, and a touch operation in which the touch positions are moved away from each other is called pinch out. Pinch out and pinch in are collectively called pinch operation (or simply pinch). The touch panel 70a may be of any of various touch panel types, such as a resistive film type, a capacitive type, a surface acoustic wave type, an infrared type, an electromagnetic induction type, an image recognition type, and an optical sensor type. Depending on the type, there are types that detect a touch by contact with the touch panel, and types that detect a touch by the approach of a finger or a pen to the touch panel, and either type may be used.

[0046] When a touch-move operation is performed in the eye-closed state, the user can set the method of specifying the position of the position index according to the touch-move operation to either absolute position specification or relative position specification. For example, if the position index is an AF frame, in the case of absolute position specification, when the touch panel 70a is touched, an AF position corresponding to the touched position (position where the coordinates are input) is set. That is, the position coordinates where the touch operation is performed are associated with the position coordinates of the display unit 28. On the other hand, in the case of relative position specification, the position coordinates where the touch operation is performed are not associated with the position coordinates of the display unit 28. In the case of relative position specification, regardless of the touch-down position on the touch panel 70a, the touch position is moved from the currently set AF position in the direction of the touch-move movement by a distance corresponding to the amount of movement of the touch-move.

[0047] ●Settings screen FIG. 3 is a diagram relating to a menu for changing the setting values ​​displayed on the display unit 28 or the EVF 29. As shown in FIG.

[0048] FIG. 3(a) is a menu setting screen, and 301 to 305 indicate setting items and setting values.

[0049] The setting item 301 is the AF operation, and it is possible to set "One Shot AF", which locks the focus after AF is activated (after the shooting preparation command is given), or "Servo AF", which tracks the focus.

[0050] The setting item 302 is the AF area, which allows you to set the size of the area where AF is performed. If there are many settings, you can go deeper into the hierarchy and set them on a dedicated screen (Figure 3(b)). As shown in Figure 3(b), the user selects a setting value from the list of settings (306).

[0051] The setting item 303 is a tracking setting, which allows the user to set whether or not to perform tracking after AF is activated (after a shooting preparation command is issued). The subject to track is determined from the AF area before AF is activated (before a shooting preparation command is issued), and after AF is activated (after a shooting preparation command is issued), the size of the AF area is expanded to cover the entire screen to perform tracking. Also, if the main subject is detected by this setting, a detection frame is displayed around the main subject to notify the user. The determination of the main subject is determined by the setting of the subject to be detected 304.

[0052] The setting item 304 is a detection subject setting, and selects the type of target to be prioritized in determining the main subject. In this embodiment, as shown in FIG. 3(d), it is possible to set from "person", "animal priority", "vehicle priority" and "no priority" (310). Depending on the setting value, it is also possible to perform more detailed settings as shown in 311. Here, the image processing unit 24 can detect a specific subject using the captured image data. In this embodiment, the specific subject is a person, an animal such as a dog or a wild bird, a vehicle, and further a main area within the subject is detected (spot detection). For example, spot detection for a person is detection of the torso, head, pupils, and face. Also, for example, spot detection for an animal is detection of the pupils, face, and body. Also, for example, spot detection can be set when vehicle priority is selected, and the driver of a car, the leading car of a train, and the cockpit of an airplane are detected with priority. These detection methods use learning methods using machine learning and recognition processing using image processing.

[0053] For example, there are several types of machine learning: (1) Support Vector Machine (2) Convolutional Neural Network (3) Recurrent Neural Network

[0054] As an example of the recognition process, for example, when detecting a face, there is a method of extracting a skin color area from the gradation color of each pixel represented by image data and detecting the face based on the degree of matching with a face outline plate prepared in advance. There is also a method of detecting a face by extracting facial feature points such as the eyes, nose, and mouth using a well-known pattern recognition technology. Furthermore, the main area detection method applicable to the present invention is not limited to these methods, and other methods may be used.

[0055] As shown in FIG. 3( c), there is also a screen for simultaneously setting the AF area (309) and tracking (308). In this screen, a live view through image is displayed in the background, and the settings can be changed while viewing the AF area 307 display.

[0056] ●Button customization function FIG. 4 is a diagram relating to a menu for setting a button customization function for activating tracking and calling a function displayed on the display unit 28 or the EVF 29.

[0057] To customize the button for activating tracking, for example, as shown in 401 in FIG. 4(a), when the user aligns a cursor (index) indicating the position to be currently processed with an operating member (e.g., a button) on the screen to which the user wishes to assign it, the assignable function is displayed selectably as shown in 402 in FIG. 4(b). In this figure, "tracking start / stop" is assigned to the SET button. Tracking start / stop is a function that starts tracking based on the position of the AF area, regardless of the tracking setting, and a function that stops tracking that has started. This function can be activated while waiting to shoot (SW0), while AF is activated (while the first shutter switch is held, SW1 ON), and during servo AF continuous shooting (SW2 ON).

[0058] Also, for example, when the user places the cursor on the button on the screen to which the user wishes to assign a function, as in 403 in Fig. 4(c), the functions to be assigned are displayed in a selectable manner, as in 404 in Fig. 4(d). In this figure, "call registered function" is assigned to the AEL (AE lock) button.

[0059] The registered function call is a function that calls a function that the user has registered in advance. When the user presses 405 in FIG. 4(d), the detailed setting screen in FIG. 4(e) opens. 406 in FIG. 4(e) is a check box, and the user can register the function to be called by setting the setting item 407 and setting value 408 that he or she wants to call and checking 406. In the figure, the AF operation is registered as "one shot" and the call position is registered as "HP (home position)". Note that when each item is being set, other items may be displayed as grayed out to indicate that they cannot be registered. For example, in FIG. 4(e), the AF area is displayed as grayed out to indicate that they cannot be registered. Also, if the user does not check the box, such as the tracking setting or spot detection in FIG. 4(e), the current setting value is not changed.

[0060] ● Shooting information display and icons showing settings FIG. 5 is a diagram for explaining the shooting information display and icons indicating setting values ​​displayed on the display unit 28 or the EVF 29. As shown in FIG.

[0061] 5(a) is an example of the display screen of the display unit 28. Reference numeral 501 denotes an icon indicating the AF area and tracking settings, 502 denotes an AF operation setting, 503 denotes a setting for the subject to be detected, and 504 denotes an icon indicating the setting for pupil detection. Reference numeral 505 denotes an icon indicating the tracking activation status. By checking 501 to 505, the current settings and status can be known.

[0062] Fig. 5(b) is an example of a list of icon displays. An icon expressed by a combination of the AF area and tracking settings, such as icon 506, is displayed in 501. Icons prepared according to setting values, such as icons 507, 508, and 509, are displayed in 502 to 504. An icon indicating the tracking control status, such as icon 510, is displayed in 505.

[0063] ●Frame display before and after AF activation FIG. 6 shows frame displays displayed on the display unit 28 or EVF 29 before and after AF is activated.

[0064] In Figure 6, the frame display before and after AF is different, but it can be the same. Also, the AF operation can be distinguished by color, such as green for One Shot AF and blue for Servo AF.

[0065] Reference numeral 601 denotes the AF area frame that represents a narrow area such as a spot, single point, or area expansion. Before AF is activated, it is a rectangle, and after AF is activated, it becomes a thick rectangle like 602.

[0066] Reference numeral 603 denotes an AF area frame that represents a wide area such as a zone or the entire area. Before AF is activated, an area 603 surrounded by brackets [] is displayed, and after AF is activated, small rectangular frames such as 604 are displayed for only the parts of the area 603 that are in focus. Multiple rectangular frames 604 can be displayed within the area. Also, when representing the entire area of ​​the screen, such as the entire area, the brackets 603 may not be displayed before AF is activated.

[0067] Reference numeral 605 denotes a detection frame. This is a frame displayed for a subject that is automatically detected depending on the setting of the specific subject to be detected. In the figure, the setting is "person," and a frame is displayed for a person's face. Depending on the setting of the eye detection, it is also possible to display the detection frame 605 in the eye area. Also, when the setting is "animal" or "vehicle," a detection frame is displayed for the whole body or face of an animal or vehicle. After AF is activated, a rectangular frame 606 is displayed in accordance with the detection frame 605. In this embodiment, it is represented by a dotted line to distinguish it from 602. The detection frame can be updated every frame to track the subject, but the frame position is fixed at the focused position only after one-shot AF is activated.

[0068] Reference numeral 607 denotes a tracking frame. This is displayed when the user selects the detection frame 605 or when the user selects a tracking target through a user operation. There are multiple selection operations by the user, such as selection based on the operation position on the touch panel 70a, selection by a tracking start operation, and selection by a cross button from multiple detection frames. After AF is activated, it is represented by a dotted double rectangle (608). Like the detection frame, the tracking frame can be updated for each frame to track the subject, but the frame position is fixed at the focused position only after one-shot AF is activated.

[0069] Frame expression according to the combination of AF area and tracking settings FIG. 7 is a diagram showing frame expressions according to combinations of AF areas and tracking settings.

[0070] The combinations of AF areas when tracking is "not" are states 7-A to I, and the combinations of AF areas when tracking is "on" are states 7-J to R, which illustrate the conditions under which the "AF area frame," "detection frame," and "tracking frame" are active, respectively.

[0071] First, the cases of "no tracking" in states 7-A to 7-I will be described.

[0072] When the AF area frame is activated, an AF area frame according to each setting, such as a one-point AF area frame 701 or a zone AF area frame 702, is displayed (7-A, 7-B, 7-C).

[0073] When tracking is "off," subject detection processing is not performed, so the detection frame never becomes active. For this reason, the frame is not displayed in states 7-D, 7-E, and 7-F. For the sake of explanation, the screen is grayed out in states 7-D, 7-E, and 7-F in Figure 7, but live view display is still performed.

[0074] Furthermore, when a subject is selected by the user, a tracking frame 703 is displayed (7-G, 7-H, 7-I). The tracking frame here corresponds to a tracking frame when tracking is started based on the operation position on the touch panel 70a, a tracking frame when tracking is started based on the operation position for starting tracking, etc.

[0075] Next, the cases where tracking is "on" in states 7-J to 7-R will be described.

[0076] In states 7-J to 7-O, if tracking is enabled and the main subject is detected, both the AF area frame and the detection frame are displayed, and the frame that is actually focused on when AF is activated is made active. If the main subject is not detected, only the AF area frame is displayed, which is the same as the tracking disabled pattern.

[0077] When the main subject is detected and AF is activated, the frame to be actually focused on is selected as follows.

[0078] First, when the detection frame does not overlap the AF area frame, the AF area frame becomes active (7-J, 7-K, 7-L). When the AF area is the entire screen, the entire AF area becomes active (7-L) as well, since the detection frame does not overlap the AF area frame and a subject is not detected within the AF area, but the frame is not displayed because the AF area is the entire screen. For this reason, the screen is grayed out for the sake of explanation, but the live view display is still performed. When the AF area frame becomes active, the AF area frames (704) and (706) are displayed with solid lines, and the detection frame is represented by a transparent line (705). When AF is activated, the AF area frame is used to adjust the focus.

[0079] Next, when the detection frame overlaps with the AF area frame, the detection frame becomes active (7-M, 7-N, 7-O). Note that in the case of eye detection or spot detection, even if the eye or spot does not overlap with the AF area, the detection frame may become active if the entire body that makes up the face or subject overlaps with the AF area frame. When the detection frame is active, it is represented by a solid line (707) and the AF area frame is represented by a transparent line (708).

[0080] When a subject is selected by the user and tracking is "on," if the main subject is detected, the tracking frame is active during tracking (7-P, 7-Q, 7-R) ​​and only the tracking frame is displayed (709). Also, if the main subject is not detected, the tracking frame is displayed in the same way as in the "not tracking" pattern.

[0081] ● State transition in case of servo AF FIG. 8 is a diagram showing state transitions in the case of servo AF.

[0082] States 8-A to 8-R in FIG. 8(a) are state transitions when tracking is set "on", and states 8-a to 8-r in FIG. 8(b) are state transitions when tracking is not set "on".

[0083] <When tracking> 8-A indicates the shooting standby state (SW0), and 801 to 805 are icons indicating setting values ​​and status values. Here, 1-point AF x tracking is performed (801), the AF operation is servo AF (802), the subject to be detected is a person (803), eye detection is OFF (804), and the tracking state is OFF (805). 806 is the AF area frame, and 807 is the detection frame, and because the detection frame overlaps with the AF area, the detection frame becomes active and the AF area frame becomes inactive. If a "tracking start operation" is performed in this state, proceed to 8-B, and if an AF operation (shooting preparation operation SW1) is performed, proceed to 8-G.

[0084] 8-B updates the tracking frame 808 according to the movement of the subject. Also, the icon 805 switches to ON. In this state, if the "stop tracking" operation is performed, the flow returns to 8-A, and if the AF operation (shooting preparation operation SW1) is performed, the flow proceeds to 8-G.

[0085] 8-C updates the tracking frame 809 in accordance with the movement of the subject. If a "stop tracking" operation is performed here, proceed to 8-D, and if an AF operation (shooting preparation operation SW1) is performed, proceed to 8-H.

[0086] In 8-D, 810 is the AF area frame and 811 is the detection frame, and here the AF area frame is active. If a "frame movement operation" is performed in this state, the process proceeds to 8-E.

[0087] In 8-E, 812 is the AF area frame and 813 is the detection frame, and here the AF area frame is active. If the "tracking start" operation is performed in this state, proceed to 8-F, and if the AF operation is performed, proceed to 8-K.

[0088] 8-F updates the tracking frame 814 according to the movement of the subject. Also, the icon 805 switches to ON. In this state, if the "stop tracking" operation is performed, the process returns to 8-E, and if the AF operation (shooting preparation operation SW1) is performed, the process proceeds to 8-K.

[0089] 8-G continues to adjust the focus while updating the tracking frame 815 according to the movement of the subject (continuous AF). Also, the icon 805 switches to ON. In this state, if the subject to be tracked moves, it proceeds to 8-H, if the "stop tracking" operation is performed, it proceeds to 8-Q, if AF is released (release of shooting preparation operation SW1), it returns to 8-A, and if shooting operation (SW2) is performed, it proceeds to 8-L.

[0090] In 8-Q, the camera continues to focus using AF area 826. The tracking state is OFF. If a shooting operation (SW2) is performed in this state, the camera proceeds to 8-R.

[0091] 8-H continues to adjust the focus while updating the tracking frame 816 according to the movement of the subject. In this state, if a "stop tracking" operation is performed, the flow advances to 8-I, if a shooting operation (SW2) is performed, the flow advances to 8-M, and if AF is released (release of the shooting preparation operation SW1), the flow returns to 8-D.

[0092] In 8-I, the focus continues to be adjusted using the AF area 817. The tracking state is OFF. In this state, if a shooting operation (SW2) is performed, the flow advances to 8-N, and if AF is released (release of the shooting preparation operation SW1), the flow returns to 8-D.

[0093] In 8-J, the AF area 818 moves in response to user operation. When moving, the focus remains within the area. If a shooting operation (SW2) is performed in this state, the process proceeds to 8-O, if AF is released (release of shooting preparation operation SW1), the process returns to 8-E, and if a "start tracking" operation is performed, the process proceeds to 8-K.

[0094] 8-K continues to adjust the focus while updating the tracking frame 819 according to the movement of the subject. In this state, if the "stop tracking" operation is performed, the flow returns to 8-J, if the shooting operation (SW2) is performed, the flow proceeds to 8-P, and if AF is released (release of the shooting preparation operation SW1), the flow returns to 8-E or 8-F.

[0095] In 8-L, the camera continues to focus while updating the tracking frame 821 in response to the movement of the subject and takes a picture. The display 820 indicates that shooting is in progress. If continuous shooting is set, shooting continues while tracking the focus position. In this state, if the subject to be tracked moves, the camera proceeds to 8-M, and if the shooting operation (SW2) is released, the camera returns to 8-G, and if the "stop tracking" operation is performed, the camera returns to 8-R.

[0096] In 8-R, the camera continues to focus on the AF area 827 and takes pictures. The tracking state is OFF. In this state, if the "Start Tracking" operation is performed, the camera advances to 8-L, and if the shooting operation (SW2) is released, the camera returns to 8-Q.

[0097] In 8-M, the camera continues to focus on the subject while updating the tracking frame 822 in response to the subject's movement and takes a picture. If the shooting operation (SW2) is released in this state, the camera returns to 8-H, and if the "stop tracking" operation is performed, the camera proceeds to 8-N.

[0098] In 8-N, shooting is performed while continuing to focus using AF area 823. The tracking state is OFF. In this state, if a "frame movement" operation is performed, the flow advances to 8-O, and if the shooting operation (SW2) is released, the flow returns to 8-I.

[0099] In 8-O, shooting is performed by continuing to adjust the focus in the AF area 824. In this state, when the shooting operation (SW2) is released, the flow returns to 8-J, and when the "start tracking" operation is performed, the flow proceeds to 8-P.

[0100] In 8-P, the camera continues to focus on the subject while updating the tracking frame 825 in response to the subject's movement and takes a picture. If you release the shooting operation (SW2) in this state, the camera returns to 8-K, and if you perform the "stop tracking" operation, the camera returns to 8-O.

[0101] <If you don't want to track> Figure 8 -a indicates the shooting standby state, and 801a to 805a are icons indicating setting values ​​and status values. In this example, 1-point AF x tracking is performed (801a), the AF operation is servo AF (802a), the subject to be detected is a person (803a), eye detection is OFF (804a), and the tracking state is OFF (805a). 806a is the AF area frame. If a "tracking start operation" is performed in this state, proceed to 8-b, and if an AF operation (shooting preparation operation SW1) is performed, proceed to 8-q.

[0102] 8-b updates the tracking frame 808a according to the movement of the subject. Also, the icon 805a switches to ON. In this state, if the "stop tracking" operation is performed, the flow returns to 8-a, and if the AF operation (shooting preparation operation SW1) is performed, the flow proceeds to 8-g.

[0103] In step 8-c, the tracking frame 809a is updated according to the movement of the subject. If a "stop tracking" operation is performed here, the process proceeds to step 8-d, and if an AF operation (shooting preparation operation SW1) is performed, the process proceeds to step 8-h.

[0104] In 8-d, 810a is the AF area frame. If a "frame movement operation" is performed in this state, the process proceeds to 8-e.

[0105] In 8-e, 812a is the AF area frame. If the "Start Tracking" operation is performed in this state, proceed to 8-f, and if the AF operation is performed, proceed to 8-j.

[0106] 8-f updates the tracking frame 814a according to the movement of the subject. Also, the icon 805a switches to ON. In this state, if the "stop tracking" operation is performed, the process returns to 8-e, and if the AF operation (shooting preparation operation SW1) is performed, the process proceeds to 8-k.

[0107] 8-g continues to adjust the focus while updating the tracking frame 815a according to the movement of the subject. Also, the icon 805a switches to ON. In this state, if the subject to be tracked moves, it proceeds to 8-h, if the "stop tracking" operation is performed, it proceeds to 8-q, if AF is canceled, it returns to 8-b, and if a shooting operation (SW2) is performed, it proceeds to 8-l.

[0108] In 8-q, the focus is kept adjusted using AF area 826a. The tracking state is OFF. If a shooting operation (SW2) is performed in this state, the process proceeds to 8-r.

[0109] In 8-h, the camera continues to adjust the focus while updating the tracking frame 816a according to the movement of the subject. In this state, if the "stop tracking" operation is performed, the camera proceeds to 8-i, if the shooting operation (SW2) is performed, the camera proceeds to 8-m, and if the AF is released (release of the shooting preparation operation SW1), the camera returns to 8-d.

[0110] In 8-i, the focus is kept adjusted in AF area 817a. The tracking state is OFF. In this state, if a shooting operation (SW2) is performed, the flow advances to 8-n, and if AF is released (release of shooting preparation operation SW1), the flow returns to 8-d.

[0111] In 8-j, the AF area 818a is moved in response to user operation. When moving, the focus is kept within the area. In this state, if a shooting operation (SW2) is performed, the process proceeds to 8-o, if AF is released (release of shooting preparation operation SW1), the process returns to 8-e, and if a "start tracking" operation is performed, the process proceeds to 8-k.

[0112] 8-k continues to adjust the focus while updating the tracking frame 819a according to the movement of the subject. In this state, if the "stop tracking" operation is performed, the flow returns to 8-j, if the shooting operation (SW2) is performed, the flow proceeds to 8-p, and if the AF is released (release of the shooting preparation operation SW1), the flow returns to 8-e or 8-f.

[0113] In 8-l, the camera continues to focus while updating the tracking frame 821a according to the movement of the subject and takes a picture. You can tell that shooting is in progress by the display of 820a. If continuous shooting is set, shooting will continue while tracking the focus position. In this state, if the subject to be tracked moves, the camera proceeds to 8-m, and if the shooting operation (SW2) is released, the camera returns to 8-g, and if the "stop tracking" operation is performed, the camera returns to 8-r.

[0114] In 8-r, the camera continues to focus using AF area 827a and takes a picture. The tracking state is OFF. In this state, if the "Start Tracking" operation is performed, the camera advances to 8-l, and if the shooting operation (SW2) is released, the camera returns to 8-q.

[0115] In 8-m, the camera continues to focus while updating the tracking frame 822a according to the movement of the subject and takes a picture. In this state, if you cancel the shooting operation (SW2), the camera returns to 8-h, and if you perform the "stop tracking" operation, the camera returns to 8-n. move on .

[0116] In 8-n, the camera continues to focus on the AF area 823a and takes a picture. The tracking state is OFF. In this state, if the "frame movement" operation is performed, the camera advances to 8-o, and if the shooting operation (SW2) is released, the camera returns to 8-i.

[0117] In 8-o, the camera continues to focus on the AF area 824a and takes a picture. If the shooting operation (SW2) is released in this state, the camera returns to 8-j, and if the "Start Tracking" operation is performed, the camera proceeds to 8-p.

[0118] In 8-p, the camera continues to focus while updating the tracking frame 825a according to the movement of the subject and takes a picture. In this state, if you cancel the shooting operation (SW2), the camera returns to 8-k, and if you perform the "stop tracking" operation, the camera returns to 8-o.

[0119] ● State transition in case of one-shot AF FIG. 9 is a diagram showing state transitions in the case of one-shot AF.

[0120] States 9-A to 9-O in FIG. 9(a) are state transitions when tracking is set "on," and states 9-a to 9-o in FIG. 9(b) are state transitions when tracking is set "off."

[0121] <When tracking> In 9-A, 901 to 905 are icons indicating setting values ​​and status values. Here, 1-point AF x tracking is enabled (901), the AF operation is one-shot AF (902), the subject to be detected is a person (903), eye detection is OFF (904), and the tracking status is OFF (905). 906 is the AF area, and 907 is the detection frame. As the detection frame overlaps with the AF area, the detection frame becomes active and the AF area frame becomes inactive. If the "start tracking" operation is performed in this state, proceed to 9-B, and if an AF operation (shooting preparation operation SW1) is performed, proceed to 9-F.

[0122] In 9-B, the subject is tracked using a tracking frame 908. The icon 905 switches to ON. In this state, if the "stop tracking" operation is performed, the process returns to 9-A, if the AF operation (shooting preparation operation SW1) is performed, the process proceeds to 9-G, and if the subject moves in the XY direction of the screen, the process proceeds to 9-C.

[0123] In 9-C, the tracking frame 909 is updated in accordance with the movement of the subject. If a "stop tracking" operation is performed in this state, proceed to 9-D, and if an AF operation (shooting preparation operation SW1) is performed, proceed to 9-H.

[0124] In 9-D, 910 is the AF area and 911 is the detection frame. Because the detection frame is outside the AF area, the AF area frame is active and the detection frame is inactive. If the "Start Tracking" operation is performed in this state, proceed to 9-E, and if the AF operation (shooting preparation operation SW1) is performed, proceed to 9-I.

[0125] In 9-E, the tracking frame 912 is updated according to the movement of the subject being tracked. The icon 905 is switched to ON. In this state, if the "stop tracking" operation is performed, the process returns to 9-D, and if the AF operation (shooting preparation operation SW1) is performed, the process proceeds to 9-J.

[0126] In 9-F, one-shot AF is performed in the detection frame 913, and the focus position is locked. In this state, if a shooting operation (SW2) is performed, the flow advances to 9-K, and if a "tracking start" operation is performed, the flow advances to 9-G. When the AF operation (shooting preparation operation SW1) is released, the flow returns to 9-A.

[0127] In 9-G, one-shot AF is performed using the tracking frame 914, and the focus position is locked. In this state, if the "stop tracking" operation is performed, the flow returns to 9-F, if a shooting operation (SW2) is performed, the flow proceeds to 9-L, and if the AF operation (shooting preparation operation SW1) is released, the flow returns to 9-B.

[0128] In 9-H, one-shot AF is performed and the focus position is locked using the tracking frame 915. If the "stop tracking" operation is performed in this state, the flow proceeds to 9-I, if a shooting operation (SW2) is performed, the flow proceeds to 9-M, and if the AF operation (shooting preparation operation SW1) is released, the flow returns to 9-C.

[0129] In 9-I, one-shot AF is performed in AF area 916, and the focus position is locked. If the "start tracking" operation is performed in this state, the flow proceeds to 9-J, if a shooting operation (SW2) is performed, the flow proceeds to 9-N, and if the AF operation (shooting preparation operation SW1) is released, the flow returns to 9-D.

[0130] In 9-J, one-shot AF is performed using the tracking frame 917, and the focus position is locked. The icon 905 switches to ON. If the "stop tracking" operation is performed in this state, the flow returns to 9-I, and if a shooting operation (SW2) is performed, the flow proceeds to 9-O. If the AF operation (shooting preparation operation SW1) is released, the flow returns to 9-E.

[0131] In 9-K, shooting is performed with the focus position locked. At this time, the detection frame 913 is hidden. 918 is an expression indicating that shooting is in progress. In this state, operations such as "stop tracking" cannot be performed, and when shooting operation (SW2) is released, it returns to 9-F.

[0132] In the 9-L, shooting is performed with the focus position locked. At this time, the detection frame of the 914 is hidden. In this state, operations such as "stop tracking" cannot be performed, and when shooting operation (SW2) is released, it returns to the 9-G.

[0133] In 9-M, the focus position is locked while shooting. At this time, the tracking frame of the 915 is hidden. In this state, operations such as "stop tracking" cannot be performed, and when shooting operation (SW2) is released, it returns to 9-H.

[0134] In the 9-N, the focus position is locked while shooting. At this time, the AF area of ​​the 916 is hidden. In this state, operations such as "stop tracking" cannot be performed, and when shooting operation (SW2) is released, it returns to the 9-I.

[0135] In the 9-O, the focus position is locked while shooting. At this time, the tracking frame of the 917 is hidden. In this state, operations such as "stop tracking" cannot be performed, and when shooting operation (SW2) is released, it returns to the 9-J.

[0136] <If you don't want to track> In 9-a, 901a to 905a are icons indicating setting values ​​and status values. Here, 1-point AF x no tracking (901a), AF operation is one-shot AF (902a), the subject to be detected is a person (903a), eye detection is OFF (904a), and tracking status is OFF (905a). 906a is the AF area. If the "tracking start" operation is performed in this state, proceed to 9-b, and if the AF operation (shooting preparation operation SW1) is performed, proceed to 9-f.

[0137] In 9-b, the subject is tracked using a tracking frame 907a. a The icon will switch to ON. If the "Stop Tracking" operation is performed in this state, the process will return to 9-a, if the AF operation (shooting preparation operation SW1) is performed, the process will proceed to 9-g, and if the subject moves in the XY direction of the screen, the process will proceed to 9-c.

[0138] In 9-c, the tracking frame 908a is updated according to the movement of the subject. In this state, if a "stop tracking" operation is performed, the process proceeds to 9-d, and if an AF operation (shooting preparation operation SW1) is performed, the process proceeds to 9-h.

[0139] In 9-d, 909a is the AF area. If a "tracking start" operation is performed in this state, the process proceeds to 9-e, and if an AF operation (shooting preparation operation SW1) is performed, the process proceeds to 9-i.

[0140] In step 9-e, the tracking frame 910a is updated in accordance with the movement of the subject to be tracked. a The icon will switch to ON. If the "Tracking Stop" operation is performed in this state, return to 9-d, and if the AF operation (shooting preparation operation SW1) is performed, proceed to 9-j.

[0141] In 9-f, one-shot AF is performed in AF area 911a and the focus position is locked. In this state, if a shooting operation (SW2) is performed, the flow advances to 9-k, and if a "tracking start" operation is performed, the flow advances to 9-g. When the AF operation (shooting preparation operation SW1) is released, the flow returns to 9-a.

[0142] In 9-g, one-shot AF is performed with the tracking frame 912a, and the focus position is locked. In this state, if the "stop tracking" operation is performed, the flow returns to 9-f, if the shooting operation (SW2) is performed, the flow proceeds to 9-l, and if the AF operation (shooting preparation operation SW1) is released, the flow returns to 9-b.

[0143] In 9-h, one-shot AF is performed with the tracking frame 913a, and the focus position is locked. In this state, if the "stop tracking" operation is performed, the flow proceeds to 9-i, if the shooting operation (SW2) is performed, the flow proceeds to 9-m, and if the AF operation (shooting preparation operation SW1) is released, the flow returns to 9-c.

[0144] In 9-i, one-shot AF is performed in AF area 914a and the focus position is locked. In this state, if the "Start Tracking" operation is performed, the flow advances to 9-j, if a shooting operation (SW2) is performed, the flow advances to 9-n, and if the AF operation (shooting preparation operation SW1) is released, the flow returns to 9-d.

[0145] In 9-j, one-shot AF is performed using the tracking frame 915a, and the focus position is locked. a The icon will switch to ON. If the "stop tracking" operation is performed in this state, the process will return to 9-i, and if a shooting operation (SW2) is performed, the process will proceed to 9-o. If the AF operation (shooting preparation operation SW1) is canceled, the process will return to 9-e.

[0146] In 9-k, the focus position is locked while shooting. At this time, the AF area of ​​911a is hidden. 916a is an expression that indicates that shooting is in progress. In this state, operations such as "stop tracking" cannot be performed, and when the shooting operation (SW2) is released, it returns to 9-f.

[0147] In 9-l, the focus position is locked while shooting. At this time, the tracking frame of 912a is hidden. In this state, operations such as "stop tracking" cannot be performed, and when shooting operation (SW2) is released, it returns to 9-g.

[0148] In 9-m, the focus position is locked while shooting. At this time, the tracking frame of the 913a is hidden. In this state, operations such as "stop tracking" cannot be performed, and when shooting operation (SW2) is released, it returns to 9-h.

[0149] In the 9-n, the focus position is locked while shooting. At this time, the AF area of ​​the 914a is hidden. In this state, operations such as "stop tracking" cannot be performed, and when the shooting operation (SW2) is released, it returns to the 9-i.

[0150] In 9-o, the focus position is locked while shooting. At this time, the tracking frame of 915a is hidden. In this state, operations such as "stop tracking" cannot be performed, and when shooting operation (SW2) is released, it returns to 9-j.

[0151] ●Control flow for servo AF 10 is a flowchart showing control in the case of servo AF. Each process is realized by the system control unit 50 expanding a program stored in the non-volatile memory 56 into the system memory 52 and executing it.

[0152] The processing and control of the following flowcharts are performed by the system control unit 50.

[0153] In S1001, the tracking start position is read from a storage area (memory).

[0154] In S1002, it is determined whether or not a movement operation of the tracking start position has been performed. If a movement operation has been performed, the process proceeds to S1003, and if not, the process proceeds to S1004. Examples of the movement operation according to the embodiment include frame movement using an eight-way key or a cross button, frame movement by touch, and the like.

[0155] In S1003, the tracking start position is updated based on the movement operation of the tracking start position (e.g., from 8-D to E).

[0156] In S1004, it is determined whether or not a tracking start operation has been performed. If a tracking start operation has been performed, the process proceeds to S1005, and if not, the process proceeds to S1006. An example of the tracking start operation according to the embodiment is "Start Tracking" of the button customization function.

[0157] In S1005, the camera detects the subject from the tracking start position, determines the main subject, and starts tracking. When tracking starts, the tracking start position (AF area frame) is hidden and the tracking frame is displayed. (Example: 8-E to F)

[0158] In S1006, it is determined whether tracking is being continued. If tracking is being continued, the process proceeds to S1007, and if tracking is not being continued, the process proceeds to S1008.

[0159] In S1007, the tracking frame is updated. The tracking frame is updated according to the movement of the subject. (Example: 8-B to C)

[0160] In S1008, it is determined whether or not a tracking stop operation has been performed. If a tracking stop operation has been performed, the process proceeds to S1009, and if not, the process proceeds to S1010.

[0161] In S1009, the tracking frame is stopped. At this time, the tracking frame is hidden and the tracking start position (AF area frame) is displayed. At this time, the stored tracking start position is read out and set. (Example: 8-C to D)

[0162] In S1010, it is determined whether or not a shooting preparation operation has been performed. If a shooting preparation operation has been performed, the process proceeds to S1011. If not, the process proceeds to S103. 6 Proceed to step 10. Examples of the shooting preparation operations include SW1 and SW2 operations. (Example: 8-A to J)

[0163] In S1011, the position change flag and the automatic tracking flag controlled within the flow are turned OFF.

[0164] In S1012, the tracking start position is temporarily stored in a memory. In the flow, this is defined as the start position Temp.

[0165] In S1013, it is determined whether to start tracking (automatic tracking) according to the tracking setting. The determination condition is when, in a non-tracking state, the tracking setting is set to "on" and the state transitions from a shooting standby state to a shooting preparation state. If automatic tracking is to be started, the process proceeds to S1014, and if not, the process proceeds to S1016.

[0166] In S1014, the camera detects the subject from the tracking start position, determines the main subject, and starts tracking. When tracking starts, the tracking start position (AF area frame) is hidden and the tracking frame is displayed. (Example: 8-A to G) In S1015, the automatic tracking flag is turned ON.

[0167] In S1016, it is determined whether or not a movement operation of the tracking start position has been performed. If a movement operation has been performed, the process proceeds to S1017, and if not, the process proceeds to S1019. Examples of the movement operation according to the embodiment include frame movement using an eight-way key or a cross button, frame movement by touch, and the like.

[0168] In S1017, the tracking start position is updated based on the movement operation of the tracking start position (e.g., from 8-I to J).

[0169] In S1018, the position change flag is turned ON.

[0170] In S1019, it is determined whether or not a tracking start operation has been performed. If a tracking start operation has been performed, the process proceeds to S1020, and if not, the process proceeds to S1021. An example of the tracking start operation according to the embodiment is "Start Tracking" of the button customization function.

[0171] In S1020, the camera detects the subject from the tracking start position, determines the main subject, and starts tracking. When tracking starts, the tracking start position (AF area frame) is hidden and the tracking frame is displayed. (Example: 8-J to K)

[0172] In S1021, it is determined whether tracking is being continued. If tracking is being continued, the process proceeds to S1022, and if tracking is not being continued, the process proceeds to S1023.

[0173] In S1022, the tracking frame is updated. The tracking frame is updated according to the movement of the subject. (Example: from 8-G to H)

[0174] In S1023, it is determined whether or not a tracking stop operation has been performed. If a tracking stop operation has been performed, the process proceeds to S1024, and if not, the process proceeds to S1027.

[0175] In S1024, the center position of the tracking frame being tracked is set as the tracking start position. This is a characteristic process of the present embodiment, and such a process is performed since importance is placed on the continuity of tracking in the shooting preparation state.

[0176] In S1025, the tracking frame is stopped. At this time, the tracking frame is hidden and the tracking start position (AF area frame) is displayed at the position set in S1024. (Example: 8-H to I)

[0177] In S1026, the automatic tracking flag is turned OFF. Note that in the second embodiment, the process in S1026 is not performed, and the tracking in S1014 is clarified and the control is changed to provide easy-to-understand specifications.

[0178] In S1027, it is determined whether or not to perform AF operation. If AF operation is to be performed, the process proceeds to S1028, and if not, the process proceeds to S1029.

[0179] In S1028, an AF operation is performed. An example of the AF operation according to the embodiment is a servo operation. In the case of a servo operation, the servo operation is executed every time to track the focus.

[0180] In S1029, it is determined whether or not a shooting operation has been performed. If a shooting operation has been performed, the process proceeds to S1030, and if not, the process proceeds to S1031.

[0181] In S1030, a shooting operation is performed. In this embodiment, shooting is performed with SW2. (Example: 8-G to L) In S1031, it is determined whether the shooting preparation state has been released. If the shooting preparation state has been released, the process proceeds to S1032, and if not, the process returns to S1016.

[0182] In S1032, the state of the automatic tracking flag is determined. If the flag is ON, the process proceeds to S1033, and if the flag is OFF, the process proceeds to S1034.

[0183] In S1033, the tracking frame is stopped. At this time, the tracking frame is hidden and the tracking start position (AF area frame) is displayed at the position set in S1024. (Example: from 8-G to A) In S1034, the state of the position change flag is determined. If the position change flag is ON, the process proceeds to S1036 (e.g., from 8-J to E), and if the flag is OFF, the process proceeds to S1035.

[0184] In S1035, the tracking start position is set to the start position Temp (e.g., from 8-I to D). In S1036, it is determined whether or not this flow is to be ended. If it is to be ended, the process proceeds to S1037, and if it is not to be ended, the process returns to S1002.

[0185] In S1037, the tracking start position is stored in a storage area (memory) and the process ends.

[0186] ●Control flow for one-shot AF 11 is a flowchart showing the control in the case of one-shot AF. Each process is realized by the system control unit 50 expanding a program stored in the non-volatile memory 56 into the system memory 52 and executing it.

[0187] The processing and control of the following flowcharts are performed by the system control unit 50.

[0188] In S1101, the tracking start position (AF area) is read out from the storage area (memory).

[0189] In S1102, it is determined whether or not a movement operation of the tracking start position has been performed. If a movement operation has been performed, the process proceeds to S1103, and if not, the process proceeds to S1104. Examples of the movement operation according to the embodiment include frame movement using an eight-way key or a cross button, frame movement by touch, and the like.

[0190] In S1103, the tracking start position is updated based on the movement operation of the tracking start position.

[0191] In S1104, it is determined whether or not a tracking start operation has been performed. If a tracking start operation has been performed, the process proceeds to S1105, and if not, the process proceeds to S1106. An example of the tracking start operation according to the embodiment is "Start Tracking" of the button customization function.

[0192] In S1105, the camera detects the subject from the tracking start position, determines the main subject, and starts tracking. When tracking starts, the tracking start position (AF area frame) is hidden and the tracking frame is displayed. (Example: 9-D to E, a to b)

[0193] In S1106, it is determined whether tracking is being continued. If tracking is being continued, the process proceeds to S1107, and if tracking is not being continued, the process proceeds to S1108.

[0194] In S1107, the tracking frame is updated. The tracking frame is updated according to the movement of the subject. (Example: 9-B to C)

[0195] In S1108, it is determined whether or not a tracking stop operation has been performed. If a tracking stop operation has been performed, the process proceeds to S1109, and if not, the process proceeds to S1110.

[0196] In S1109, the tracking frame is stopped. At this time, the tracking frame is hidden and the tracking start position (AF area frame) is displayed. At this time, the stored tracking start position is read out and set. (Example: from 9-C to D)

[0197] In S1110, it is determined whether or not a shooting preparation operation has been performed. If a shooting preparation operation has been performed, S1 1 Go to 11, if not, go to S1 123 Proceed to step 10. Examples of the shooting preparation operations include SW1 and SW2 operations. (Example: 9-A to F)

[0198] In S1111, it is determined whether or not a movement operation of the tracking start position has been performed. If a movement operation has been performed, S1 112 If there is no movement operation, proceed to S1 113 In one embodiment, the movement operation is a return-to-center operation. In another embodiment, the movement may be performed using an eight-way operation member.

[0199] In S1112, the tracking start position is updated based on the movement operation of the tracking start position.

[0200] In S1113, it is determined whether or not a tracking start operation has been performed. If a tracking start operation has been performed, the process proceeds to S1114, and if not, the process proceeds to S1115. An example of the tracking start operation according to the embodiment is "Start Tracking" of the button customization function.

[0201] In S1114, the subject is detected from the tracking start position and the main subject is locked. When the subject is locked, the tracking start position (AF area frame) is hidden and the tracking frame is displayed. (Example: 9-f to g)

[0202] In S1115, it is determined whether or not a tracking stop operation has been performed. If a tracking stop operation has been performed, the process proceeds to S1116, and if not, the process proceeds to S1117.

[0203] In S1116, the main subject lock is released. When released, the internal tracking state is also turned OFF. (Example: 9-g to f)

[0204] In S1117, it is determined whether or not to perform AF operation. If AF operation is to be performed, the process proceeds to S1118, and if not, the process proceeds to S1119.

[0205] In S1118, AF operation is performed. The AF operation according to the embodiment may be a one-shot operation. In the case of a one-shot operation, the AF operation is performed once in the shooting preparation state, and the focus position is locked after focusing. (Examples 9-a to 9-f)

[0206] In S1119, it is determined whether or not a shooting operation has been performed. If a shooting operation has been performed, the process proceeds to S1120, and if not, the process proceeds to S1122.

[0207] In S1120, a shooting operation is performed. In this embodiment, shooting is performed with SW2. (Example: 8-F to K)

[0208] In S1121, it is determined whether the shooting operation is continued. If the shooting operation is continued, the process returns to S1120, and if not, the process proceeds to S1122. If continuous shooting is set and SW2 is held, shooting is repeated with the focus position fixed in one-shot AF.

[0209] In S1122, it is determined whether the image capture preparation state has been released. If the image capture preparation state has been released, the process proceeds to S1123, and if not, the process returns to S1111.

[0210] In S1123, it is determined whether or not this flow is to be ended. If it is to be ended, the process proceeds to S1124, and if it is not to be ended, the process returns to S1102.

[0211] In S1124, the tracking start position is stored in a storage area (memory) and the process ends.

[0212] As described above, when tracking is stopped, while the shooting preparation state continues, the continuity of tracking is prioritized, and the camera does not return to the original tracking start position, but stops at the vicinity of the tracked subject (the position where it was tracked until just before) as the start position. Also, if the camera is in a shooting standby state, the tracking start position is returned to the original position. This makes it possible to set the optimal tracking start position. This realizes comfortable operability. It is particularly effective as a means for determining the subject to be photographed in a digital camera, and this allows for comfortable shooting without missing a shutter opportunity.

[0213] In this embodiment, an example has been described in which the display frame is expressed as a rectangle as an index showing the position and size on the screen, but it does not necessarily have to be a rectangle and may be any shape, such as a circle, a hexagon, etc. Also, a crosshair like display that shows only the position may be used.

[0214] Furthermore, the system control unit 50 can generate metadata based on shooting conditions that combine shooting settings and detection settings, add it to image data captured by the imaging unit 22, and record it on the recording medium 200. When displaying a recorded image, metadata recorded in association with the image data may be displayed. The image data and metadata to be recorded are recorded in accordance with a standard such as Exif (Exchangeable Image File Format).

[0215] In addition, although it has been explained that tracking is stopped by the user performing a "stop tracking" operation, tracking may be stopped automatically when the tracking target is lost, when the tracking reliability falls below a predetermined value, or when the tracking target is switched.

[0216] Furthermore, the various controls described above as being performed by the system control unit 50 may be performed by a single piece of hardware, or the entire device may be controlled by multiple pieces of hardware sharing the processing.

[0217] In addition, although the present invention has been described in detail based on the preferred embodiments, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. Furthermore, each of the above-mentioned embodiments merely shows one embodiment of the present invention, and each embodiment can be appropriately combined.

[0218] In the above-mentioned embodiment, the present invention has been described as being applied to the digital camera 100, but the present invention is not limited to this example and can be applied to any display control device that can control image processing. In other words, the present invention can be applied to mobile phone terminals, portable image viewers, PCs, printer devices equipped with viewfinders, home appliances with display units, digital photo frames, projectors, tablet PCs, music players, game consoles, electronic book readers, and the like.

[0219] (Other embodiments) The present invention can also be realized by executing the following process. That is, software (programs) that realize the functions of the above-mentioned embodiments are supplied to a system or device via a network or various storage media, and the computer (or CPU, MPU, etc.) of the system or device reads and executes the program code. In this case, the program and the storage medium on which the program is stored constitute the present invention. [Explanation of symbols]

[0220] 100 Digital Camera 150 Lens unit 50 System control section 28 Display section 70a Touch Panel 22 Imaging unit 32 Memory 70 Operation section 77 AE lock button 78 Enlarge button 75 SET button 79 Play button

Claims

1. A tracking means for tracking a tracking target in an image; a tracking start means for starting tracking by the tracking means from a tracking start position; a tracking stop means for stopping tracking by the tracking means; and a setting means for setting a different tracking start position when the tracking is stopped depending on whether a shooting preparation instruction has been given to start shooting preparation or not.

2. When the tracking is stopped, a tracking start position in the case where the shooting preparation instruction is given is set based on a position that was tracked immediately before the tracking is stopped, 2 . The electronic device according to claim 1 , wherein a tracking start position in a state in which the shooting preparation instruction has not been issued when the tracking is stopped is set to a predetermined position.

3. The electronic device described in Claim 2, characterized in that the predetermined position is the position before the previous tracking was started.

4. The electronic device described in Claim 2, characterized in that the predetermined position is updated when a movement operation is performed by a user.

5. 5. The electronic device according to claim 1, wherein the tracking stopping means stops the tracking in response to a user operation.

6. The electronic device according to any one of claims 1 to 4, characterized in that the tracking stop means automatically stops tracking when the tracking target is lost, when the tracking reliability falls below a predetermined value, or when the tracking target is switched.

7. 7. The electronic device according to claim 1, wherein the tracking initiation means can be activated during execution of an AF process.

8. 8. The electronic device according to claim 7, wherein the AF process is started when the instruction for preparation for photographing is given.

9. 9. The electronic device according to claim 1, wherein the state in which the photographing preparation instruction has been issued is a state in which a shutter button is half-pressed.

10. 9. The electronic device according to claim 8, further comprising an AF unit that performs continuous AF on a subject to be tracked when the shooting preparation instruction is held.

11. 11. The electronic device according to claim 1, wherein the image is a live view image captured by an image capture unit.

12. 12. The electronic device according to claim 1, further comprising an image capturing unit.

13. a tracking step of tracking a tracking target in an image; a tracking start step of starting tracking of the tracking target from a tracking start position; a tracking stopping step of stopping tracking of the tracking target; and a setting step of setting different tracking start positions when the tracking is stopped depending on whether a shooting preparation instruction has been given to start shooting preparation and whether the shooting preparation instruction has not been given.

14. A program for causing a computer to function as each of the means of the electronic device according to any one of claims 1 to 11.

15. A computer-readable storage medium storing a program for causing a computer to function as each of the means of the electronic device according to any one of claims 1 to 11.

Images