Imaging device, imaging control method, and program

Abstract

The present technology relates to an imaging device, an imaging control method, and a program which make it possible to, after tracking has ended, restart tracking from an appropriate position. The imaging device comprises: a focus control unit that controls a tracking function for tracking a tracking subject and continuously focusing on the tracking subject; and a setting unit that, on the basis of prescribed conditions, causes a tracking-start position to move during tracking. The present technology can be applied to, for example, an imaging device provided with a tracking function.

Description

Technical Field

[0001] The present technology relates to a photographing apparatus, a photographing control method, and a program, and particularly to a photographing apparatus, a photographing control method, and a program for tracking a subject.

Background Art

[0002] In recent years, photographing apparatuses having a tracking function for tracking a subject to be tracked and continuously adjusting focus to the subject have become widespread.

[0003] In addition, a photographing apparatus has been proposed that stores a tracking start position by moving a tracking start frame before tracking and starts tracking from the tracking start position stored before tracking after the tracking ends. For example, when the tracking target is lost due to being hidden behind another subject during tracking, the tracking is restarted from the tracking start position stored before tracking (see, for example, Patent Document 1).

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, in the invention described in Patent Document 1, for example, when the tracking target reappears at a location far from the stored tracking start position, it is difficult to immediately adjust focus to the tracking target and perform tracking.

[0006] The present technology has been made in view of such a situation, and enables restarting tracking from an appropriate position after the tracking ends.

Means for Solving the Problems

[0007] One aspect of this technology is an imaging device comprising a focus control unit that tracks a target and controls the tracking function to maintain focus on the target, and a setting unit that moves the tracking start position during tracking based on predetermined conditions.

[0008] One aspect of this technology is a shooting control method which involves tracking a target, controlling a tracking function that keeps the focus on the target, and moving the tracking start position during tracking based on predetermined conditions.

[0009] One aspect of this technology is a program that tracks a target, controls the tracking function to maintain focus on the target, and causes the computer to execute a process to move the tracking start position during tracking based on predetermined conditions.

[0010] In one aspect of this technology, the tracking function is controlled to track a target and maintain focus on the target, and the tracking start position is moved during tracking based on predetermined conditions. [Brief explanation of the drawing]

[0011] [Figure 1] This is a block diagram showing one embodiment of a photographic device to which this technology is applied. [Figure 2] This is a perspective view of the imaging device from the rear. [Figure 3] This is a magnified view of the multi-selector on the imaging device. [Figure 4] This is a perspective view of the imaging device with the lens unit attached, seen from the front, and a side view of the front end of the lens unit. [Figure 5] This diagram shows an example of a focus area zone. [Figure 6] This is a diagram illustrating a first example of how to move the tracking start position. [Figure 7] This diagram illustrates a second example of how the tracking start position can be moved. [Figure 8] This diagram illustrates a third example of how the tracking start position can be moved. [Figure 9]It is a flowchart for explaining focus standard processing. [Figure 10] It is a diagram showing a first example of a setting screen for the press-and-hold-off function. [Figure 11] It is a diagram showing a second example of a setting screen for the press-and-hold-off function. [Figure 12] It is a diagram for explaining a first example of a method for setting a tracking position when tracking fails. [Figure 13] It is a diagram for explaining a second example of a method for setting a tracking position when tracking fails. [Figure 14] It is a diagram for explaining a third example of a method for setting a tracking position when tracking fails.

Modes for Carrying Out the Invention

[0012] Hereinafter, modes for carrying out the present technology will be described. The description will be carried out in the following order. 1. Embodiment 2. Variation 3. Others

[0013] <<1. Embodiment>> Referring to FIGS. 1 to 14, embodiments of the present technology will be described.

[0014] <Configuration Example of Imaging Apparatus 1> FIG. 1 is a block diagram showing an embodiment of an imaging apparatus 1 to which the present technology is applied.

[0015] The imaging apparatus 1 includes a processor 11, an optical unit 12, an imaging element 13, an operation unit 14, a sensing unit 15, a display unit 16, a storage unit 17, a communication unit 18, an external interface (I / F) 19, and a drive 20. The processor 11 to the drive 20 are connected to a bus and perform necessary communication with each other.

[0016] The processor 11 includes, for example, a CPU (Central Processing Unit), an MPU (Micro Processing Unit), and a GPU (Graphics Processing Unit). The processor 11 performs various processes by executing programs installed in the memory unit 17.

[0017] The optical unit 12 is equipped with optical elements such as lenses and forms an image of incident light from the subject onto the light-receiving surface of the image sensor 13.

[0018] The image sensor 13 is composed of, for example, a CMOS image sensor. The image sensor 13 captures an image of the subject formed by the optical unit 12 and outputs the obtained image data onto the bus.

[0019] The control unit 14 consists of physical keys (including a keyboard), a mouse, a touch panel, etc. The control unit 14 outputs an operation signal corresponding to the user's operation onto the bus.

[0020] The sensing unit 15 is equipped with various sensors and outputs sensor data from each sensor onto the bus. The sensing unit 15 includes, for example, sensors for detecting the movement of the imaging device 1, such as an acceleration sensor, an angular velocity sensor, a geomagnetic sensor, and a GNSS (Global Navigation Satellite System) receiver.

[0021] The display unit 16 is composed of, for example, a touch panel, and displays an image according to the data supplied from the bus.

[0022] Here, for example, the touch panel, which serves as the operation unit 14, is made of a transparent material and can be integrated with the display unit 16. This allows the user to input information by operating icons, buttons, etc., displayed on the display unit 16.

[0023] The storage unit 17 may include, for example, volatile memory to temporarily store programs executed by the processor 11 and necessary data. Alternatively, the storage unit 17 may include, for example, a hard disk or non-volatile memory to store programs executed by the processor 11 and necessary data.

[0024] The communication unit 18 is equipped with communication circuits and antennas, and communicates with various external devices.

[0025] External I / F19 is an interface for exchanging data with various external devices.

[0026] Drive 20 allows for the insertion and removal of removable media 20A, such as a memory card, and drives the removable media 20A that is installed therein.

[0027] In the imaging device 1 configured as described above, the program executed by the processor 11 can be pre-recorded in the storage unit 17.

[0028] Furthermore, the program can be stored (recorded) on the removable media 20A and provided as so-called packaged software, which can then be installed from the removable media 20A onto the imaging device 1.

[0029] In addition, the program can be downloaded from a server (not shown) or the like via the communication unit 18 and installed on the imaging device 1.

[0030] The processor 11 executes a program installed in the imaging device 1 to realize the image processing unit 31, recognition unit 32, setting unit 33, focus control unit 34, imaging control unit 35, display control unit 36, and communication control unit 37.

[0031] The image processing unit 31 performs various image processing operations (for example, noise reduction) on the image data obtained by the image sensor 13. The image processing unit 31 outputs the processed image data onto the bus.

[0032] The recognition unit 32 performs recognition processing of various subjects in the image based on the image data after the image processing by the image processing unit 31. For example, the recognition unit 32 recognizes the type, position, movement, etc. of the subject in the image.

[0033] The setting unit 33 performs various setting processes of the photographing apparatus 1 based on the operation signal from the operation unit 14 and the result of the subject recognition processing by the recognition unit 32, etc. For example, when executing the tracking function of tracking a focused subject (tracking target) and continuously focusing, the setting unit 33 performs setting processing of the tracking start position which is the reference position for starting tracking, etc.

[0034] The focus control unit 34 controls the focus of the photographing apparatus 1 by controlling the optical unit 12 based on the setting state of the photographing apparatus 1 by the setting unit 33 and the operation signal from the operation unit 14, etc. For example, the focus control unit 34 performs AF (Auto Focus) which automatically focuses on a subject within the angle of view, and control of the above-described tracking function.

[0035] The photographing control unit 35 controls the photographing of the subject by controlling the optical unit 12 and the imaging device 13 based on the setting state of the photographing apparatus 1 by the setting unit 33 and the operation signal from the operation unit 14, etc.

[0036] The display control unit 36 controls the display of the display unit 16. For example, the display control unit 36 controls the display on the display unit 16 of the through image based on the image data obtained by the imaging device 13 and subjected to image processing by the image processing unit 31, the image based on the image data stored in the storage unit 17 or the removable medium 20A, and various setting screens, etc.

[0037] The communication control unit 37 controls the communication by the communication unit 18.

[0038] <Operation member for AF and tracking function> Next, with reference to Figures 2 to 4, the operating members included in the operating unit 14 and used for operating the AF and tracking functions of the shooting device 1 will be described.

[0039] Figure 2 is a perspective view of the imaging device 1 from the rear. Figure 3 is an enlarged view of the multi-selector 54 of the imaging device 1. Figure 4 is a perspective view of the imaging device 1 with the lens unit 71 attached, viewed from the front, and a side view of the front end of the lens unit 71.

[0040] The shooting device 1 includes a monitor 51, a shutter button 52, an AF button 53, a multi-selector 54, a function button 55, a control wheel 56, an AEL button 57, and custom buttons 58 to 61. The lens unit 71 includes a lens button 81.

[0041] The monitor 51 is located on the lower left of the back of the imaging device 1. The monitor 51 is, for example, a touch panel and constitutes part of the operation unit 14 and the display unit 16. For example, the monitor 51 displays a through image based on image data obtained by the image sensor 13 and processed by the image processing unit 31, an image based on image data stored in the storage unit 17 or the removable media 20A, and various setting screens, etc.

[0042] Furthermore, for example, the user can perform various operations on the monitor 51, which is a touch panel. For instance, by touching the monitor 51, the user can move the focus area frame to the touched position.

[0043] Here, the focus area, as will be explained in more detail later, is the area on which autofocus (AF) is performed. The focus area frame is the frame displayed on monitor 51 to indicate the focus area.

[0044] The shutter button 52 is located at the front right corner of the top surface of the shooting device 1. The shutter button 52 can be half-pressed or fully pressed. When the shutter button 52 is half-pressed, autofocus (AF) is performed. Also, if the tracking function is set to ON, when the shutter button 52 is half-pressed, the tracking function is performed. When the shutter button 52 is fully pressed, a still image or video is taken, and the obtained image data is stored in the storage unit 17 or the removable media 20A.

[0045] The AF button 53 is located on the back of the camera unit 1, near the upper right corner of the monitor 51. When the AF button 53 is pressed, autofocus (AF) is performed. Also, if the tracking function is set to ON, pressing the AF button 53 will activate the tracking function.

[0046] The multi-selector 54 is located to the right of the monitor 51 and below the AF button 53. As shown in Figure 3, the multi-selector 54 consists of lever-shaped buttons that can be pressed in the center or tilted up, down, left, or right.

[0047] For example, the center of the multi-selector 54 is pre-assigned to a focus standard function. The focus standard function allows the user to move the focus area, for example, simply by pressing the button to which the focus standard is assigned. In addition, for example, the user can move the focus area frame displayed on the monitor 51 by tilting the multi-selector 54 up, down, left, or right.

[0048] The function button 55 is located to the right of the monitor 51 and below the multi-selector 54. The function button 55 is used to display a function menu on the monitor 51, etc.

[0049] The control wheel 56 is located to the right of the monitor 51 and below the function button 55. The control wheel 56 allows the user to press the central button, rotate the surrounding wheel, and press the up, down, left, and right buttons on the wheel. The control wheel 56 is used, for example, to operate various menus displayed on the monitor 51.

[0050] The AEL button 57 is located near the upper right corner of the camera device 1. The AEL button is used, for example, to operate the AE (exposure) lock function.

[0051] Custom buttons 58 and 59 are arranged side by side on the top surface of the camera device 1, behind the shutter button 52.

[0052] The custom button 60 is located on the back of the imaging device 1, near the upper left corner of the monitor 51.

[0053] The custom button 61 is located near the lower right corner on the back of the imaging device 1.

[0054] The lens button 81 (Figure 4) is located slightly behind the front of the lens unit 71, and slightly below the left side.

[0055] Custom buttons 58 through 61 and the lens button 81 do not have a specific purpose assigned to them, and users can assign any desired function to them. In addition, users can assign any desired function other than those pre-assigned to the AF button 53, the center of the multi-selector 54, the function button 55, the center button of the control wheel 56, the left, right, and bottom buttons of the control wheel 56, and the AEL button 57.

[0056] Hereafter, buttons and other elements to which users can assign their desired functions will be referred to as custom keys. For example, a user can assign the focus standard function or the press-and-off function (described later) to any of the custom keys.

[0057] Hereafter, a custom key assigned to the Focus Standard function will be referred to as the Focus Standard key. Hereafter, a custom key assigned to the Press-and-Hold Off function will be referred to as the Press-and-Hold Off key.

[0058] <AF function of camera device 1> Next, we will explain the details of the AF function of the camera device 1.

[0059] <Focus Mode> The shooting device 1 has four types of focus modes, for example, single AF (Auto Focus), continuous AF (Auto Focus), DMF (Direct Manual Focus), and MF (Manual Focus).

[0060] Single AF is a mode in which the camera automatically focuses on a subject within the focus area, and the focus position is fixed once focus is achieved.

[0061] Continuous AF is a mode that maintains focus while AF is being performed (for example, while the shutter button 52 is half-pressed, or while the AF button 53 is pressed). In Continuous AF mode, for example, the focus point moves in accordance with the movement of the subject that is in focus.

[0062] When the focus mode is set to continuous AF mode, the tracking function becomes available. When the tracking function is turned on, the subject to be tracked is followed, and the focus is continuously maintained on the subject. However, even if the focus mode is set to continuous AF mode, if the tracking function is turned off, the focus will shift to another subject, for example, if another subject appears closer than the subject that is in focus.

[0063] DMF is a mode that allows the user to manually fine-tune the focus point after autofocus has achieved focus.

[0064] MF is a mode in which the focus is adjusted manually.

[0065] <Focus Area> For example, the imaging device 1 allows setting five types of focus areas: wide, zone, center, flexible spot, and expanded flexible spot.

[0066] When the focus area is set to wide, the entire display range of the monitor 51 is set as the focus area. Then, autofocus is performed on the shooting range corresponding to the entire display range of the monitor 51.

[0067] When the focus area is set to a zone, for example, as shown in Figure 5, the display range of the monitor 51 (i.e., the shooting range (angle of view)) is divided into zones Z1 to Z9, and the zone specified by the user is set as the focus area. Then, autofocus is performed on the shooting range corresponding to the specified zone. If focusing fails within the specified zone, the entire display range of the monitor 51 is set as the focus area.

[0068] If the focus area is set to the center, the area near the center of the monitor 51 is set as the focus area. Then, autofocus is performed on the shooting range corresponding to the area near the center of the monitor 51. If focusing fails near the center of the monitor 51, the entire display area of ​​the monitor 51 is set as the focus area.

[0069] When the focus area is set to flexible spot, a focus area frame is displayed on the monitor 51. The user can move the focus area frame to the desired position on the monitor 51. The area within the focus area frame is then set as the focus area, and autofocus is performed on the shooting range corresponding to the focus area frame. If focusing fails within the focus area frame, the entire display range of the monitor 51 is set as the focus area.

[0070] When the focus area is set to an expanded flexible spot, the focus area frame is displayed on the monitor 51, similar to when it is set to a flexible spot. The user can move the focus area frame to a desired position on the monitor 51. The area within the focus area frame is then set as the focus area, and autofocus (AF) is performed on the shooting range corresponding to the focus area frame. If focusing fails within the focus area frame, a predetermined area around the focus area frame is set as the focus area. Then, AF is performed on the shooting range corresponding to the predetermined area around the focus area frame. If focusing fails within the predetermined area around the focus area frame, the entire display range of the monitor 51 is set as the focus area.

[0071] Furthermore, if the tracking function is enabled, regardless of the focus area setting, the focus position will shift after the focus is set, following the movement of the tracked subject.

[0072] Hereafter, flexible spot and extended flexible spot will be collectively referred to as spot systems.

[0073] <Face / Eye Priority AF Function> Face / Eye Priority AF is a function that prioritizes focusing on the face or eyes within the focus area.

[0074] For example, if the face / eye priority AF function is turned on, and an eye is detected within the focus area, the camera will focus on the detected eye. If multiple eyes are detected, the camera will focus on one of the eyes based on predetermined conditions.

[0075] Furthermore, if no pupils are detected within the focus area but a face is detected, the camera will focus on the detected face. If multiple faces are detected, the camera will focus on one of the faces based on predetermined conditions.

[0076] If eyes and faces are not detected within the focus area, normal autofocus will be performed within the focus area.

[0077] <How to set the tracking start position> In the imaging device 1, if the focus area is set to zone or spot and the tracking function is turned on, it is possible to set the tracking start position. The tracking start position is the position at which focus is achieved and tracking begins when tracking starts. The tracking start position can be set both before and during tracking.

[0078] Here, with reference to Figures 6 to 8, an example of how to set the tracking start position will be explained. Figures 6 to 8 show an example where the focus area is set to a spot type. Also, in Figures 6 to 8, a through image (not shown) is displayed on the monitor 51, and the focus area frame Fa and focus frame Fb are superimposed on the through image.

[0079] Figure 6 shows an example where the tracking start position can be set to the tracking position, which is the position where the tracked object is in focus during tracking.

[0080] Figure 6A shows an example of the display on the monitor 51 before tracking. The focus area frame Fa is displayed on the monitor 51. For example, the user can move the focus area frame Fa to any position on the monitor 51 by using the multi-selector 54 or by touching the monitor 51.

[0081] Here, the focus area frame Fa indicates the area where AF will be performed when the tracking function is turned on, as well as the starting position for tracking. In other words, when AF is performed, the subject within the range of the focus area frame Fa is focused on, then the focused subject is set as the tracking target, and the focus position moves in accordance with the movement of the tracking target.

[0082] Then, the setting unit 33 sets the position of the focus area frame Fa to the tracking start position.

[0083] Figure 6B shows an example of the display on the monitor 51 when tracking begins. For example, when the subject within the focus area frame Fa is brought into focus, the focus frame Fb indicating the in-focus position is displayed. At this time, for example, the focus area frame Fa remains displayed.

[0084] Figure 6C shows an example of the display on the monitor 51 during tracking. For example, the focus frame Fb moves in accordance with the movement of the tracked object. Therefore, the focus frame Fb indicates the tracking position, which is the position where the focus has shifted in accordance with the movement of the tracked object. At this time, the focus area frame Fa remains in the same position without moving.

[0085] Figure 6D shows an example of the display on monitor 51 when the user performs a predetermined operation during tracking (for example, when the focus standard key is pressed). At this time, the focus area frame Fa moves to the position of the focus frame Fb when the user performed the predetermined operation. The setting unit 33 then sets the position where the focus area frame Fa is displayed as the tracking start position.

[0086] In this way, the user can easily move the reference position for resuming tracking after the tracking period ends (the tracking start position) to the current tracking position while tracking is in progress.

[0087] On the other hand, if the focus area is set to a zone, and the user performs a predetermined operation during tracking (for example, by pressing the focus standard key), the focus area moves to the zone where the center of the focus frame Fb is located. For example, in the case of Figure 6, the center of the focus frame Fb when the user performs the predetermined operation is within zone Z4 in Figure 5, so the focus area moves to zone Z4. The setting unit 33 then sets zone Z4 as the tracking start position.

[0088] In this way, the user can easily move the starting position (the reference point for resuming tracking after tracking has ended) to a zone that includes the current tracking position, while tracking is in progress.

[0089] Figure 7 shows an example where the tracking start position can be set to any position during tracking.

[0090] Figures 7A through 7C show examples similar to those in Figures 6A through 7C, and their explanation is omitted.

[0091] For example, during tracking, the user can move the focus area frame Fa to any position on the monitor 51 by using the multi-selector 54 or by touching the monitor 51. For example, the user can move the focus area frame Fa to a position different from the focus frame Fb, as shown in Figure 7D. The setting unit 33 then sets the position of the focus area frame Fa to the tracking start position.

[0092] In this way, the user can easily move the starting position (the reference point for resuming tracking after tracking has ended) to a specified position during tracking.

[0093] On the other hand, if the focus area is set to a zone, during tracking, the user can move the focus area in zone units as shown in Figure 5 by using the multi-selector 54 or by touching the monitor 51. The setting unit 33 then sets the zone specified by the user as the tracking start position.

[0094] In this way, the user can easily move the starting position (the reference point for resuming tracking after tracking has ended) to a specified zone during tracking.

[0095] Figure 8 shows an example where the tracking start position automatically moves to the tracking position when tracking ends.

[0096] Figures 8A through 8C show examples similar to those in Figures 6A through 8C, and their explanation is omitted.

[0097] Figure 8D shows an example of the display on the monitor 51 at the end of tracking. For example, in the state shown in Figure 8C, the focus control unit 34 terminates tracking if it loses sight of the target, fails to focus, or if AF is set to off. At this time, for example, as shown in Figure 8D, the focus frame Fb disappears, and the focus area frame Fa moves to the position where the focus frame Fb was displayed at the end of tracking. The setting unit 33 then sets the position where the focus area frame Fa is displayed as the tracking start position.

[0098] In this way, the reference position for resuming tracking after the tracking period ends (the tracking start position) automatically moves to the tracking position at the end of the tracking period.

[0099] On the other hand, if the focus area is set to a zone, the focus area moves to the zone where the center of the focus frame Fb is located at the end of tracking. For example, in the example in Figure 8, the center of the focus frame Fb at the end of tracking is within zone Z4 in Figure 5, so the focus area moves to zone Z4. The setting unit 33 then sets zone Z4 as the tracking start position.

[0100] In this way, the reference position for resuming tracking after the tracking period ends (the tracking start position) automatically moves to the zone that includes the tracking position at the end of the tracking period.

[0101] Furthermore, the function that automatically moves the tracking start position to the tracking position when tracking ends can be set to on or off by the user in advance.

[0102] Furthermore, in the setting method shown in Figure 8, for example, the setting unit 33 may control the movement of the tracking start position at the end of tracking based on the type of subject recognized by the recognition unit 32. Specifically, the setting unit 33 may control the movement of the tracking start position at the end of tracking based on at least one of the following conditions: when a predetermined type of subject is recognized by the recognition unit 32, and when a predetermined type of subject is not recognized by the recognition unit 32.

[0103] For example, the setting unit 33 moves the tracking start position to the tracking position if the recognition unit 32 has recognized a predetermined type of subject at the end of tracking. Alternatively, the setting unit 33 moves the tracking start position to the tracking position if the recognition unit 32 has not recognized a predetermined type of subject at the end of tracking. Alternatively, the setting unit 33 moves the tracking start position to the tracking position if the recognition unit 32 has recognized a first type of subject, or if the recognition unit 32 has not recognized a second type of subject at the end of tracking.

[0104] Furthermore, the function that controls the movement of the tracking start position at the end of tracking, based on the recognized subject type, can be set by the user to turn it on or off in advance, for example.

[0105] Furthermore, the types of subjects that qualify for this function could include, for example, people, animals, birds, cars, etc. In addition, the types of subjects could be further classified down to specific parts of an object (for example, a person's face, an animal's eyes, etc.).

[0106] Furthermore, the user may be allowed to set the type of subject that constitutes the condition for the function. For example, the user may be allowed to select the type of subject that constitutes the condition for the function from among several candidates.

[0107] Furthermore, for example, the setting method in Figure 6 and the setting method in Figure 7 can be combined. For example, the user can move the tracking start position to the tracking position by pressing the focus standard key (for example, the center of the multi-selector 54) during tracking. Alternatively, for example, the user can move the tracking start position to a specified position by tilting the multi-selector 54 up, down, left, or right, or by touching the monitor 51.

[0108] On the other hand, the setting methods in Figure 6 or Figure 7 cannot be combined with the setting method in Figure 8. This is because, even if the tracking start position is moved during tracking using the setting method in Figure 6 or Figure 7, the tracking start position will automatically move to the tracking position when tracking ends using the setting method in Figure 8.

[0109] In contrast, for example, the user may be allowed to set which of the setting methods shown in Figures 6 to 8 to turn on. In this case, the user can turn on the setting method in Figure 6 and the setting method in Figure 7 simultaneously, but cannot turn on the setting method in Figure 6 or Figure 7 and the setting method in Figure 8 simultaneously.

[0110] However, in the setting method shown in Figure 8, if the movement of the tracking start position at the end of tracking is controlled based on the type of recognized subject, it is possible to combine at least one of the setting methods shown in Figures 6 and 7 with the setting method shown in Figure 8.

[0111] For example, when a predetermined type of subject is recognized and the tracking start position is moved to the tracking position at the end of tracking, the setting method in Figure 8 is effective when a predetermined type of subject is recognized. On the other hand, when a predetermined type of subject is not recognized, at least one of the setting methods in Figures 6 and 7 is effective.

[0112] Furthermore, for example, when moving the tracking start position to the tracking position at the end of tracking if a predetermined type of subject is not recognized, the setting method in Figure 8 becomes effective when a predetermined type of subject is not recognized. On the other hand, when a predetermined type of subject is recognized, at least one of the setting methods in Figures 6 and 7 becomes effective.

[0113] As described above, it becomes possible to move the tracking start position not only before tracking begins, but also during tracking. This makes it possible to restart tracking from a more appropriate position, for example, when restarting tracking after it has ended.

[0114] Furthermore, as shown in Figures 6B and 6C, if the focus area frame is displayed during tracking in the same manner as before tracking, it may become difficult for the user to distinguish between before and during tracking. In addition, the increased number of frames and other displays on the monitor 51 may make it difficult to see the subject.

[0115] In contrast, the display control unit 36 ​​may, for example, change the display mode of the focus area frame before and during tracking. For example, the display control unit 36 ​​may change the color of the focus area frame to an inconspicuous color (e.g., semi-transparent, gray, etc.) during tracking. For example, the display control unit 36 ​​may change the shape of the focus area frame during tracking.

[0116] Furthermore, for example, the display control unit 36 ​​may stop displaying the focus area frame (erase the focus area frame) during tracking based on user settings. In this case, for example, the display control unit 36 ​​will temporarily display the focus area frame if the focus area frame (tracking start position) moves during tracking (for example, if an operation is performed to move the focus area frame, or if the focus area frame moves to the tracking position when tracking ends).

[0117] <Focus Standard Processing> Next, referring to the flowchart in Figure 9, we will explain the process that occurs when the focus standard key is pressed (focus standard processing).

[0118] In step S1, the setting unit 33 determines whether the focus area is set to a spot or zone. If it is determined that the focus area is set to a spot or zone, the process proceeds to step S2.

[0119] In step S2, the setting unit 33 determines whether or not tracking is in progress. If it is determined that tracking is in progress, the process proceeds to step S3.

[0120] In step S3, the setting unit 33 moves the focus area to the tracking position. For example, if the focus area is set to a spot type, the setting unit 33 moves the focus area frame to the position of the current focus frame, as described above with reference to Figure 6. For example, if the focus area is set to a zone, the setting unit 33 moves the focus area to the zone where the center of the current focus frame is located.

[0121] This allows the user to easily move the focus area, i.e., the position where tracking resumes after it has ended, to the tracking position by pressing the focus standard key during tracking.

[0122] After that, the focus standard processing is completed.

[0123] On the other hand, if it is determined in step S2 that tracking is not in progress, the process proceeds to step S4.

[0124] In step S4, the setting unit 33 moves the focus area to the center of the monitor 51. For example, if the focus area is set to a spot type, the setting unit 33 moves the focus area frame to the center of the monitor 51. For example, if the focus area is set to a zone, the setting unit 33 moves the focus area to zone Z5 in Figure 5.

[0125] This allows the user to move the focus area to the center of the monitor 51 by pressing the focus standard key when tracking is not in progress. Therefore, when the tracking function is set to ON, the tracking start position moves to the center of the monitor 51.

[0126] After that, the focus standard processing is completed.

[0127] On the other hand, if the setting unit 33 determines in step S1 that the focus area is set to wide or center, the process proceeds to step S5.

[0128] In step S5, the setting unit 33 determines whether or not another function is assigned to the focus standard key. If it is determined that another function is assigned to the focus standard key, the process proceeds to step S6.

[0129] In step S6, the shooting device 1 performs the function assigned to it. For example, if the function to temporarily turn on the tracking function is assigned, the tracking function will be set to ON until the focus standard key is pressed again. For example, if the function to temporarily turn on AF is assigned, AF will be performed while the focus standard key is pressed.

[0130] After that, the focus standard processing is completed.

[0131] On the other hand, if it is determined in step S5 that no other function is assigned to the focus standard key, the process in step S5 is skipped and the focus standard processing ends.

[0132] <Off function while pressed> Next, the press-and-off function will be explained with reference to Figures 10 and 11.

[0133] The "Press-to-Off" function is a feature that temporarily turns off at least one of the following functions: tracking function and face / eye priority AF function, by pressing a custom key (press-to-off key) to which the "Press-to-Off" function is assigned.

[0134] Figures 10 and 11 show examples of the settings screen for the "press-to-off" function displayed on the monitor 51.

[0135] The "press and turn off" function is classified into six types based on the combination of the operation method and the function being turned off. Specifically, the "press and turn off" function is classified into six types: "press and turn off tracking," "press and turn off tracking and face / eye priority AF," "press and turn off tracking and face / eye priority AF," "press and turn off face / eye priority AF," and "press and turn off face / eye priority AF."

[0136] Figure 10 shows an example of a settings screen that lists six types of press-and-off functions for selection.

[0137] Specifically, this settings screen displays six options: "Press-to-Press Tracking Off," "Re-press Tracking Off," "Press-to-Press Tracking / Face Off," "Re-press Tracking / Face Off," "Press-to-Press Face Off," and "Re-press Face Off."

[0138] If "Press-to-Hold Tracking Off" is selected, the press-to-hold tracking off function will be turned on. When the press-to-hold tracking off function is turned on, the tracking function will be turned off while the press-to-hold off key is pressed.

[0139] If "Re-press Tracking Off" is selected, the re-press tracking off function will be turned on. When the re-press tracking off function is turned on, the tracking function will be turned off from the time the off key is pressed until it is pressed again.

[0140] When "Press and hold Tracking / Face Off" is selected, the press and hold tracking and face / eye priority AF off functions are turned on. When the press and hold tracking and face / eye priority AF off functions are turned on, the tracking function and face / eye priority AF function are turned off while the press and hold off key is pressed.

[0141] If "Re-press Tracking / Face Off" is selected, the re-press tracking and face / eye priority AF off functions will be turned on. When the re-press tracking and face / eye priority AF off functions are turned on, the tracking function and face / eye priority AF function will be turned off from the time the off key is pressed until it is pressed again.

[0142] If "Face-focused AF Off while pressed" is selected, the Face / Eye-focused AF Off function will be turned on while the button is pressed. When the Face / Eye-focused AF Off function is turned on, the Face / Eye-focused AF function will be turned off while the Off key is pressed.

[0143] If "Re-press Face Off" is selected, the Re-press Face / Eye Priority AF Off function will be turned on. When the Re-press Face / Eye Priority AF Off function is turned on, the Face / Eye Priority AF function will be turned off from the time the Off key is pressed until it is pressed again.

[0144] In the settings screen shown in Figure 11, the method for operating the "off while pressed" function and the function to be turned off are configured individually.

[0145] Specifically, a radio button is displayed that allows you to select either "While pressed" or "Press again". If "While pressed" is selected, the "Press to Off" function will be active while the "Press to Off" key is pressed. On the other hand, if "Press again" is selected, the "Press to Off" function will be active from the time the "Press to Off" key is pressed until it is pressed again.

[0146] Additionally, checkboxes are displayed allowing you to select either "Tracking OFF" or "Face / Eye Priority OFF," or both. When "Tracking OFF" is selected, the tracking function will be turned off while the "Press and Hold Off" function is active. When "Face / Eye Priority OFF" is selected, the face / eye priority AF function will be turned off while the "Press and Hold Off" function is active.

[0147] If the camera 1 is equipped with either a face-priority AF function or an eye-priority AF function instead of a face / eye-priority AF function, the above function will temporarily turn off either the face-priority AF function or the eye-priority AF function. Face-priority AF function is a function that prioritizes focusing on faces within the focus area. Eye-priority AF function is a function that prioritizes focusing on eyes within the focus area.

[0148] <Examples of using the tracking while pressed and the face / eye priority AF off function> Next, with reference to Figures 12 to 14, examples of using the press-and-hold tracking and face / eye priority AF off functions will be explained.

[0149] In the examples shown in Figures 12 to 14, the focus area is set to flexible spot, and the tracking function is enabled. Additionally, the press-and-hold tracking and face / eye priority AF off functions are enabled.

[0150] For example, Figure 12 shows an example of filming a boxing match between boxer 101 and boxer 102.

[0151] For example, in Figure 12A, the focus frame Fb is displayed at the position of boxer 101's face, and boxer 101's face is being tracked.

[0152] In this case, for example, if the boxer's face is obscured, as shown in Figure 12B, the focus control unit 34 will no longer be able to track the boxer's face. As a result, for example, the focus will be set to a position different from the boxer's face, and the focus frame Fb will be displayed at that position.

[0153] In contrast, for example, if the user presses the off key while holding it down, the tracking function and the face / eye priority AF function are temporarily turned off. As a result, AF is performed on targets within the focus area frame, and the focus is set on the subject within the focus area frame. Therefore, for example, the user can quickly refocus on the boxer 101's face by setting the focus area frame Fa to the position shown in Figure 12C while tracking is in progress.

[0154] Then, when the user releases the OFF key while still holding it down, the tracking function and face / eye priority AF function are restarted. This allows the Boxer 101 to quickly resume tracking faces.

[0155] For example, Figure 13 shows an example of filming a sumo match between wrestler 121 and wrestler 122.

[0156] For example, in Figure 13A, the focus frame Fb is displayed at the position of sumo wrestler 121's face, and sumo wrestler 121's face is being tracked.

[0157] In this case, depending on the movement of the sumo wrestler 121's face, for example, as shown in Figure 13B, the tracking of the sumo wrestler 121's face may fail, and the focus may shift to the face of a spectator 123 that is close to the sumo wrestler 121's face, resulting in the tracking of the spectator 123's face.

[0158] In contrast, for example, if the user presses the off key while holding it down, the tracking function and the face / eye priority AF function are temporarily turned off. As a result, AF is performed on targets within the focus area frame, and the focus is set on the subject within the focus area frame. Therefore, for example, the user can quickly refocus on the sumo wrestler 121's face by setting the focus area frame Fa to the position shown in Figure 13C while tracking.

[0159] Then, when the user releases the OFF key while still holding it down, the tracking function and face / eye priority AF function are restarted. This allows for a quick resumption of tracking the face of sumo wrestler 121.

[0160] For example, Figure 14 shows an example where a running dog 141 is being filmed and its right eye is being tracked.

[0161] In Figure 14A, tracking of dog 141's right eye fails, and the focus frame Fb is shifted to a different position from dog 141's right eye. On the other hand, the focus area frame Fa is positioned around dog 141's right eye.

[0162] In contrast, for example, if the user holds down the off key, the tracking function and face / eye priority AF function are temporarily turned off. As a result, as shown in Figure 14B, the focus frame Fb disappears and AF is performed within the range of the focus area frame Fa. This allows the camera to quickly refocus on the right eye of dog 141, as shown in Figure 14C.

[0163] Then, when the user releases the OFF key while still holding it down, the tracking function and face / eye priority AF function are restarted. This quickly resumes tracking of dog 141's right eye.

[0164] <Examples of assigning focus standard keys and off keys while pressed> Next, we will explain examples of assignments for the focus standard key and the off key (while pressed).

[0165] For example, users of the camera device 1 can be divided into those who half-press the shutter button 52 when performing the AF function and those who press the AF button 53.

[0166] For example, a user who half-presses the shutter button 52 is assumed to press the focus standard key and the press-and-off key with their right thumb. Therefore, it is desirable to assign the focus standard key and the press-and-off key to one of the custom keys on the back of the camera unit 1, excluding the custom button 60. In particular, it is desirable to assign the focus standard key to the center of the multi-selector 54.

[0167] On the other hand, it is assumed that the user pressing the AF button 53 will press the focus standard key and the press-and-off key with the thumb or index finger of their right hand. Therefore, it is desirable to assign the focus standard key and the press-and-off key to one of the custom keys on the top and back of the camera unit 1, excluding the custom button 60. In particular, it is desirable to assign the focus standard key to the center of the multi-selector 54.

[0168] As described above, the user can move the tracking start position not only before tracking begins but also during tracking. As a result, after tracking ends due to a tracking failure or other reasons, tracking can be quickly restarted from an appropriate position. In other words, tracking of the desired target can be quickly resumed.

[0169] <<2. Variant>> The following describes some modifications of the embodiments of the present technology described above.

[0170] The operating method and operating components described above are just examples and can be modified as needed.

[0171] The display modes of the focus frame indicating the focus position and tracking position, and the focus area frame indicating the focus area and tracking start position, as described above, are examples and can be changed as needed. For example, display modes other than frames may be used. For example, the display mode may be changed depending on whether the focus position or tracking position is being shown. The display mode may also be changed depending on whether the focus area or tracking position is being shown.

[0172] This technology can be applied, for example, to imaging devices with an auxiliary imaging function, such as smartphones, tablet devices, and mobile phones.

[0173] <<3.B>> <Example of computer configuration> The series of processes described above can be executed by hardware or by software. When the series of processes are executed by software, the programs that make up that software are installed on a computer. Here, a computer includes computers built into dedicated hardware, as well as general-purpose personal computers that can perform various functions by installing various programs.

[0174] The programs executed by the computer may be programs that are processed chronologically in the order described herein, or they may be programs that are processed in parallel or at necessary times, such as when a call is made.

[0175] Furthermore, the embodiments of this technology are not limited to those described above, and various modifications are possible without departing from the spirit of this technology.

[0176] For example, this technology can be configured as cloud computing, where a single function is shared and processed collaboratively by multiple devices via a network.

[0177] Furthermore, each step described in the flowchart above can be performed by a single device, or it can be divided and performed by multiple devices.

[0178] Furthermore, if a single step includes multiple processes, those processes can be executed by a single device or shared among multiple devices.

[0179] <Examples of configuration combinations> This technology can also be configured as follows:

[0180] (1) A focus control unit that tracks a target and controls the tracking function to maintain focus on the target, A setting unit that moves the tracking start position during tracking based on predetermined conditions. A photographic device equipped with the following features. (2) The setting unit moves the tracking start position during tracking based on user operation. (1) The imaging device described above. (3) The setting unit moves the tracking start position to the tracking position when the first user operation is performed during tracking. (2) The imaging device described above. (4) The setting unit moves the tracking start position to a position specified by a second user operation during tracking. (3) The imaging device described above. (5) The setting unit divides the shooting range into multiple zones and moves the tracking start position to the zone that includes the tracking position when the first user operation is performed. The imaging device described in (3) or (4). (6) The setting unit moves the tracking start position to a position specified by user operation during tracking. (2) The imaging device described above. (7) The setting unit moves the tracking start position to the tracking position at the end of tracking. (1) to (6) the imaging device described in any of these. (8) The setting unit divides the shooting range into multiple zones and moves the tracking start position to one of the zones that includes the tracking position at the end of tracking. (7) The imaging device described above. (9) The recognition unit performs the recognition processing of the subject. Furthermore, The setting unit controls the movement of the tracking start position at the end of tracking based on the type of recognized subject. The imaging device described in (7) or (8). (10) The setting unit controls the movement of the tracking start position at the end of tracking based on at least one of the following conditions: when the recognition unit recognizes a first type of subject, and when the recognition unit does not recognize a second type of subject. (9) The imaging device described above. (11) The setting unit sets the type of subject selected by the user to either the first type of subject or the second type of subject. The imaging device described in (10). (12) A display control unit that controls the display of the tracking start position superimposed on the through image. The photographic apparatus further comprises any of (1) to (11). (13) The display control unit changes the display pattern of the tracking start position before and during tracking. The imaging device described in (12). (14) The display control unit stops displaying the tracking start position during tracking and displays it when the tracking start position moves. The imaging device described in (12). (15) The focus control unit sets a position for resuming tracking, based on the tracking start position, after tracking has finished. The imaging device described in any of (1) to (14). (16) The setting unit, based on user operation, temporarily turns off at least one of the following during tracking: the tracking function and the priority autofocus function which prioritizes focusing on at least one of the face and the eyes. The imaging device described in any of (1) to (15). (17) The tracking function tracks the target object and maintains focus on the target object. Based on predetermined conditions, the tracking start position is moved during tracking. A method for controlling the shooting process. (18) The tracking function tracks the target object and maintains focus on the target object. Based on predetermined conditions, the tracking start position is moved during tracking. A program that causes a computer to perform a process.

[0181] Furthermore, the effects described herein are merely illustrative and not limiting; other effects may also occur. [Explanation of Symbols]

[0182] 1 Shooting device, 11 Processor, 13 Image sensor, 14 Operation unit, 16 Display unit, 32 Recognition unit, 33 Setting unit, 34 Focus control unit, 35 Shooting control unit, 37 Display control unit, 51 Monitor, 52 Shutter button, 53 AF button, 54 Multi-selector

Claims

1. A focus control unit that tracks a target and controls the tracking function to maintain focus on the target, A setting unit that moves the tracking start position during tracking based on predetermined conditions, A display control unit controls the display of the tracking start position superimposed on the through-image, and changes the display mode of the tracking start position before and during tracking. A photographic device equipped with the following features.

2. The setting unit moves the tracking start position during tracking based on user operation. The imaging apparatus according to claim 1.

3. The setting unit moves the tracking start position to the tracking position when a user operation is performed during tracking. The imaging apparatus according to claim 2.

4. The setting unit divides the shooting range into multiple zones and moves the tracking start position to one of the zones that includes the tracking position when a user operation is performed during tracking. The imaging apparatus according to claim 2.

5. The setting unit moves the tracking start position to a position specified by user operation during tracking. The imaging apparatus according to claim 2.

6. The setting unit moves the tracking start position based on the tracking position at the end of tracking. The imaging apparatus according to claim 1.

7. The setting unit divides the shooting range into multiple zones and moves the tracking start position to one of the zones that includes the tracking position at the end of tracking. The imaging apparatus according to claim 6.

8. The recognition unit performs the recognition processing of the subject. Furthermore, The setting unit controls the movement of the tracking start position at the end of tracking based on the type of recognized subject. The imaging apparatus according to claim 6.

9. The setting unit controls the movement of the tracking start position at the end of tracking based on at least one of the following conditions: when the recognition unit recognizes a first type of subject, or when the recognition unit does not recognize a second type of subject. The photographic apparatus according to claim 8.

10. The setting unit sets the type of subject selected by the user to either the first type of subject or the second type of subject. The imaging apparatus according to claim 9.

11. The display control unit stops displaying the tracking start position during tracking and displays it when the tracking start position moves. The imaging apparatus according to any one of claims 1 to 10.

12. The focus control unit sets a position for resuming tracking based on the tracking start position after tracking has finished. The imaging device according to any one of claims 1 to 11.

13. The setting unit, based on user operation, temporarily turns off at least one of the following during tracking: the tracking function and the priority autofocus function which prioritizes focusing on at least one of the face and the eyes. The imaging device according to any one of claims 1 to 12.

14. The tracking function tracks the target object and maintains focus on the target object. Based on predetermined conditions, the tracking start position is moved during tracking, The display of the tracking start position superimposed on the through-image is controlled, and the display pattern of the tracking start position is changed before and during tracking. A method for controlling the shooting process, including the following:

15. The tracking function tracks the target object and maintains focus on the target object. Based on predetermined conditions, the tracking start position is moved during tracking, The display of the tracking start position superimposed on the through-image is controlled, and the display pattern of the tracking start position is changed before and during tracking. A program that causes a computer to perform a process that includes [a specific action].

Images