Imaging apparatus, control method, and program

Abstract

To provide a technique that allows a user to use a plurality of functions related to predetermined processing according to purposes with one operating unit capable of a plurality of depressing operations, and can reduce operational moves.SOLUTION: An imaging apparatus has: imaging means; processing means that performs predetermined processing on a subject in an image picked up by the imaging means; a first operating unit to perform a photographing instruction; a second operating unit different from the first operating unit; and control means that performs control to execute the predetermined processing on a first subject in the image according to a first depressing operation on the second operating unit, and to switch a target of the predetermined processing according to a second depressing operation following the first depressing operation on the second operating unit.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a technique for operating an imaging device. [Background technology]

[0002] In an imaging device such as a digital camera, a desired function (e.g., autofocus) can be assigned to a predetermined operation member, and the desired function can be executed by operating the predetermined operation member when taking a picture. Imaging devices are equipped with a wide variety of functions in addition to autofocus, and the number of functions that users can assign to operation members is increasing.

[0003] While a user can assign a desired function to an operating member, if a user wants to execute another function after executing the desired function, the user needs to operate multiple operating members, which increases the number of operations and makes the operation difficult. For example, if the user operates an operating member to execute autofocus on a certain subject and then wants to execute autofocus again on a different subject, the user needs to operate multiple operating members, which may result in the camera not being able to focus on the changed subject in time, resulting in a loss of a photographic opportunity.

[0004] To address these issues, Patent Document 1 describes a method for enabling different functions to be executed in response to different operations on a single operating member, and Patent Document 2 describes a method for determining a subject to be autofocused based on the user's gaze detection position and the subject position. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Laid-Open No. 2001-346080 [Patent Document 2] Japanese Patent Application Publication No. 2019-008076 Summary of the Invention [Problem to be solved by the invention]

[0006] In Patent Document 1, video recording can be performed by pressing the operating member (shutter button) halfway, and still image capture can be performed by pressing it all the way, but there are cases where the shutter button is desired to be fixed solely as a still image capture function, and in that case, changing the function to be executed as in Patent Document 1 would make it impossible to perform the intended still image capture. Also, when operating autofocus using an operating member other than the shutter button, the user simply does not operate the shutter button, and the effect of reducing the number of steps required for operation cannot be obtained.

[0007] In Patent Document 2, there is a possibility that the autofocus target may be determined automatically against the user's will.

[0008] The present invention has been made in consideration of the above-mentioned problems, and its purpose is to realize a technology that enables multiple functions related to a specified process to be used selectively with a single operation unit that can perform multiple pressing operations, thereby reducing the number of operation steps. [Means for solving the problem]

[0009] In order to solve the above problems and achieve the object, the imaging device of the present invention has an imaging means, a processing means for performing a predetermined process on a subject in an image captured by the imaging means, a first operation unit for issuing shooting instructions, a second operation unit different from the first operation unit, and a control means for performing the predetermined process on a first subject in the image in response to a first pressing operation on the second operation unit, and for controlling to switch the target of the predetermined process in response to a second pressing operation subsequent to the first pressing operation on the second operation unit. [Effects of the Invention]

[0010] According to the present invention, a single operation unit capable of multiple pressing operations can be used to selectively use a plurality of functions related to a predetermined process, thereby reducing the number of operation steps. [Brief explanation of the drawings]

[0011] [Figure 1]FIG. [Figure 2] FIG. 1 is a block diagram showing the configuration of an apparatus. [Figure 3] 4 is a flowchart showing a control process according to the first embodiment. [Figure 4] 10 is a flowchart showing a control process when the eye-gaze input function of the first embodiment is disabled. [Figure 5] FIG. 3 is a diagram illustrating a live view screen for explaining the control process of the first embodiment. [Figure 6] 3A to 3C are diagrams illustrating a method of assigning functions to operation members in the first embodiment. [Figure 7] 10A to 10C are diagrams illustrating a method of assigning functions to operation members in the second embodiment. [Figure 8] 10A to 10C are diagrams illustrating a method of assigning functions to operation members in the second embodiment. [Figure 9] 10A to 10C are diagrams illustrating a method of assigning functions to operation members in the second embodiment. [Figure 10] 10 is a flowchart showing a control process according to a second embodiment. [Figure 11] 10 is a flowchart showing a control process according to a second embodiment. [Figure 12] FIG. 10 is a diagram illustrating an example of a display setting screen for a gaze pointer. DETAILED DESCRIPTION OF THE INVENTION

[0012] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the invention claimed. Although multiple features are described in the embodiments, not all of these multiple features are necessarily essential to the invention, and multiple features may be combined arbitrarily. Furthermore, in the accompanying drawings, the same reference numerals are used to designate the same or similar components, and redundant explanations will be omitted.

[0013] An embodiment in which the imaging device of the present invention is applied to a digital single-lens reflex camera capable of taking still images and recording moving images will be described in detail below with reference to the accompanying drawings. While this embodiment describes an example in which the imaging device of the present invention is applied to a digital camera, the present invention is not limited to this example and can be applied to any device equipped with a camera function. In other words, the present invention can also be applied to tablet devices equipped with a camera function, mobile phones and smartphones, music players, game consoles, e-book readers, and the like.

[0014] [First embodiment] <Device Configuration> The configuration and functions of the digital camera 100 of this embodiment will be described with reference to FIGS.

[0015] FIG. 1(a) is a front perspective view of the digital camera 100 with the lens unit 200 removed, and FIG. 1(b) is a rear perspective view of the digital camera 100. FIG.

[0016] In FIG. 1, the rear display unit 101 is a display device such as a liquid crystal panel or organic EL panel provided on the rear surface of the camera body outside the viewfinder, which displays images and various information so that the user can view them. The rear display unit 101 also has functions for playing back still images after capturing a still image, displaying moving images during recording, and displaying a live view. The rear display unit 101 is provided with a touch panel 270a. The touch panel 270a is a touch detection means capable of detecting contact (touch operation) with the display surface of the rear display unit 101 (the operation surface of the touch panel 270a). The outside-finder display unit 243 is a display device such as a liquid crystal panel or organic EL panel provided on the top surface of the camera body, which displays various camera settings such as shutter speed and aperture.

[0017] The shutter button 102 is a push-button type operating member used to issue shooting instructions. The mode selector switch 103 is a dial type operating member used to switch between various modes. The mode selector switch 103 switches the operation mode of the system control unit 201 between still image shooting mode, video recording mode, and playback mode. The still image shooting modes include, for example, auto shooting mode, auto scene determination mode, manual mode, aperture priority mode (Av mode), shutter speed priority mode (Tv mode), and program AE mode (P mode). The still image shooting modes also include, for example, various scene modes, program AE mode, custom mode, etc., which provide shooting settings for different shooting scenes.

[0018] The mode selector switch 103 is used to directly switch to one of the multiple modes included in the still image shooting mode. Alternatively, after the mode selector switch 103 is used to switch to the still image shooting mode, another operating member may be used to switch to one of the multiple modes included in the still image shooting mode. Similarly, the moving image recording mode and playback mode may also include multiple modes.

[0019] The terminal cover 104 is a cover member that protects a connector (not shown) for connecting an external device to the digital camera 100 via a cable such as a USB. The main electronic dial 105 is a rotary operation member included in the operation unit 270, which will be described later with reference to Fig. 2, and by turning this main electronic dial 105, settings such as the shutter speed and aperture can be changed.

[0020] The power switch 106 is an operating member that switches the power of the digital camera 100 on and off. The sub electronic dial 107 is a rotary operating member that moves the selection frame, advances through images, etc. The cross key 108 is a movement instruction member that can perform an operation corresponding to the part of the cross key 108 that is pressed by pressing one of the four directional buttons consisting of up, down, left, and right. The SET button 109 is a push-button operating member that is mainly used to confirm a selection item, etc.

[0021] The record button 110 is a push-button type operating member used to switch the live view display on / off in still image shooting mode and to start or stop video shooting (recording) in video recording mode. The enlarge button 111 is a push-button type operating member used to turn the enlarged display on / off during live view and to change the magnification ratio during enlarged display. The enlarge button 111 is also used to enlarge the playback image and increase the magnification ratio in playback mode. After turning on the enlarged display, the live view can be enlarged or reduced by operating the main electronic dial 105. In playback mode, it also functions as an enlargement button to enlarge the playback image and increase the magnification ratio. The AE lock button 112 is a push-button type operating member that can fix the exposure state by pressing it in shooting standby mode.

[0022] The playback button 113 is a push-button type operating member used to switch between shooting mode and playback mode. Pressing the playback button 113 during shooting mode switches to playback mode, and the most recent image of the images recorded on the recording medium 250 can be displayed on the rear display unit 101. The menu button 114 is a push-button type operating member that, when pressed, displays a menu screen on the rear display unit 101 on which various settings can be made. The user can intuitively make various settings using the menu screen displayed on the rear display unit 101, the cross key 108, the SET button 109, or the multi-controller 115.

[0023] The AF-on button 116 is an operating member capable of instructing the execution of a function of performing AE (auto exposure) processing and AF (auto focus) processing on a predetermined subject in a live view image, and a function of switching the target of AF processing to a subject specified by the user's gaze input. Similar to the shutter button 102 (described later), the AF-on button 116 is a push-button type operating member that can be operated in two stages: a first stage, in which the button is turned on during operation (halfway pressed) and generates a first AF-on signal SW3, and a second stage, in which the button is turned on upon completion of operation (fully pressed) and generates a second AF-on signal SW4. When the AF-on button 116 is operated to the first stage, the system control unit 201 executes the AE processing and AF processing on the subject, and when the button is operated to the second stage following the first stage, the system control unit 201 executes the function of switching to a subject specified by the user's gaze input. The functions executed in response to halfway pressing and fully pressing the AF-on button 116 can be assigned using a setting screen (described later in FIG. 6 ), the cross key 108, the SET button 109, or the multi-controller 115. It is also possible to assign functions other than AE processing, AF processing, and switching of subjects based on eye gaze input to the halfway and full press operations of the AF-on button 116. It is also possible to configure other operating members, as well as the AF-on button 116, so that the user can set the function to be executed. The function to be executed when the shutter button 102 is halfway pressed may also be changeable. For example, the user may be able to change whether or not AE processing and AF processing are executed when the shutter button 102 is halfway pressed. However, if the shutter button 102 is fully pressed to which the function of photographing and recording processing is assigned, photographing will become impossible if the assigned function is changed. Therefore, the function to be executed (the assigned function) by the user cannot be changed when the shutter button 102 is fully pressed.

[0024] The rear display unit 101 and a finder display unit 229 (described later) are controlled by the system control unit 201 as an electronic viewfinder (hereinafter referred to as EVF) in accordance with the various operation modes described above.

[0025] The eyepiece 216 is a peer-type eyepiece finder. The user can view the image displayed on the finder display unit 229 through the eyepiece 216, and can check the focus and composition of the subject image captured through the lens unit 200.

[0026] The eyepiece detector 217 is disposed near the eyepiece 216 and can detect the approach of an object to the eyepiece 216. The eyepiece detector 217 is, for example, an infrared proximity sensor.

[0027] The communication terminal 210 is an electrical contact that enables the digital camera 100 to communicate with the lens unit 200 (FIG. 2). The cover 118 is a member that opens and closes a slot to insert and remove the recording medium 250 into the digital camera 100. The grip section 117 has a shape that makes it easy for the user to hold the digital camera 100 in their right hand. When the digital camera 100 is held by gripping the grip section 117 with the little finger, ring finger, and middle finger of the right hand, the shutter button 102 and main electronic dial 105 are located in positions that can be operated with the index finger of the right hand. In the same state, the sub electronic dial 107 is located in a position that can be operated with the thumb of the right hand.

[0028] Next, the internal configuration of the digital camera 100 and lens unit 200 of this embodiment will be described with reference to Fig. 2. In Fig. 2, components common to Fig. 1 are denoted by the same reference numerals.

[0029] 2, the lens unit 200 is equipped with a photographing lens 207 and is detachable from the digital camera 100. The photographing lens 207 is usually made up of multiple lenses, but for simplicity's sake, it is shown here as only one lens. The communication terminal 206 is an electrical contact that enables the lens unit 200 to communicate with the digital camera 100. The communication terminal 210 is an electrical contact that enables the digital camera 100 to communicate with the lens unit 200. The lens unit 200 communicates with the system control unit 201 via the communication terminal 206, and the built-in lens control unit 204 controls the aperture drive circuit 202 to drive the aperture 205 and controls the AF drive circuit 203 to change the position of the photographing lens 207, thereby adjusting the focus.

[0030] The focal plane shutter 221 can freely control the exposure time of the imaging unit 222 in response to instructions from the system control unit 201. The imaging unit 222 is an image sensor composed of imaging elements such as CCD or CMOS that convert a subject image into an electrical signal. The A / D converter 223 converts the analog signal of one pixel output from the imaging unit 222 into, for example, a 10-bit digital signal.

[0031] The image processing unit 224 performs predetermined pixel interpolation, resizing (e.g., reduction), and color conversion on data from the A / D converter 223 or data from the memory control unit 215. The image processing unit 224 also performs predetermined calculations for photometry and distance measurement using the captured image data, and the system control unit 201 performs exposure control and distance measurement control based on the calculation results. This results in TTL (through-the-lens) AF, AE, and EF (pre-flash) processing. The image processing unit 224 also performs predetermined calculations for white balance processing using the captured image data, and TTL AWB (auto white balance) processing based on the calculation results. The image processing unit 224 also performs subject detection processing using the captured image data to detect the type, part, and condition (type) of the subject, as well as the position and size (area) of the subject. The image processing unit 224 is also capable of face AF and pupil AF. Face AF refers to performing AF on a face in an image detected by subject detection processing. Pupil AF refers to performing AF on an eye included in a face in an image detected by subject detection processing. In addition, the system control unit 201 determines a predetermined subject from one or more subjects detected by the image processing unit 224 automatically or by user operation, and displays a frame indicating that the predetermined subject is a target for AE processing and AF processing.

[0032] The memory control unit 215 controls the exchange of data between the A / D converter 223, the image processing unit 224, and the memory 232. Digital data output from the A / D converter 223 is written to the memory 232 via the image processing unit 224 and the memory control unit 215, or directly via the memory control unit 215. The memory 232 stores image data obtained from the imaging unit 222 and the A / D converter 223, and image display data to be displayed on the rear display unit 101 or the in-finder display unit 229. The memory 232 has a storage capacity sufficient to store a predetermined number of still images and a predetermined length of moving images and audio. The memory 232 also serves as a memory for image display (video memory).

[0033] The D / A converter 219 converts image display data stored in the memory 232 into an analog signal and supplies it to the rear display unit 101 or the viewfinder display unit 229. The display image data written to the memory 232 is displayed on the rear display unit 101 or the viewfinder display unit 229 via the D / A converter 219. The rear display unit 101 or the viewfinder display unit 229 performs display on a display device according to the analog signal from the D / A converter 219. In this way, by converting the digital signal stored in the memory 232 into an analog signal and sequentially transferring and displaying it on the rear display unit 101 or the viewfinder display unit 229, it functions as an EVF that performs live view display (through image display).

[0034] Various camera settings such as shutter speed and aperture are displayed on the outside viewfinder display section 243 via an outside viewfinder display section drive circuit 244 .

[0035] The nonvolatile memory 256 is an electrically erasable and recordable memory, such as an EEPROM. Constants, programs, etc. for the operation of the system control unit 201 are stored in the nonvolatile memory 256. The programs referred to here are programs for executing the flowcharts described below.

[0036] The system control unit 201 includes a CPU and MPU that provide overall control of the digital camera 100, and executes programs stored in a nonvolatile memory 256 to implement the processes in the flowcharts described below. The system memory 252 is a RAM or the like, and is also used as a work memory for expanding constants and variables for the operation of the system control unit 201, programs read from the nonvolatile memory 256, and the like. The system control unit 201 also controls display by controlling the memory 232, D / A converter 219, rear display unit 101, viewfinder display unit 229, and the like. The system timer 253 is a timing unit that measures the time used for various controls and the time of the built-in clock.

[0037] The first shutter switch 211 is turned on when the shutter button 102 provided on the digital camera 100 is pressed halfway (a shooting preparation instruction) and generates a first shutter switch signal SW1. Upon receiving the first shutter switch signal SW1, the system control unit 201 starts AE processing, AF processing, AWB processing, EF processing, etc. using the image processing unit 224.

[0038] The second shutter switch 212 is turned on when the shutter button 102 is fully pressed (a shooting instruction) and generates a second shutter switch signal SW2. The system control unit 201 starts a series of recording processes, from reading out a signal from the imaging unit 222 to writing image data to the recording medium 250, in response to the second shutter switch signal SW2.

[0039] The operation unit 270 is made up of operation members such as various switches and buttons that accept various operations from the user and notify the system control unit 201, and includes at least the following operation members: a shutter button 102, a mode selector switch 103, a main electronic dial 105, a power switch 106, a sub electronic dial 107, a cross key 108, a SET button 109, a record button 110, a magnification button 111, an AE lock button 112, a playback button 113, a menu button 114, a multi-controller 115, and an AF-on button 116.

[0040] It should be noted that a desired function can be assigned to each operation member included in the operation unit 270 using the menu screen, the cross key 108, the SET button 109, or the multi-controller 115.

[0041] The power supply control unit 280 is configured with a battery detection circuit, a DC-DC converter, a switch circuit for switching between blocks to be energized, and detects whether a battery is installed, the type of battery, and the remaining battery power. The power supply control unit 280 also controls the DC-DC converter based on the detection results and instructions from the system control unit 201, and supplies the required voltage for the required period to each unit, including the recording medium 250.

[0042] The power supply unit 230 is composed of a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, or a Li-ion battery, an AC adapter, etc. The recording medium I / F 218 is an interface with a recording medium 250 such as a memory card or a hard disk. The recording medium 250 is a recording medium such as a memory card for recording captured images, and is composed of a semiconductor memory, a magnetic disk, etc.

[0043] The communication unit 254 is communicably connected to an external device via a wireless antenna or a wired cable, and transmits and receives images and audio. The communication unit 254 can also be connected to a wireless LAN (Local Area Network) or the Internet. The communication unit 254 can transmit image data (including live view images) captured by the imaging unit 222 and image files recorded on the recording medium 250 to an external device, and can also receive image data and various other information from an external device. Note that the communication unit 254 is not limited to a wireless LAN, and may use a wireless communication module such as infrared communication, Bluetooth (registered trademark), Bluetooth (registered trademark) Low Energy, or Wireless USB, or a wired connection means such as a USB cable, HDMI (registered trademark), or IEEE1394.

[0044] The orientation detection unit 255 detects the orientation of the digital camera 100 with respect to the direction of gravity. Based on the orientation detected by the orientation detection unit 255, it is possible to determine whether an image captured by the imaging unit 222 was captured with the digital camera 100 held horizontally or vertically. The system control unit 201 can add orientation information corresponding to the orientation detected by the orientation detection unit 255 to the image file of the image captured by the imaging unit 222, or rotate and record the image. An acceleration sensor, a gyro sensor, or the like can be used as the orientation detection unit 255. By using an acceleration sensor or a gyro sensor, the orientation detection unit 255 can also detect movements of the digital camera 100 (panning, tilting, lifting, standing still, etc.).

[0045] The operation unit 270 includes a touch panel 270a capable of detecting touch operations on the rear display unit 101. The touch panel 270a and the rear display unit 101 can be configured as an integrated unit. For example, the touch panel 270a is configured so that its light transmittance does not interfere with the display on the rear display unit 101, and is attached to the upper layer of the display surface of the rear display unit 101. Then, input coordinates on the touch panel 270a are associated with display coordinates on the rear display unit 101. This makes it possible to configure a GUI that gives the user the impression that they can directly operate the screen displayed on the rear display unit 101. The system control unit 201 can detect the following operations or states on the touch panel 270a.

[0046] A finger or pen that has not been touching the touch panel 270a touches the touch panel 270a again, that is, the start of touching (hereinafter referred to as touch-down).

[0047] The touch panel 270a is in a state of being touched with a finger or a pen (hereinafter referred to as Touch-On).

[0048] Touching the touch panel 270a with a finger or a pen and moving it (hereinafter referred to as Touch-Move).

[0049] The finger or pen that has been touching the touch panel 270a is released, that is, the touch ends (hereinafter referred to as "touch-up").

[0050] A state in which nothing is touching the touch panel 270a (hereinafter referred to as Touch-Off).

[0051] When touch down is detected, touch on is also detected at the same time. After touch down, touch on will usually continue to be detected unless touch up is detected. Touch move is also detected when touch on is detected. Even if touch on is detected, touch move will not be detected unless the touch position moves. Once it is detected that all fingers or pens that were touching have touched up, touch off occurs.

[0052] These operation states and the position coordinates of the finger or pen touching the touch panel 270a are notified to the system control unit 201 via the internal bus. The system control unit 201 determines what kind of operation (touch operation) has been performed on the touch panel 270a based on the notified information.

[0053] Regarding touch-move, the movement direction of a finger or pen moving on the touch panel 270a can also be determined for each vertical and horizontal component of the touch panel 270a based on changes in position coordinates. When a touch-move of a predetermined distance or more is detected, it is determined that a slide operation (drag) has been performed. An operation in which a finger is touched to the touch panel 270a, quickly moved a certain distance, and then released is called a flick. In other words, a flick is an operation in which a finger is quickly traced across the touch panel 270a as if flicking. When a touch-move of a predetermined distance or more at a predetermined speed or more is detected, followed by a touch-up, it is determined that a flick has been performed (a drag followed by a flick). Furthermore, a touch operation in which multiple points (e.g., two points) are touched simultaneously and the touch positions are brought closer together is called a pinch-in, and a touch operation in which the touch positions are moved farther apart is called a pinch-out. Pinch-out and pinch-in are collectively referred to as a pinch operation (or simply pinch).

[0054] The touch panel 270a may be any of a variety of touch panel types, including resistive film type, capacitive type, surface acoustic wave type, infrared type, electromagnetic induction type, image recognition type, optical sensor type, etc. Depending on the type, there are types that detect a touch by contact with the touch panel, and types that detect a touch by the approach of a finger or pen to the touch panel, but either type may be used.

[0055] The eyepiece detection unit 217 detects whether the eye (object) is approaching (eye proximity) or moving away (eye distance) from the eyepiece unit 216 (approach detection). The system control unit 201 switches the display (display state) / non-display (non-display state) of the rear display unit 101 and the viewfinder display unit 229 depending on the state detected by the eyepiece detection unit 217. At least in shooting mode and when the display destination switching is automatic, the system control unit 201 sets the display destination to the rear display unit 101 when the eye is not in contact with the subject and sets the viewfinder display unit 229 to non-display. Furthermore, when the eye is in contact with the subject, the display destination is set to the viewfinder display unit 229 and sets the rear display unit 101 to non-display.

[0056] When an object approaches, infrared light emitted from a light-emitting unit (not shown) of the eyepiece detection unit 217 is reflected and incident on a light-receiving unit (not shown) of the infrared proximity sensor. The amount of incident infrared light received by the infrared proximity sensor can be used to detect the approach of an object to the eyepiece 216 and determine the distance (eyepiece distance) from the eyepiece 216 to which the object is approaching. When an object is detected approaching the eyepiece 216, the system control unit 201 can start displaying the viewfinder display unit 229. This allows the viewfinder display unit 229 to be displayed with as little delay as possible when the user looks through the eyepiece 216.

[0057] Furthermore, when the eyepiece detection unit 217 detects an object approaching within a predetermined distance from the eyepiece unit 216 from a non-eyepiece state (non-approach state), it determines that an eyepiece has been detected, and transmits an eyepiece detection notification to the system control unit 201. When the object whose approach was detected from the eyepiece state (approach state) moves away by more than a predetermined distance, it determines that an eyepiece has been detected, and transmits an eyepiece detection notification to the system control unit 201. The threshold for detecting eyepiece proximity and the threshold for detecting eyepiece separation may be different, for example, by providing hysteresis. Furthermore, after detecting eyepiece proximity, the eyepiece remains in the eyepiece state until eyepiece separation is detected. After detecting eyepiece separation, the eyepiece remains in the non-eyepiece state until eyepiece proximity is detected. As a result, the system control unit 201 controls the display of the rear display unit 101 and the viewfinder display unit 229 depending on the eyepiece state or eyepiece separation state detected by the eyepiece detection unit 217.

[0058] The eye proximity detection unit 217 is not limited to an infrared proximity sensor, and any other sensor may be used as long as it can detect the approach of an eye or an object that can be regarded as an eye.

[0059] The gaze detection unit 260 includes a dichroic mirror 262, an imaging lens 263, a gaze detection sensor 264, a gaze detection circuit 265, and an infrared light emitting element 266, and detects not only whether the user is gazing at the viewfinder display unit 229, but also the position and movement of the gaze.

[0060] The digital camera 100 of this embodiment detects the gaze using a method called the corneal reflex method with the gaze detection unit 260. The corneal reflex method detects the gaze position and direction from the positional relationship between the light reflected by the eyeball (eye) 261 (particularly the cornea) and the pupil of the eyeball (eye) 261 when infrared light emitted from the infrared light-emitting element 266 is reflected. There are also various other gaze position and direction detection methods, such as a method called the scleral reflex method, which utilizes the difference in light reflectance between the black and white of the eye. Note that any gaze detection method other than those described above may be used as long as it can detect the gaze position and direction. The digital camera 100 of this embodiment allows the display setting of the gaze pointer when the gaze input function is on to be performed using a menu screen such as the one shown in FIG. 12. On the gaze pointer display setting screen of FIG. 12, the user can operate the operation unit 270 to select and set the gaze pointer display setting from among "on," "only while waiting to shoot," and "off." When the gaze pointer display setting is set to “Yes,” the system control unit 201 controls the viewfinder display unit 229 to display a gaze pointer indicating the gaze position detected by the gaze detection unit 260 superimposed on a live view image when the gaze input function is on. By displaying the gaze pointer, the user can grasp the currently detected gaze position and, when specifying a position using the gaze input function, can confirm in advance which position will be specified. When the gaze pointer display setting is set to “No,” the system control unit 201 controls not to display the gaze pointer indicating the gaze position. When “Only during shooting standby” is set, the system control unit 201 controls to display the gaze pointer when the gaze input function is on. However, while shooting preparation processing such as AF processing and AE processing is being performed by fully pressing the shutter button 102 or halfway pressing the shutter button 102, the gaze pointer is hidden even if the gaze is detected by the gaze detection unit 260. In other words, the gaze pointer is controlled to be displayed only when AF processing and AE processing are not being performed.While AF and AE processing is being performed, the user may want to look at the live view image to check whether the subject is in focus, but if the gaze pointer is displayed at the eye position, it will be difficult to confirm the subject. Therefore, a setting called "Only while waiting to shoot" has been provided which does not display the gaze pointer while the shooting preparation processing is being performed.

[0061] The infrared light emitting element 266 is a diode that emits infrared light for detecting the position of the user's line of sight within the finder screen, and irradiates the infrared light toward the user's eyeball (eye) 261, near the center of the eyepiece 216. The infrared light irradiated from the infrared light emitting element 266 is reflected by the eyeball (eye) 261, and the reflected infrared light reaches the dichroic mirror 262. The dichroic mirror 262 has the function of reflecting only infrared light and transmitting visible light, and the reflected infrared light, whose optical path has been changed, forms an image on the imaging surface of the line of sight detection sensor 264 via the imaging lens 263.

[0062] The imaging lens 263 is an optical element that constitutes the gaze detection optical system. The gaze detection sensor 264 includes an image sensor such as a CCD or CMOS. The gaze detection sensor 264 photoelectrically converts incident reflected infrared light into an electrical signal and outputs the signal to the gaze detection circuit 265. The gaze detection circuit 265 detects the user's gaze position from the movement of the user's eyeball (eye) 261 and the position of the pupil based on the output signal from the gaze detection sensor 264, and outputs the detected information to the system control unit 201. Because the gaze detection sensor 264 can detect the pupil of a person's eye, it does not detect that a person's gaze is being input even if another object is approaching or touching the eyepiece unit 216. This allows the eyepiece unit 216 to function as a gaze operation unit, but the gaze detection unit may have a different configuration. The user can enable / disable the gaze input function by the gaze detection unit 260 via a menu screen, for example.

[0063] The system control unit 201 can detect the following operations or states of the eyepiece unit 216 based on the detection result of the line of sight detection unit 260. The gaze of the user who has placed his / her eye on the eyepiece unit 216 has been newly input (detected) (start of gaze input). The user is performing gaze input by placing his / her eye on the eyepiece unit 216. The user is gazing at the eyepiece 216. The user who has placed his / her eye on the eyepiece unit 216 moves his / her gaze away from the eyepiece unit 216 (end of gaze input). A state in which the user puts their eye in the eyepiece 216 and does not input anything by eye. These operation states and the input position of the gaze on the eyepiece unit 216 are notified to the system control unit 201, and the system control unit 201 can determine what kind of operation (gaze operation) was performed on the eyepiece unit 216 based on the notified information.

[0064] Note that "gazing" refers to a situation where the user's gaze position does not exceed a predetermined amount of movement within a predetermined time. That is, based on the detection information received from the gaze detection circuit 265, the system control unit 201 determines that the user is gazing at a certain area when the period during which the user's gaze is fixed on that area exceeds a predetermined threshold. Therefore, that area can be said to be the gaze position (gazing area) where the gaze is performed. Note that "the gaze is fixed on a certain area" means, for example, that the average position of the gaze movement is within that area until a predetermined period has elapsed, and the variation (variance) is less than a predetermined value.

[0065] <Control Processing> Next, the control processing of the digital camera 100 of the first embodiment will be described with reference to FIGS.

[0066] 3 and 4 are flowcharts showing the control processing of the digital camera 100 of the first embodiment. The processing of FIG. 3 is realized when the digital camera 100 is powered on and the system control unit 201 loads a program stored in the nonvolatile memory 256 into the system memory 252, executes the program, and controls each component. The processing of FIG. 3 may be performed not only immediately after the digital camera 100 is started up, but also immediately after the digital camera 100 transitions to a still image capture mode or a video recording mode and starts displaying a live view image. The processing of FIG. 3 excerpts only the processing related to the operation of the AF-on button 116 in a shooting standby state (a state in which shooting and recording processing due to the shutter button 102 being fully pressed in shooting mode has not been executed). In other words, the processing described in the device configuration is also executed in addition to the processing of FIG. 3. That is, the system control unit 201 executes shooting preparation processing such as AE processing, AF processing, AWB processing, and EF processing in response to the shutter button 102 being half-pressed (SW1 ON). The system control unit 201 also executes recording processing in response to the shutter button 102 being fully pressed (SW2 ON).

[0067] In step S301, the system control unit 201 successively updates and displays a live view image captured by the imaging unit 222 on the rear display unit 101. The display process for the live view image is executed continuously during the process of FIG.

[0068] In step S302, the system control unit 201 causes the image processing unit 224 to perform subject detection processing on the live view image.

[0069] In step S303, the system control unit 201 determines whether or not a specified subject has been detected by the subject detection processing of the image processing unit 224, and if it is determined that the specified subject has been detected, the process proceeds to step S304, and if it is not determined that the specified subject has been detected, the process proceeds to step S305.

[0070] In step S304, the system control unit 201 receives position information of the predetermined subject detected in step S302 from the image processing unit 224 and displays a subject frame surrounding the predetermined subject in the image displayed on the rear display unit 101. Note that if a subject to be AF-targeted is selected by the user through a user operation, for example, a full press of the AF-on button 116 to confirm the AF position at the line of sight, or a touch operation on the rear display unit 101 to specify the AF position, a subject frame indicating that the subject is already selected may be displayed. If the subject is not a subject selected by the user but a subject automatically selected by the system control unit 201, a normal single-line subject frame may be displayed, whereas if the subject is a subject selected by the user, a double-line subject frame may be displayed, and the subject may be displayed in a different display form (shape, color, etc.) so that it can be identified as a selected subject. Also, once a subject selected by the user has been selected, the image processing unit 224 may track the subject, and a subject frame may be displayed at the position of the tracked subject.

[0071] In step S305, the system control unit 201 displays a fixed AF frame of a certain size at the AF position specified by the user using the cross key 108, the SET button 109, or the multi-controller 115 in the image displayed on the rear display unit 101. Note that if a subject is not detected in step S302, the system control unit 201 may skip the process of step S305 and proceed to step S306.

[0072] In step S306, the system control unit 201 receives information about the user's gaze position detected by the gaze detection unit 260, and displays the gaze position on the image displayed on the rear display unit 101. Note that if the gaze input function of the digital camera 100 is disabled, the processing of step S306 may be omitted.

[0073] In step S307, the system control unit 201 determines whether the AF-on button 116 is half-pressed. The system control unit 201 determines that the AF-on button 116 is half-pressed when it detects a first AF-on signal SW3 from the AF-on button 116. If the system control unit 201 determines that the AF-on button 116 is half-pressed, the process proceeds to step S308; if it determines that the AF-on button 116 is not half-pressed, the process returns to step S301.

[0074] In step S308, the system control unit 201 executes AE processing by exposure control based on the photometric calculation result obtained by the image processing unit 224.

[0075] In step S309, the system control unit 201 determines, as the AF position, the subject frame or fixed AF frame determined as the AF target in the processing of steps S303 to S305 by the image processing unit 224. The digital camera 100 of the first embodiment does not perform AE / AF processing during steps S301 to S306 when the AF-on button 116 is not operated, but performs AE / AF processing when the AF-on button 116 is pressed halfway or all the way. AE / AF processing is also performed when the shutter button 102 is pressed halfway.

[0076] In step S310, the system control unit 201 executes AF processing by distance measurement control based on the distance measurement calculation result of the AF position determined in step S309, which is obtained by the image processing unit 224, and displays an AF frame indicating the result of the AF processing on the rear display unit 101. The AF frame indicating the result of the AF processing is displayed by displaying it in a color or shape different from the subject frame and the fixed frame. Note that if the AF operation setting can be set on the menu screen, and if the AF operation setting is set to one-shot (single-point) AF, the system control unit 201 controls the AF processing to be executed only once when the AF-on button 116 is half-pressed. Also, if the AF operation setting is set to servo AF, the system control unit 201 controls the AF processing to continue for the determined AF position and update the display of the AF frame indicating the AF result. Also, if the AF operation setting is set to servo AF on the menu screen and subject tracking is also set, the system control unit 201 controls the AF processing to be executed and the AF processing to be executed with the tracked subject position as the AF position.

[0077] In step S311, the system control unit 201 determines whether the half-press of the AF-on button 116 has been released, that is, whether the AF-on button 116 is no longer being operated. The system control unit 201 determines that the half-press of the AF-on button 116 has been released when the system control unit 201 no longer detects the first AF-on signal SW3 from the AF-on button 116. If the system control unit 201 determines that the half-press of the AF-on button 116 has been released, it returns the process to step S301. If the system control unit 201 determines that the half-press of the AF-on button 116 has not been released, it proceeds to step S312.

[0078] In step S312, the system control unit 201 determines whether the AF-on button 116 has been fully pressed. If the system control unit 201 detects a second AF-on signal SW4 from the AF-on button 116, it determines that the AF-on button 116 has been half-pressed. If the system control unit 201 determines that the AF-on button 116 has been fully pressed, it proceeds to step S313. If the system control unit 201 determines that the AF-on button 116 has not been fully pressed, it returns the process to step S311.

[0079] In step S313, the system control unit 201 determines whether the gaze input function of the digital camera 100 is enabled, and if it determines that the gaze input function is enabled, proceeds to step S314, and if it determines that the gaze input function is not enabled, returns to step S311.

[0080] In step S314, the system control unit 201 determines the gaze position detected by the gaze detection unit 260.

[0081] In step S315, the system control unit 201 determines the gaze position determined in step S314 as the AF position.

[0082] In step S316, the system control unit 201 causes the image processing unit 224 to perform AE processing and AF processing on the subject at the AF position determined in step S315, and displays an AF frame on the rear display unit 101. Note that in step S316, as in step S310, the system control unit 201 switches between performing AF processing once or continuously performing AF processing depending on whether the AF operation setting is one-shot (single point) or servo AF. The system control unit 201 also updates the display of the AF frame that indicates the AF result, and, if subject tracking is set, performs subject tracking and controls the AF processing to be performed with the tracked subject position as the AF position.

[0083] In step S317, the system control unit 201 determines whether the full press of the AF-on button 116 has been released, that is, whether the AF-on button 116 has become half-pressed. The system control unit 201 determines that the full press of the AF-on button 116 has been released when the system control unit 201 no longer detects the second AF-on signal SW4 from the AF-on button 116. The system control unit 201 waits until it determines that the full press of the AF-on button 116 has been released, and if it determines that the AF-on button 116 has been released, the process proceeds to step S318.

[0084] In step S318, the system control unit 201 determines whether the shooting operation has ended, for example, by changing the operating mode of the digital camera 100, and if it determines that the shooting operation has ended, it ends the processing, and if it determines that the shooting operation has not ended, it returns the processing to step S311.

[0085] If it is determined in step S317 that the AF-on button 116 has been released from its fully pressed state, the process may proceed to step S308, where the AE process and AF process may be performed again at the position of the subject frame or fixed AF frame.

[0086] Furthermore, if the eye-gaze input function is disabled, even if the AF-on button 116 is fully pressed in step S312, the AE process and AF process may be continued at the position of the subject frame or fixed AF frame in steps S308 to S310.

[0087] Next, with reference to FIG. 4, a control process when the eye-gaze input function of the digital camera 100 of the first embodiment is disabled will be described.

[0088] In FIG. 3, if the eye gaze input function is disabled in step S313, the state is immediately after AF is performed at the position of the subject frame or fixed AF frame by half-pressing the AF-on button 116 in steps S307 to S310, but the control processing shown in FIG. 4(a) or 4(b) may also be executed.

[0089] FIG. 4(a) shows the process of switching between pupil AF and face AF when the eye-gaze input function is disabled in step S313 of FIG.

[0090] In steps S401 and S312, the same processes as in steps S301 to S312 in FIG. 3 are performed.

[0091] If it is determined in step S313 that the eye-gaze input function of the digital camera 100 is enabled, the system control unit 201 executes the processing of steps S314 and S315, and if it is determined that the eye-gaze input function is not enabled, the processing proceeds to step S402.

[0092] In step S402, the system control unit 201 determines whether AF processing for the subject's pupil (pupil AF function) is enabled, and if it is determined that the pupil AF function is enabled, proceeds to step S403, and if it is determined that the pupil AF function is not enabled, proceeds to step S405.

[0093] In step S403, the system control unit 201 disables the pupil AF function and enables AF processing (face AF function) for the face (entire face) of the subject.

[0094] In step S404, the system control unit 201 detects the face of the subject using the image processing unit 224, determines the position of the detected face as the AF position, and in step S407 executes AE processing and AF processing for the determined AF position and displays an AF frame on the rear display unit 101. Note that in step S404, a rectangular area including the entire subject may be detected instead of the face of the subject.

[0095] In step S405, the system control unit 201 enables the pupil AF function.

[0096] In step S406, the system control unit 201 detects the pupil of the subject in the subject frame using the image processing unit 224, determines the detected pupil position as the AF position, proceeds to step S407, executes AE processing and AF processing for the determined AF position (step S316), and displays the AF frame on the rear display unit 101.

[0097] In step S407, the same processes as those in steps S316 to S322 in FIG. 3 are performed.

[0098] In steps S402 to S406, the pupil AF function is switched between enabled and disabled each time the AF-on button 116 is repeatedly pressed fully (after the AF-on button 116 is released and then fully pressed again). This allows the AF process to be performed while switching the AF position between the face and the eye of the subject. Instead of switching the AF position between the face and the eye of the subject each time the AF-on button 116 is repeatedly pressed fully, the AF position may be switched between the face, right eye, or left eye of the subject. Alternatively, the AF position may be switched between the right eye and left eye of the subject each time the AF-on button 116 is repeatedly pressed fully.

[0099] Note that in steps S402 to S406, the pupil AF function may be always disabled, and the pupil AF function may be enabled to perform AF processing on the subject's pupil only while the AF-on button 116 is fully pressed.

[0100] FIG. 4(b) shows the process of switching the subject to be AF-targeted when the eye-gaze input function is disabled.

[0101] In steps S401 and S351, the same processes as in steps S301 to S312 in FIG. 3 are performed.

[0102] If it is determined in step S313 that the eye-gaze input function of the digital camera 100 is enabled, the system control unit 201 executes the processing of steps S314 and S315, and if it is determined that the eye-gaze input function is not enabled, the processing proceeds to step S408.

[0103] In step S408, the system control unit 201 searches for the subject detected in step S303, and displays a subject frame for a subject different from the subject determined as the AF position in step S309.

[0104] In step S409, the system control unit 201 determines the subject frame displayed in step S408 as the AF position, and in step S407 performs AE processing and AF processing for the determined AF position, and displays the AF frame on the rear display unit 101. Note that in step S408, a rectangular area including the entire subject may be detected instead of the face of the subject.

[0105] In step S407, the same processes as those in steps S316 to S322 in FIG. 3 are performed.

[0106] In steps S408 and S409, the subject to be AF-targeted may be switched to another subject in sequence while the AF-on button 116 is repeatedly pressed halfway and fully.

[0107] Furthermore, in FIG. 4, when the AF-on button 116 is fully pressed and the gaze input function is disabled, the processing of steps S402 to S406 or steps S408 to S409 is executed, but the processing may be executed without determining whether the gaze input function is enabled or disabled.

[0108] Next, with reference to FIG. 5, the control process of the first embodiment will be described using a live view screen.

[0109] 5(a), a live view image is displayed on the rear display unit 101, a subject 501 is detected by the image processing unit 224, and a subject frame 502 is displayed at the position of the face of the subject 501. Also, on the screen of FIG. 5(a), a gaze icon 503 is displayed at the gaze position detected by the gaze detection unit 260.

[0110] 5(a), the user's line of sight is near the upper left of the screen. Note that if the line of sight input function is disabled, the line of sight icon 503 does not need to be displayed.

[0111] 5(a), a subject frame 502 is displayed around a subject 501, but if the subject cannot be detected, a fixed AF frame 510 may be displayed at a position designated by the user, or the fixed AF frame 510 may be displayed simultaneously with the subject frame 502. The size of the fixed AF frame 510 can be designated by the user as desired.

[0112] The screen in FIG. 5(b) illustrates a state in which the user half-presses the AF-on button 116 on the screen in FIG. 5(a).

[0113] The system control unit 201 causes the image processing unit 224 to perform AE processing and AF processing on the subject frame 502 of the subject 501 , and changes the subject frame 502 to an AF frame 504 .

[0114] If the subject cannot be detected, AE processing and AF processing are performed on the frame 510 in FIG. 5( a ), and an AF frame 504 is displayed at the position of the fixed AF frame 510 .

[0115] Even during the above processing, the gaze detection processing by the gaze detection unit 260 can be constantly performed, and the position of the gaze icon 503 is updated according to the gaze position of the user.

[0116] The example of FIG. 5(b) illustrates a state in which the user's line of sight is in the same position as in FIG. 5(a).

[0117] The screen in FIG. 5(c) illustrates a state in which the user's line of sight has been changed from the state in FIG. 5(b) to a subject 505.

[0118] During the period from FIG. 5(b) to FIG. 5(c), the gaze detection process by the gaze detection unit 260 can be constantly executed, similar to the example of FIG. 5(b).

[0119] Unlike the example in FIG. 5( a ), in the example in FIG. 5( c ), the position of the line-of-sight icon 503 has moved to the vicinity of the subject 505 , and the user's line of sight has been changed from the subject 501 to another subject 505 .

[0120] The screen in FIG. 5(d) illustrates a state in which the user has fully pressed the AF-on button 116 from the state in FIG. 5(c).

[0121] The system control unit 201 determines the gaze position detected by the gaze detection unit 260 as the position of the subject 505 .

[0122] The system control unit 201 causes the image processing unit 224 to execute AE processing and AF processing on the subject 505 at the determined gaze position, and displays the AF frame 504.

[0123] Note that even after the AF process is performed on the subject at the gaze position in the state of FIG. 5(d), the gaze detection section 260 may continue to detect the gaze, and the gaze icon 503 may continue to be displayed.

[0124] The screen in FIG. 5(e) illustrates a state in which the pupil AF function is enabled and AE processing and AF processing are performed on the pupil of the subject 501 when the AF-on button 116 is fully pressed.

[0125] 5(e), an pupil AF icon 506 is displayed, indicating that the pupil AF function is enabled. If the pupil AF function is disabled, the pupil AF icon 506 does not have to be displayed, or an icon indicating that the pupil AF function is disabled may be displayed.

[0126] In the example of FIG. 5(e), an pupil AF frame 507 is displayed, indicating that AE processing and AF processing have been performed on the pupil of the subject 501.

[0127] If the eye-gaze input function is disabled in step S402 of FIG. 4, the system control unit 201 enables the pupil AF function in step S405 and displays the pupil AF icon 506.

[0128] The system control unit 201 executes AE processing and AF processing on the pupil of the subject 501 detected by the image processing unit 224 , and displays the pupil AF frame 507 .

[0129] If the pupil AF function is disabled in step S403 of Figure 4, the system control unit 201 causes the image processing unit 224 to perform AE processing and AF processing on the face of the subject 501 in step S406 of Figure 4, and displays an AF frame 504 on the face of the subject 501.

[0130] In the state shown in FIG. 5(e), the pupil AF function may be executed on the subject 501 regardless of whether the eye-gaze input function is enabled or disabled.

[0131] The screen in FIG. 5(f) illustrates a state in which, when the AF-on button 116 is fully pressed, the subject is changed from the state in which the AF-on button 116 is half-pressed, and AE processing and AF processing are performed.

[0132] In the example of FIG. 5(f), a dotted frame 508 is displayed around the face of the subject 501 that was the AF position when the AF-on button 116 was half-pressed in steps S307 to S310 in FIG.

[0133] 4, when the AF-on button 116 is fully pressed, the system control unit 201 searches for candidates for a subject different from the subject 501 from the subjects detected by the image processing unit 224. Then, it is assumed that a subject 509 different from the subject 501 is found.

[0134] In this case, the system control unit 201 causes the image processing unit 224 to execute AE processing and AF processing on the face of the subject 509 and display the AF frame 504 .

[0135] As described above, the user can switch the subject to be AF-targeted simply by pressing the AF-on button 116 all the way down.

[0136] Specifically, when the gaze input function is enabled, the subject to be AF-targeted can be switched according to the user's gaze position simply by fully pressing the AF-on button 116. Furthermore, when the gaze input function is disabled, the subject to be AF-targeted can be switched to eye AF or face AF, or the subject to be AF-targeted can be switched, simply by fully pressing the AF-on button 116.

[0137] Note that the AF-on button 116 may be repeatedly pressed halfway and fully to sequentially switch between the AF target subjects and execute the AE process and the AF process.

[0138] Next, a method for assigning functions to the operation members included in the operation unit 270 of the first embodiment will be described with reference to FIG.

[0139] FIG. 6 shows an example of a setting screen for assigning a function to the AF-on button 116 of the first embodiment.

[0140] As an example of assigning functions to operation members included in the operation unit 270, a method of setting functions that can be executed when the AF-on button 116 is pressed halfway or fully is described below.

[0141] FIG. 6A shows an example of a setting screen 601 that displays a list of functions that can be assigned to the AF-on button 116 and functions assigned to other operation members.

[0142] In the display area 602, the name of the operation member corresponding to the position of the cursor 604 to which the user has moved using the cross key 108 or multi-controller 115, and the functions that can be assigned to the operation member are displayed.

[0143] In the display area 603, the names of the operation members and the simple names of the functions assigned to the operation members are displayed.

[0144] In the example of FIG. 6(a), the AF-on button 116 is selected, the name of the AF-on button 116 and the name of the current function are displayed in a display area 602, and a cursor 604 is displayed in a display area 603 of the AF-on button 116.

[0145] When the display area 603 at the position of the cursor 604 is touched or the SET button 109 is operated while the display area 603 at the position of the cursor 604 is selected, a setting screen 605 (FIG. 6(b)) for setting the function to be assigned to the AF-on button 116 is displayed.

[0146] FIG. 6B shows an example of a setting screen 605 that is displayed when the SET button 109 is operated with the AF-ON button 116 selected on the screen of FIG. 6A.

[0147] In the display area 606, the names (Set1 to Set5) of the functions that can be executed when the AF-on button 116 is pressed halfway or fully, and the contents of the functions are displayed.

[0148] In the display area 607, options indicating combinations of functions that can be assigned to the AF-on button 116 and that are executed when the button is pressed halfway and when the button is pressed all the way are simply displayed.

[0149] When one of the options in the display area 607 is touched or when the SET button 109 is operated with one of the options in the display area 607 selected, a screen 611 is displayed for setting the function to be executed when the AF-on button 116 is pressed halfway and the function to be executed when the AF-on button 116 is pressed all the way.

[0150] Furthermore, when the cursor is moved from option 607a to option 607b in display area 607, display area 606 is updated to show the simple name and function name of the function corresponding to option 607b.

[0151] When setting the functions that can be executed by half-pressing the AF-on button 116 and the functions that can be executed by fully pressing the button, the setting screen 611 shown in FIG. 6(c) is displayed by touching the INFO button 609 while the cursor 604 is positioned on the option 607a.

[0152] FIG. 6C shows an example of a setting screen 611 for setting functions that can be executed by half-pressing the AF-on button 116 and functions that can be executed by fully pressing the AF-on button 116.

[0153] A screen 611 displays a function display area 612 for half-pressing the AF-on button 116 and a function display area 613 for half-pressing the AF-on button 116, and the cursor 604 can be moved and selected using the multi-controller 115 or the cross key 108.

[0154] In the function display area 612, it is possible to confirm the function that will be executed when the AF-on button 116 is pressed halfway, and in the function display area 613, it is possible to confirm the function that will be executed when the AF-on button 116 is pressed all the way.

[0155] In the example of FIG. 6(c), "AE processing and AF processing" is set as the function to be executed when the AF-on button 116 is pressed halfway, and "moving the AF frame with the line of sight" is set as the function to be executed when the AF-on button 116 is pressed all the way.

[0156] When the cursor 604 is placed on the function display area 612 and the function selection touch button 614 is touched or the SET button 109 is operated, a screen 615 for selecting the function to be executed, as shown in FIG. 6(d), is displayed.

[0157] FIG. 6D shows an example of a screen for selecting a function to be executed when the AF-on button 116 is pressed halfway.

[0158] In addition, if you place the cursor 604 on the function display area 613 on the screen of Figure 6(c) and operate the function selection touch button 614 or the SET button 109, a screen similar to that of Figure 6(d) will be displayed, allowing you to select the function you want to execute by fully pressing the AF-on button 116.

[0159] In the example of FIG. 6(d), the cursor is placed on the option 616, and the option 616 "AE processing and AF processing" is selected by half-pressing the AF-on button 116.

[0160] For example, on the screen 615 in FIG. 6D, if the cursor is moved to "Function A" of the option 617, it is possible to set "Function A" of the option 617 to be executed when the AF-on button 116 is pressed halfway.

[0161] In the first embodiment, when the cursor 604 is moved on the screen 601 of FIG. 6(a) to select the AF-on button 116, the screen 605 of FIG. 6(b) is displayed, and it becomes possible to select a combination of functions that can be assigned to the AF-on button 116 and that are executed when the button is pressed halfway and that are executed when the button is pressed all the way. However, it is also possible to display the screen 611 of FIG. 6(c) from the screen 601 of FIG. 6(a) without going through the screen 605 of FIG. 6(b).

[0162] FIG. 6(e) shows an example of a screen for enabling or disabling the eye-gaze input function.

[0163] Selecting "Enable" in option 617 enables the gaze input function and allows gaze detection by the gaze detection unit 260. Selecting "Disable" in option 618 disables the gaze input function and prevents gaze detection by the gaze detection unit 260 from being performed.

[0164] In the first embodiment, when option 618 is selected, the gaze input function is disabled even if the AF-on button 116 is fully pressed, so that the AE processing and AF processing can be performed by switching the pupil AF function on or off, or by switching the subject to be AF-targeted, as described in FIG. 4.

[0165] As described above, according to the first embodiment, by half-pressing or fully pressing the AF-on button 116, it is possible to selectively use a function that executes AF (autofocus) processing and AE (autoexposure) processing on a subject in a live view image, and a function that switches the AF target to a subject specified by the user's gaze input. In this way, different AF-related functions can be instructed by half-pressing or fully pressing the AF-on button 116, thereby reducing the number of operation steps.

[0166] [Second embodiment] In the second embodiment, the user can set not only the function that is executed when the AF-on button 116 is fully pressed, but also the function that is executed when the AF-on button 116 is half-pressed. The device configuration of the second embodiment is the same as that of the first embodiment, and some of the control processing of the second embodiment is common to that of the first embodiment, so the same processes are denoted by the same reference numerals and descriptions thereof will be omitted.

[0167] The allocation of functions to the AF-on button 116 using the menu screen will be described with reference to FIGS.

[0168] FIG. 7A illustrates an example of a function assignment setting screen 700 for the AF-on button 116. As shown in FIG.

[0169] A function assignment setting screen 700 for the AF-on button 116 displays items 721 to 727 as setting items to which functions can be assigned to the AF-on button. Also displayed are a cursor 701 indicating the selected item, a setting content display area 710 for the selected item, a detailed setting icon 702, and an OK icon 703.

[0170] On the function assignment setting screen 700 for the AF-on button 116, the user can use the cross key 108 to move the cursor 701 to one of items 721 to 727 and change the selected item. Items 721 to 727 correspond to AFON1 to AFON7, respectively, and the combinations of functions assigned to halfway pressing and full pressing of the AF-on button 116 for AFON1 to AFON7 are pre-defined, as shown in FIG. 7B. However, for halfway pressing of the AF-on button for AFON1 and full pressing of the AF-on button for AFON2, which are designated as "user settings" in FIG. 7B, "metering and AF start" is set as the default setting, but the assigned function can be changed by user selection. The user can set the functions assigned to halfway pressing and full pressing of the AF-on button from among the combinations of AFON1 to AFON7, making it easy to set the functions assigned to the two operations.

[0171] A setting content display area 710 displays a function 711 that is assigned to half-pressing the AF-on button when the selected item is set, and a function 712 that is assigned to full-pressing the AF-on button. Functions 711 and 712 are displayed in a normal display if they are functions that can be changed by the user, and grayed out if they cannot be changed. In this embodiment, functions that cannot be changed are displayed in a grayed out display, but other methods (for example, an icon indicating that a function can be changed if it can be changed) may also be used to display the function in a different manner.

[0172] In FIG. 7(a), AFON1 (item 721) is selected by the cursor 701, and for AFON1, half-pressing the AF-on button sets it to "User Setting," while fully pressing the AF-on button sets it to "Disabled." Therefore, item 712 is grayed out and displays "Disabled." Item 711 allows the user to select a function to assign to half-pressing the AF-on button, so it is displayed normally rather than grayed out. Furthermore, the function name displayed is "Metering and AF Start," which is the default setting in the user settings.

[0173] The advanced settings icon 702 indicates that pressing the INFO button (not shown) of the digital camera 100 will take you to advanced settings, and you can also proceed to advanced settings by touching the advanced settings icon 702. When the INFO button is pressed or the advanced settings icon 702 is touched, an advanced settings screen for the selected item is displayed. The advanced settings screen will be described later with reference to FIGS. 8 and 9.

[0174] The OK icon 703 indicates that by pressing the SET button 109 or by touching the OK icon 703, a function to be assigned to half-pressing the AF-on button and full-pressing the AF-on button is set.

[0175] When the SET button 109 is pressed or the OK icon 703 is touched, the system control unit 201 assigns the function corresponding to the selected item, that is, the function displayed in the setting content display area 710, to half-pressing the AF-on button and full-pressing the AF-on button.

[0176] 8(a) and (b) show examples of the detailed setting screen for AFON1 (item 721).

[0177] The detailed setting screens for AFON1 to AFON7 basically display the name of the item to be set in detail 801, a function 802 to be assigned to half-pressing the AF-on button when the item to be set in detail is set, a function 803 to be assigned to full-pressing the AF-on button, a cursor 804, a detailed setting icon 805, and a back icon 806.

[0178] 8A and 8B show the detailed settings screen for AFON1, so the item name 801 displays an icon indicating AFON1. The half-press function 802 displays the default setting, "Metering / AF Start," and the full-press function 803 displays "Disabled." The half-press function 802 for AFON1 is normally displayed because it can be changed by user settings. In contrast, the full-press function 803, "Disabled," is grayed out because it is a fixed setting that cannot be changed. The cursor 804 indicates whether the half-press function 802 or the full-press function 803 is currently selected, and the selection of the half-press function 802 or the full-press function 803 can be changed by operating the cross key 108 or by touch operation. If the INFO button is pressed or the detailed settings icon 805 is touched, and the function selected by the cursor 804 can be changed by user settings, the screen transitions to the function change screen shown in FIG. 8C. 8(a) and 8(b), in the case of AFON1, pressing the INFO button or touching the advanced settings icon 805 while selecting a half-press function 802 that can be set by the user as shown in FIG. 8(a) causes a transition to the function change screen. However, pressing the INFO button while selecting a full-press function 803 that cannot be set by the user as shown in FIG. 8(b) does not cause a transition to the function change screen. If an item that cannot be set by the user is selected, transition to the function change screen is not possible, so the advanced settings icon 805 may be hidden as shown in FIG. 8(b). Furthermore, pressing the menu button 114 or touching the back icon 806 on the advanced settings screen confirms the settings on the advanced settings screen (as the setting target) and returns to the previous screen (the function assignment setting screen 700 for the AF-on button 116). To confirm the settings on the advanced settings screen, for the item 801 to be set, when the item 801 is set, the functions to be assigned to half-pressing the AF-on button and full-pressing the AF-on button are set in functions 802 and 803, respectively.

[0179] FIG. 8(c) illustrates an example of a function change screen 810, which is a screen for changing the functions assigned to the operation units through a user operation. Item 811 indicates the operation unit to which the function selected on the function change screen 810 is set. In the example of FIG. 8(c), the function change screen is shown for setting the function assigned to half-pressing the AF-on button. The function change screen 810 displays function icons corresponding to assignable functions, a cursor 813 is displayed for the currently selected function icon, and a character indicating the selected function is displayed in item 812. When the SET button 109 is pressed or the OK icon 815 is touched, the settings on the function change screen 810 are confirmed, and the function selected on the function change screen 810 is displayed on the detailed setting screen 800 with the function set for the operation unit 811 to be set. Some of the functions displayed on the function change screen 810 can be further configured in detail. When a function for which detailed settings are possible is selected, a detailed settings icon 814 is displayed, and by pressing the INFO button or the detailed settings icon 814, a function detailed settings screen 820 is displayed.

[0180] 8(d) shows an example of a function detail setting screen 820 for the metering / AF start function. The function detail setting screen 820 displays a function name 821 to be set in detail, an initial setting icon 822 for restoring the settings to the initial setting, a back icon 823 for confirming the settings and returning to the previous screen (function change screen 810), setting items for the detailed setting, and the like. The function detail setting can be restored to the initial setting by touching the initial setting icon 822. When the menu button 114 is pressed or the back icon 823 is touched, the settings on the function detail setting screen 820 for the function 821 to be set in detail are reflected, and the screen returns to the function change screen 810 (switches to displaying the function change screen 810).

[0181] FIG. 9 shows an example of a function change screen for AFON2 to AFON7.

[0182] Figure 9(a) shows an example of the function change screen for AFON2. In AFON2, "Disable" is set for half-pressing the AF-On button, and "Metering and AF Start" is initially displayed as the default value because pressing the AF-On button all the way is user-configurable. Therefore, on the function change screen for AFON2, "Disable" for half-pressing the AF-On button is displayed as a frameout because it cannot be changed, while "Full-pressing the AF-On button" is displayed as normal because it is user-configurable.

[0183] Figure 9(b) shows an example of the function change screen for AFON3. In AFON3, "Start metering and AF" is set for half-pressing the AF-on button, and "Shift AF frame by line of sight" is set for fully pressing the AF-on button. Therefore, on the function change screen for AFON3, both half-pressing the AF-on button and fully pressing the AF-on button are grayed out because they cannot be set by the user.

[0184] Figure 9(c) shows an example of the function change screen for AFON4. In AFON4, "Metering and AF Start" is set for half-pressing the AF-On button, and "Eye AF" is set for fully pressing the AF-On button. Therefore, on the function change screen for AFON4, both half-pressing the AF-On button and fully pressing the AF-On button are grayed out because they cannot be set by the user.

[0185] Figure 9(d) shows an example of the function change screen for AFON5. In AFON5, "Start metering and AF" is set for half-pressing the AF-on button, and "Stop AF" is set for fully pressing the AF-on button. Therefore, on the function change screen for AFON5, both half-pressing the AF-on button and fully pressing the AF-on button are grayed out because they cannot be set by the user.

[0186] Figure 9(e) shows an example of the function change screen of AFON6. In AFON6, "Start metering and AF" is set for half-pressing the AF-on button, and "Change subject selection" is set for fully pressing the AF-on button. Therefore, on the function change screen of AFON6, both half-pressing the AF-on button and fully pressing the AF-on button are displayed as grayed out because they cannot be set by the user.

[0187] Figure 9(f) shows an example of the function change screen of AFON7. In AFON7, "Metering and AF start" is set for half-pressing the AF-on button, and "One Shot / Servo switch" is set for fully pressing the AF-on button. Therefore, on the function change screen of AFON7, both half-pressing the AF-on button and fully pressing the AF-on button are grayed out because they cannot be set by the user.

[0188] Also, as shown in Figures 9(b) to (f), for AFON3 to AFON7, half-pressing the AF-on button sets "Metering and AF start" and cannot be changed. However, "Metering and AF start" is a function that can be set in detail. For this reason, a detail setting icon is displayed on the function change screen for AFON3 to 7, and by touching the detail setting icon or pressing the INFO button, a function detail setting screen 820 like that shown in Figure 8(d) is displayed, allowing detailed setting of the function.

[0189] 10 and 11 are flowcharts showing the control process of the digital camera 100 of the second embodiment.

[0190] 10 and 11 is realized by the system control unit 201 loading a program stored in the nonvolatile memory 256 into the system memory 252, executing the program, and controlling each component. Note that the processes in Figures 10 and 11 only excerpt the processes related to the operation of the AF-on button 116 in a shooting standby state (a state in which shooting and recording processing is not being executed due to the shutter button 102 being fully pressed in shooting mode). Also, since the processes in Figures 10 and 11 are partially common to the control processing of the first embodiment (Figures 3 and 4), the same processes are assigned the same numbers and descriptions thereof will be omitted.

[0191] First, the control process starts immediately after the digital camera 100 is started up, or immediately after it transitions to still image capture mode or video recording mode and starts displaying a live view image, and steps S301 to S306 are executed as in the first embodiment.

[0192] In step S307, if the system control unit 201 determines that the AF-on button 116 is half-pressed, the process proceeds to step S1001; if it determines that the AF-on button 116 is not half-pressed, the process returns to step S301, as in the first embodiment.

[0193] In step S1001, the system control unit 201 determines whether the function assigned to half-pressing the AF-on button is "metering and AF start" on the function assignment setting screen 700 of the AF-on button 116. If the system control unit 201 determines that the function assigned to half-pressing the AF-on button is "metering and AF start," the process proceeds to step S308. If the system control unit 201 determines that the function assigned to half-pressing the AF-on button is not "metering and AF start," the process proceeds to step S1002.

[0194] In steps S308 to S311, the system control unit 201 executes the same processes as in steps S308 to S311 in FIG. 3 of the first embodiment.

[0195] In step S1002, the system control unit 201 determines whether the function assigned to half-pressing the AF-on button 116 is "disabled" using the function assignment setting screen 700. Here, "disabled" as the function assigned to half-pressing the AF-on button means that no function is assigned to be executed in response to half-pressing the AF-on button. If the system control unit 201 determines that the function assigned to half-pressing the AF-on button is "disabled," that is, if it determines that no function is assigned, the process proceeds to step S311, and performs control so that no processing is executed in response to half-pressing the AF-on button 116. If the system control unit 201 determines that the function assigned to half-pressing the AF-on button is not "disabled," the process proceeds to step S1003.

[0196] In step S1003, the system control unit 201 executes the function assigned to half-pressing the AF-on button, and the process proceeds to step S311.

[0197] In step S311, the system control unit 201 determines whether the half-press of the AF-on button 116 has been released. If the system control unit 201 determines that the half-press of the AF-on button 116 has been released, the process returns to step S301. If the system control unit 201 determines that the half-press of the AF-on button 116 has not been released, the process proceeds to step S312.

[0198] In step S312, the system control unit 201 determines whether the AF-on button 116 has been fully pressed. If the system control unit 201 determines that the AF-on button 116 has been fully pressed, the process proceeds to step S1101. If the system control unit 201 determines that the AF-on button 116 has not been fully pressed, the process returns to step S311.

[0199] In step S1101, the system control unit 201 determines whether the function assigned to full pressing of the AF-on button is "moving the AF frame with your line of sight" on the function assignment setting screen 700 of the AF-on button 116. If the system control unit 201 determines that the function assigned to full pressing of the AF-on button is "moving the AF frame with your line of sight," the process proceeds to step S314.

[0200] In steps S314 and S315, the system control unit 201 executes the same processes as in steps S314 and S315 of the first embodiment shown in FIG.

[0201] In step S316, the system control unit 201 executes AE processing and AF processing on the subject at the AF position determined in step S315, and displays an AF frame around the subject at the AF position. If the system control unit 201 determines in step S1101 that the function assigned to full pressing of the AF-on button is not "moving the AF frame with line of sight," the process proceeds to step S1102.

[0202] In step S1102, the system control unit 201 determines whether the function assigned to full pressing of the AF-on button is "eye AF" on the AF-on button function assignment setting screen 700. If the system control unit 201 determines that the function assigned to full pressing of the AF-on button is "eye AF," the process proceeds to step S402.

[0203] 3 of the first embodiment, and then proceeds to step S316. In step S316, the system control unit 201 performs AE processing and AF processing on the subject at the AF position determined in step S404 or S406, displays an AF frame around the subject at the AF position, and proceeds to step S317. If the system control unit 201 determines in step S1102 that the function assigned to fully pressing the AF-on button is not "eye AF," the system control unit 201 proceeds to step S1103.

[0204] In step S1103, the system control unit 201 determines whether the function assigned to fully pressing the AF-on button is "change subject selection" on the AF-on button function assignment setting screen 700. If the system control unit 201 determines that the function assigned to fully pressing the AF-on button is "change subject selection," the process proceeds to step S1104. If the system control unit 201 determines that the function assigned to fully pressing the AF-on button is not "change subject selection," the process proceeds to step S1105.

[0205] In step S1104, the system control unit 201 determines, as a new AF position, a subject other than the subject currently set as the AF position, based on the subject detection result for the live view image by the image processing unit 224. That is, the subject to be the AF target is changed from the currently selected subject to another subject. If only one subject is detected by the subject detection process, the AF target subject may not be changed. Furthermore, if two or more subjects are detected, the selection of the detected subjects is changed each time the AF-on button is fully pressed, in an order based on the size, position, priority, etc. of the subject. The system control unit 201 then proceeds to step S316, where it performs AE processing and AF processing on the subject at the AF position determined in S1104 (the subject to be the AF target), and displays an AF frame around the subject at the AF position. The system control unit 201 then proceeds to step S317.

[0206] In step S1105, the system control unit 201 determines whether the function assigned to fully pressing the AF-on button is "ONE SHOT / SERVO switching" on the AF-on button function assignment setting screen 700. If the system control unit 201 determines that the function assigned to fully pressing the AF-on button is "ONE SHOT / SERVO switching," the process proceeds to step S1106. If the system control unit 201 determines that the function assigned to fully pressing the AF-on button is not "ONE SHOT / SERVO switching," the process proceeds to step S1107.

[0207] In step S1106, the system control unit 201 changes the current AF operation setting to servo AF if it is one-shot AF, and switches the current AF operation setting to one-shot AF if it is servo AF.Then, the system control unit 201 proceeds to step S316 and executes AE processing and AF processing with the AF operation setting changed in step S1106.

[0208] In step S1107, the system control unit 201 determines whether the function assigned to fully pressing the AF-on button is "AF stop" using the AF-on button function assignment setting screen 700. If the system control unit 201 determines that the function assigned to fully pressing the AF-on button is "AF stop," the process proceeds to step S1108. If the system control unit 201 determines that the function assigned to fully pressing the AF-on button is not "AF stop," the process proceeds to step S1109.

[0209] In step S1108, if the AF operation setting is servo AF, the system control unit 201 temporarily suspends the servo AF process. If the setting is one-shot AF, this process is not executed because the AF process is not being executed continuously. The system control unit 201 temporarily suspends the servo AF process of step S1107 while the AF-on button is fully pressed, and resumes the servo AF process when the AF-on button is released from operation. Alternatively, if the function of "metering and AF start" is assigned to half-pressing the AF-on button, the system control unit 201 resumes the servo AF process when the AF-on button 116 is released from being fully pressed, even if the AF-on button 116 is still half-pressed. If another function is assigned to half-pressing the AF-on button, the system control unit 201 may resume the servo AF process when both the full-press and half-press of the AF-on button 116 are released.

[0210] In step S1109, the system control unit 201 determines whether the function assigned to full pressing of the AF-on button is "disabled" using the AF-on button function assignment setting screen 700. Here, "disabled" of the function assigned to full pressing of the AF-on button means that no function is assigned to be executed in response to full pressing of the AF-on button. If the system control unit 201 determines that the function assigned to full pressing of the AF-on button is "disabled," that is, if it determines that no function is assigned, the process proceeds to step S317, where the system control unit 201 performs control so that no processing is executed in response to full pressing of the AF-on button. If the system control unit 201 determines that the function assigned to full pressing of the AF-on button is not "disabled," the process proceeds to step S1110.

[0211] In step S1110, the system control unit executes the function assigned to full pressing of the AF-on button on the AF-on button function assignment setting screen 700, and proceeds to step S317.

[0212] In step S317, the system control unit 201 determines whether or not the full press of the AF-on button 116 has been released. The system control unit 201 waits until it is determined that the full press of the AF-on button 116 has been released, and if it is determined that the full press of the AF-on button 116 has been released, the process proceeds to step S318.

[0213] In step S318, the system control unit 201 determines whether the shooting operation has ended, for example, by changing the operating mode of the digital camera 100, and if it determines that the shooting operation has ended, it ends the processing, and if it determines that the shooting operation has not ended, it returns the processing to step S311.

[0214] As described above, according to the second embodiment, the function assignment setting screen 700 for the AF-on button 116 allows functions to be assigned to the halfway press and full press of the AF-on button 116, respectively. The functions to be assigned to the AF-on button 116 can be set in predetermined combinations, as shown in FIG. 7B . Because the AF-on button 116 is basically an operation unit provided for issuing an instruction to "start metering and AF," the "metering and AF start" function is assigned to the halfway press in each of the settings for AFON3 to AFON7. For AFON3 to AFON7, where the "metering and AF start" function is assigned to the halfway press, a function related to AF processing is assigned to the full press, since operability is improved by assigning processing related to the "metering and AF start" function executed by the halfway press to the full press. Furthermore, because it is common to change the subject to be the AF target after executing the "metering and AF start" function, a function for changing the subject to be the AF target is assigned to the full press of AFON3, 4, and 6.

[0215] When the "metering and AF start" function is set for half-pressing the AF-on button 116 and "moving the AF frame by line of sight" is set for full-pressing the AF-on button 116, i.e., when AFON3 is set on the function assignment setting screen 700 for the AF-on button 116, the following processing is performed for displaying the eye-gaze pointer. When AFON3 is set, the system control unit 201 controls the eye-gaze pointer to be displayed while the AF-on button 116 is pressed, i.e., while AF processing and AE processing (metering processing) are being performed, regardless of the setting on the eye-gaze pointer display setting screen. When the "metering and AF start" function is set for half-pressing the AF-on button 116 and the eye-gaze pointer display setting is set to "off" or "only when ready to shoot," the eye-gaze pointer is not normally displayed while the AF-on button 116 is pressed. However, when "moving the AF frame by line of sight" is set for full-pressing the AF-on button 116, if the eye-gaze pointer is not displayed before full-pressing the AF-on button 116, the user will not be able to know in advance which subject the frame will move to when the AF-on button 116 is fully pressed. Therefore, when "moving the AF frame with line of sight" is set for full-pressing the AF-on button 116, even if the setting is such that the line-of-sight pointer is not displayed when the AF-on button 116 is half-pressed, the system control unit 201 performs control to display the line-of-sight pointer in response to half-pressing the AF-on button 116. Note that the line-of-sight pointer may be displayed only when the AF-on button 116 is half-pressed, or may be displayed when the AF-on button 116 is half-pressed and all the way pressed.

[0216] In the second embodiment, "AF stop" was set when the AF-on button 116 of AFON5 was fully pressed, but "start / stop full-range tracking" may also be set. In this case, when AFON5 is set on the AF-on button function assignment setting screen 700 and the AF-on button 116 is fully pressed, the following operation is performed. If the function assigned to the full-press operation of the AF-on button 116 is "start / stop full-range tracking," the system control unit 201 determines whether AF processing for the subject's face (face AF function) is enabled. If AF processing for the subject's face (face AF function) is enabled, the system control unit 201 changes the AF processing for the fixed frame to enabled and proceeds to the processing from step S316 in FIG. 11 onwards. If not, the system control unit 201 enables AF processing for the subject's face (face AF function) and proceeds to the processing from step S316 in FIG. 11 onwards. Note that each time the AF-on button 116 is fully pressed repeatedly (the AF-on button 116 is released from full pressing and then fully pressed again), the system control unit 201 alternates between enabling AF processing for the subject's face (face AF function) and enabling AF processing for the fixed frame. Therefore, AF processing can be performed while switching the AF position between the subject's face and the fixed frame position. Note that, when the eye AF function is enabled, the AF position may be switched between the subject's eye and the fixed frame position each time the AF-on button 116 is fully pressed. In this way, by half-pressing or fully pressing the AF-on button 116, the user can selectively use a function for performing AF (autofocus) processing and AE (autoexposure) processing within a live view image and a function for switching the AF target between the subject's face or eye and the fixed frame position. By allocating "start / stop full-range tracking" to the full press of the AF-on button 116, when AF is performed on an unintended subject's face, operations such as switching the AF target to the fixed frame position and changing the AF target to the desired position can be performed with fewer operations.

[0217] Furthermore, "enlargement / reduction" may be set when the AF-on button 116 of AFON5 is fully pressed. In this case, when AFON5 is set on the function assignment setting screen 700 for the AF-on button 116 and the AF-on button 116 is fully pressed, the following operation is performed. If the function assigned to the full-press operation of the AF-on button 116 is "enlargement / reduction," the system control unit 201 enlarges the live-view image with respect to the face, eyes, or position of the fixed frame of the subject (hereinafter, "enlargement position") while maintaining the AE processing result and the AF processing result, and proceeds to the processing of step S317 and subsequent steps in FIG. 11. Note that "enlargement / reduction" is valid when the AF operation is one-shot AF. When the AF operation is servo AF, the enlargement position is constantly moving, so the processing proceeds to the processing of step S317 and subsequent steps in FIG. 11 without performing any operation. Each time the AF-on button 116 is repeatedly fully pressed (the AF-on button 116 is released from the full press and then fully pressed again), enlargement of the live-view image may be switched between enabled and disabled (at the same magnification) for the enlargement position within the live-view image. Furthermore, each time the AF-on button 116 is fully pressed repeatedly (i.e., each time the AF-on button 116 is released and then fully pressed again), the magnification of the enlarged position in the live-view image may be changed in the order of 5x, 10x, and 10x, and displayed. In the second embodiment, the magnification is set to 5x and 10x, but the changeable magnifications are not limited to these. The order in which the magnification is changed may also be freely changed. In this way, by half-pressing or fully pressing the AF-on button 116, it is possible to selectively use a function for performing AF (autofocus) processing and AE (autoexposure) processing in the live-view image and a function for enlarging / reducing the enlarged position in the live-view image. By assigning "enlarge / reduc" to fully pressing the AF-on button 116, the user can enlarge the live-view image by fully pressing the AF-on button 116, and check whether the AF is in focus with fewer operation steps.

[0218] In the above-described embodiment, the function assignment setting screen 700 allows one of AFON1 to AFON7 to be set as a function to be assigned to halfway pressing and full pressing of the AF-on button 116. However, different functions may be set to halfway pressing and full pressing of the AF-on button 116 in the shooting mode and in the playback mode. Also, the functions set for each of the items (AFON1 to AFON7) that can be set on the function assignment setting screen 700 may differ between the shooting mode and the playback mode. Also, the number of items (AFON1 to AFON7 in FIG. 7) that can be set on the function assignment setting screen 700 may be different between the shooting mode and the playback mode.

[0219] [Other embodiments] The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0220] Furthermore, the above-described embodiments may be combined.

[0221] The invention is not limited to the above-described embodiments, and various changes and modifications can be made without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention.

[0222] The disclosure of this specification includes the following imaging device, control method, and program. [Configuration 1] An imaging means; a processing means for performing a predetermined process on a subject in an image captured by the imaging means; a first operation unit for issuing a photographing instruction; a second operating unit different from the first operating unit; and a control means for controlling the execution of the predetermined processing on a first subject in an image in response to a first pressing operation on the second operating unit, and for controlling the switching of a target of the predetermined processing in response to a second pressing operation on the second operating unit following the first pressing operation. [Configuration 2] a gaze detection means for detecting a gaze position of a user; The imaging device described in configuration 1, characterized in that the control means executes the predetermined processing on a first subject in the image in response to the first pressing operation on the second operating unit, and controls the target of the predetermined processing to be switched to a subject corresponding to a user's gaze position in response to the second pressing operation on the second operating unit. [Configuration 3] The imaging device described in configuration 1, characterized in that the control means executes the predetermined processing on a first subject in the image in response to the first pressing operation on the second operating unit, and controls to switch the target of the predetermined processing between the entire face or the eyes of the first subject in response to the second pressing operation on the second operating unit. [Configuration 4] The imaging device described in Configuration 3, wherein the control means executes the predetermined processing on a first subject in the image in response to the first pressing operation on the second operating unit, and controls to switch the target of the predetermined processing between the entire face, the right eye, and the left eye of the first subject in response to the second pressing operation on the second operating unit. [Configuration 5] The imaging device described in configuration 1, characterized in that the control means executes the predetermined processing on a first subject in the image in response to the first pressing operation on the second operating unit, and controls the target of the predetermined processing to switch between the right eye and the left eye of the first subject in response to the second pressing operation on the second operating unit. [Configuration 6] 6. The imaging device of any one of configurations 1 to 5, wherein the first pressing operation on the second operating unit is a half-pressing operation on the second operating unit, and the second pressing operation on the second operating unit is a full-pressing operation on the second operating unit. [Configuration 7] the imaging means has an object detection means for detecting an object from an image captured by the imaging means, 7. The imaging device according to any one of configurations 1 to 6, wherein the first subject is a subject determined by the subject detection means or a subject designated by a user. [Configuration 8] a means for setting a gaze input function based on the detection of the gaze by the gaze detection means to be valid or invalid, The imaging device described in configuration 2, characterized in that when the gaze input function is disabled, the control means, in response to the second pressing operation on the second operation unit, executes the predetermined processing on the pupil of the first subject without switching the subject that is the target of the predetermined processing in accordance with the user's gaze position. [Configuration 9] The imaging device of configuration 8, characterized in that when the eye-gaze input function is disabled and the first pressing operation and the second pressing operation on the second operation unit are repeated, the control means switches the target of the predetermined processing between the pupils of the first subject and the face of the first subject each time the second pressing operation is performed on the second operation unit. [Configuration 10] a means for setting a gaze input function based on the detection of the gaze by the gaze detection means to be valid or invalid, The imaging device described in configuration 2, characterized in that when the second pressing operation is performed on the second operation unit while the gaze input function is disabled, the control means executes the predetermined process on a subject different from the first subject and determined regardless of the user's gaze position. [Configuration 11] The imaging device described in configuration 10, characterized in that when the first pressing operation and the second pressing operation on the second operating unit are repeated, the control means switches the subject to be subjected to the predetermined processing each time the second pressing operation is performed on the second operating unit. [Configuration 12] 12. The imaging device according to any one of configurations 1 to 11, wherein the control means, when the second pressing operation is performed on the second operation unit and then the state returns to the state in which the first pressing operation was performed, executes the predetermined processing on the subject that is the target of the predetermined processing that was switched in response to the second pressing operation. [Configuration 13] 13. The imaging device according to any one of configurations 1 to 12, wherein the control means controls the imaging means to execute the predetermined processing on the subject in the image in response to the first pressing operation on the first operating unit, and to execute a recording process of capturing and recording an image using the imaging means in response to the second pressing operation on the first operating unit. [Configuration 14] 14. The imaging device according to any one of configurations 1 to 13, further comprising an assignment means for assigning, to the second operation unit, a first function to be executed in response to the first pressing operation on the second operation unit, and a second function to be executed in response to the second pressing operation on the second operation unit, in response to a user operation. [Configuration 15] an assignment unit that assigns a function to be executed in response to an operation on an operation unit of the imaging device in response to a user operation; the control means controls the camera to execute the predetermined process on the subject in the image in response to the first pressing operation on the first operation unit, and to execute a recording process of capturing and recording an image by the imaging means in response to the second pressing operation on the first operation unit; The imaging device according to any one of configurations 1 to 13, wherein the assignment means is capable of assigning a function to be executed in response to the second pressing operation on the second operating unit in response to a user operation, and is not capable of assigning a function to be executed in response to the second pressing operation on the first operating unit in response to a user operation. [Configuration 16] The imaging device described in any one of configurations 1 to 15, characterized in that the control means does not execute the specified processing when the second operation unit is not operated, and controls the device to execute the specified processing in response to the first pressing operation on the second operation unit. [Configuration 17] 17. The imaging device according to any one of configurations 1 to 16, wherein the predetermined processing is processing for performing photometry on a subject in the image and adjusting a focus. [Configuration 18] 18. The imaging device according to any one of configurations 1 to 17, wherein the first operation unit is a shutter button. [Configuration 19] A control method for an imaging device, comprising: The imaging device is An imaging means; a processing means for performing a predetermined process on a subject in an image captured by the imaging means; a first operation unit for issuing a photographing instruction; a second operating unit different from the first operating unit, The control method includes: a step of executing the predetermined processing on a first subject in an image in response to a first pressing operation on the second operating unit, and switching a target of the predetermined processing in response to a second pressing operation on the second operating unit following the first pressing operation. [Configuration 20] A program for causing a computer to function as the imaging device according to any one of configurations 1 to 18. [Explanation of symbols]

[0223] 100... digital camera, 101... rear display unit, 116... AF on button, 201... system control unit, 222... imaging unit, 224... image processing unit, 260... line of sight detection unit

Claims

1. An imaging means; a processing means for performing a predetermined process on a subject in an image captured by the imaging means; a first operation unit for issuing a photographing instruction; a second operating unit different from the first operating unit; a control means for executing the predetermined processing on a first subject in an image in response to a first pressing operation on the second operating unit, and for controlling to switch a target of the predetermined processing in response to a second pressing operation on the second operating unit following the first pressing operation.

2. a gaze detection means for detecting a gaze position of a user; 2. The imaging device according to claim 1, wherein the control means executes the predetermined processing on a first subject in the image in response to the first pressing operation on the second operation unit, and controls the target of the predetermined processing to be switched to a subject corresponding to a user's gaze position in response to the second pressing operation on the second operation unit.

3. 2. The imaging device according to claim 1, wherein the control means executes the predetermined processing on a first subject in the image in response to the first pressing operation on the second operating unit, and controls the control means to switch the target of the predetermined processing between the entire face or the eyes of the first subject in response to the second pressing operation on the second operating unit.

4. The imaging device according to claim 3, wherein the control means executes the predetermined processing on a first subject in the image in response to the first pressing operation on the second operating unit, and controls the control means to switch the target of the predetermined processing between the entire face, the right eye, and the left eye of the first subject in response to the second pressing operation on the second operating unit.

5. The imaging device according to claim 1, characterized in that the control means executes the predetermined processing on a first subject in the image in response to the first pressing operation on the second operating unit, and controls the target of the predetermined processing to be switched between the right eye and the left eye of the first subject in response to the second pressing operation on the second operating unit.

6. 2. The imaging device according to claim 1, wherein the first pressing operation on the second operating unit is a half-pressing operation on the second operating unit, and the second pressing operation on the second operating unit is a full-pressing operation on the second operating unit.

7. the imaging means has an object detection means for detecting an object from an image captured by the imaging means, 2. The imaging apparatus according to claim 1, wherein the first subject is a subject determined by the subject detection means or a subject designated by a user.

8. a means for setting a gaze input function based on the detection of the gaze by the gaze detection means to be valid or invalid, 3. The imaging device according to claim 2, wherein when the gaze input function is disabled, the control means performs the predetermined processing on the pupil of the first subject in response to the second pressing operation on the second operating unit, without switching the subject that is the target of the predetermined processing in accordance with the user's gaze position.

9. 9. The imaging device according to claim 8, wherein, when the eye-gaze input function is disabled and the first pressing operation and the second pressing operation on the second operation unit are repeated, the control means switches the target of the predetermined processing between the pupils of the first subject and the face of the first subject each time the second pressing operation is performed on the second operation unit.

10. a means for setting a gaze input function based on the detection of the gaze by the gaze detection means to be valid or invalid, 3. The imaging device according to claim 2, wherein when the second pressing operation is performed on the second operation unit while the gaze input function is disabled, the control means executes the predetermined processing on a subject that is different from the first subject and is determined regardless of the user's gaze position.

11. 11. The imaging device according to claim 10, wherein when the first pressing operation and the second pressing operation on the second operation unit are repeated, the control means switches the subject to be subjected to the predetermined processing each time the second pressing operation is performed on the second operation unit.

12. 2. The imaging device according to claim 1, wherein, when the second pressing operation is performed on the second operation unit and then the state returns to the state in which the first pressing operation is performed, the control unit executes the predetermined processing on the subject that is the target of the predetermined processing that is switched in response to the second pressing operation.

13. 2. The imaging device according to claim 1, wherein the control means controls the imaging means to perform the predetermined processing on the subject in the image in response to the first pressing operation on the first operating unit, and to perform a recording process of capturing and recording an image in response to the second pressing operation on the first operating unit.

14. 2. The imaging device according to claim 1, further comprising an assignment means for assigning to the second operation unit, in accordance with a user operation, a first function to be executed in response to the first pressing operation on the second operation unit, and a second function to be executed in response to the second pressing operation on the second operation unit.

15. an assignment unit that assigns a function to be executed in response to an operation on an operation unit of the imaging device in response to a user operation; the control means controls the camera to execute the predetermined process on the subject in the image in response to the first pressing operation on the first operation unit, and to execute a recording process of capturing and recording an image by the imaging means in response to the second pressing operation on the first operation unit; The imaging device according to claim 1, characterized in that the assignment means is capable of assigning a function to be executed in response to the second pressing operation on the second operating unit in response to a user operation, but is not capable of assigning a function to be executed in response to the second pressing operation on the first operating unit in response to a user operation.

16. 2. The imaging device according to claim 1, wherein the control means does not execute the predetermined process when the second operation unit is not operated, but controls the control means to execute the predetermined process in response to the first pressing operation on the second operation unit.

17. 2. The imaging apparatus according to claim 1, wherein the predetermined processing is processing for performing photometry on a subject in the image and adjusting the focus.

18. 2. The imaging device according to claim 1, wherein the first operation unit is a shutter button.

19. A control method for an imaging device, comprising: The imaging device is An imaging means; a processing means for performing a predetermined process on a subject in an image captured by the imaging means; a first operation unit for issuing a photographing instruction; a second operating unit different from the first operating unit, The control method includes: a step of executing the predetermined processing on a first subject in an image in response to a first pressing operation on the second operating unit, and controlling to switch the target of the predetermined processing in response to a second pressing operation on the second operating unit following the first pressing operation.

20. A program for causing a computer to function as the imaging device according to any one of claims 1 to 18.

Images