Image pickup apparatus, control method, and program

Abstract

An image pickup apparatus includes: an image pickup section; a processing means for performing a predetermined process on a subject in the image captured by the imaging means; a first operation unit configured to issue a photographing instruction; a second operation unit different from the first operation unit; and a control means for performing control to perform a predetermined process on a first subject in the image in accordance with a first pressing operation on the second operation unit, and to switch an object of the predetermined process in accordance with a second pressing operation after the first pressing operation on the second operation unit.

Description

Technical Field

[0001] The present invention relates to a technique for operating a imaging device. Background Art

[0002] An imaging device such as a digital camera can execute a desired function by assigning the desired function (e.g., an autofocus function) to a predetermined operation member and operating the predetermined operation member at the time of shooting. The imaging device has various functions in addition to the autofocus function, and the functions that can be assigned to the operation member by the user have also increased.

[0003] Since the user can assign a desired function to the operation member, but needs to operate a plurality of operation members when executing other functions after executing the desired function, the number of operation steps may increase, making it difficult to operate. For example, when the user wants to perform autofocus again on a different subject after operating the operation member to perform autofocus on a given subject, he / she needs to operate a plurality of operation units, so that the focusing on the changed subject may be delayed, resulting in a loss of shooting opportunity.

[0004] To solve this problem, Patent Document 1 describes a method that enables different functions to be executed according to different operations of one operation member, and Patent Document 2 describes a method of determining a subject to be autofocused based on the detected position of the user's line of sight and the subject position.

[0005] Citation List

[0006] Patent Documents

[0007] Patent Document 1: Japanese Unexamined Patent Application Publication No. 2001-346080

[0008] Patent Document 2: Japanese Unexamined Patent Application Publication No. 2019-008076 Summary of the Invention

[0009] Problems to be Solved by the Invention

[0010] In Patent Document 1, moving image recording can be executed by semi-pressing the operation member (shutter release button), and still image shooting can be executed by fully pressing the operation member. However, there are cases where it is desired that the shutter release button be fixed as the still image shooting function, and in such cases, when changing the function to be executed as in Patent Document 1, the original still image shooting cannot be executed. In addition, when performing an autofocus operation using an operation member different from the shutter release button, the user simply does not operate the shutter release button, so the effect of reducing the number of operation steps cannot be obtained.

[0011] In Patent Document 2, the autofocus object may be automatically determined against the user's intention.

[0012] The present invention has been made in consideration of the above problems, and an object thereof is to implement the following technology, which can appropriately use a plurality of functions related to a predetermined process by one operation unit capable of performing a plurality of pressing operations, thereby reducing the number of operation steps.

[0013] Solution to the problem

[0014] To solve the above problems, the present invention provides an imaging device including: an imaging component; a processing component for performing a predetermined process on a subject in an image captured by the imaging component; a first operation unit configured to issue a shooting instruction; a second operation unit different from the first operation unit; and a control component for controlling to execute the predetermined process on a first subject in the image according to a first pressing operation on the second operation unit, and switching an object of the predetermined process according to a second pressing operation on the second operation unit after the first pressing operation.

[0015] Effect of the invention

[0016] According to the present invention, it is possible to use a plurality of functions related to a predetermined process in different ways by one operation unit capable of performing a plurality of pressing operations, thereby reducing the number of operation steps.

[0017] Other features and advantages of the present invention will be clear from the following description in conjunction with the accompanying drawings. Note that in all the drawings, the same reference numerals denote the same or similar components. Description of the drawings

[0018] The drawings incorporated in and constituting a part of the specification illustrate embodiments of the present invention and, together with the description, are used to explain the principles of the present invention.

[0019] Figure 1A is an external view showing the device configuration according to the present embodiment;

[0020] Figure 1B is an external view showing the device configuration according to the present embodiment;

[0021] Figure 2 is a block diagram showing the device configuration according to the present embodiment;

[0022] Figure 3A is a flowchart showing the control process according to the first embodiment;

[0023] Figure 3B is a flowchart showing the control process according to the first embodiment;

[0024] Figure 4Ais a flowchart showing control processing in the case where the line-of-sight input function is disabled according to the first embodiment;

[0025] Figure 4B is a flowchart showing control processing in the case where the line-of-sight input function is disabled according to the first embodiment;

[0026] Figure 5A is a diagram illustrating a live view screen for explaining control processing according to the first embodiment;

[0027] Figure 5B is a diagram illustrating a live view screen for explaining control processing according to the first embodiment;

[0028] Figure 5C is a diagram illustrating a live view screen for explaining control processing according to the first embodiment;

[0029] Figure 5D is a diagram illustrating a live view screen for explaining control processing according to the first embodiment;

[0030] Figure 5E is a diagram illustrating a live view screen for explaining control processing according to the first embodiment;

[0031] Figure 5F is a diagram illustrating a live view screen for explaining control processing according to the first embodiment;

[0032] Figure 6A is a diagram for explaining a method of assigning functions to operation members according to the first embodiment;

[0033] Figure 6B is a diagram for explaining a method of assigning functions to operation members according to the first embodiment;

[0034] Figure 6C is a diagram for explaining a method of assigning functions to operation members according to the first embodiment;

[0035] Figure 6D is a diagram for explaining a method of assigning functions to operation members according to the first embodiment;

[0036] Figure 6E is a diagram for explaining a method of assigning functions to operation members according to the first embodiment;

[0037] Figure 7A is a diagram for explaining a method of assigning functions to operation members according to the second embodiment;

[0038] Figure 7B is a diagram for explaining a method of assigning functions to operation members according to the second embodiment;

[0039] Figure 8A is a diagram for explaining a method of assigning functions to operation members according to the second embodiment;

[0040] Figure 8B is a diagram for explaining a method of assigning functions to operation members according to the second embodiment;

[0041] Figure 8C is a diagram for explaining a method of assigning functions to operation members according to the second embodiment;

[0042] Figure 8D is a diagram for explaining a method of assigning functions to operation members according to the second embodiment;

[0043] Figure 9A is a diagram for explaining a method of assigning functions to operation members according to the second embodiment;

[0044] Figure 9B is a diagram for explaining a method of assigning functions to operation members according to the second embodiment;

[0045] Figure 9C is a diagram for explaining a method of assigning functions to operation members according to the second embodiment;

[0046] Figure 9D is a diagram for explaining a method of assigning functions to operation members according to the second embodiment;

[0047] Figure 9E is a diagram for explaining a method of assigning functions to operation members according to the second embodiment;

[0048] Figure 9F is a diagram for explaining a method of assigning functions to operation members according to the second embodiment;

[0049] Figure 10 is a flowchart showing the control process according to the second embodiment;

[0050] Figure 11A is a flowchart showing the control process according to the second embodiment;

[0051] Figure 11B is a flowchart showing the control process according to the second embodiment; and

[0052] Figure 12 is a diagram illustrating a sight line pointer display setting screen. Detailed Description of the Invention

[0053] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments are not intended to limit the scope of the claimed invention. In the embodiments, a plurality of features are described, but the invention is not limited to an invention that requires all such features, and a plurality of such features can be appropriately combined. Further, in the drawings, the same reference numerals are given to the same or similar configurations, and redundant descriptions thereof are omitted.

[0054] Hereinafter, an embodiment in which the imaging device of the present invention is applied to a single-lens reflex digital camera capable of shooting still images or recording moving images will be described in detail with reference to the accompanying drawings. Note that this embodiment will describe an example in which the imaging device of the present invention is applied to a digital camera, but the present invention is not limited thereto, and the present invention is applicable to any device having a camera function. That is, the present invention is also applicable to a tablet device, a portable phone, a smart phone as a type of portable phone, a music player, a game device, an e-book reader, and the like having a camera function.

[0055] [First Embodiment]

[0056] [Device Configuration]

[0057] With reference to Figure 1A 、 Figure 1B and Figure 2 , the configuration and functions of the digital camera 100 according to this embodiment will be described.

[0058] Figure 1A is a front perspective view of the digital camera 100 in a state where the lens unit 200 is removed. Figure 1B is a rear perspective view of the digital camera 100.

[0059] In Figure 1A and Figure 1B , the rear display unit 101 is a display device such as a liquid crystal panel or an organic EL panel provided on the back surface of the camera body outside the viewfinder for displaying images and various information that a user wants to visually recognize. Further, the rear display unit 101 has a function of reproducing a still image after shooting a still image, a function of displaying a moving image being recorded, and a live view display function. A touch panel 270a is provided on the rear display unit 101. The touch panel 270a is a touch operation member capable of detecting contact (touch operation) with the display surface of the rear display unit 101 (the operation surface of the touch panel 270a). The outside-the-viewfinder display unit 243 is a display device such as a liquid crystal panel or an organic EL panel provided on the upper surface of the camera body, and displays various setting values of the camera such as shutter speed and aperture.

[0060] The shutter release button 102 is a push-button type operation member for giving a shooting instruction. The mode selection switch 103 is a dial type operation member for switching between various modes. The mode selection switch 103 switches the operation mode of the system control unit 201 to any one of a still image shooting mode, a moving image recording mode, and a reproduction mode. The still image shooting mode includes, for example, an automatic shooting mode, an automatic scene discrimination mode, a manual mode, an aperture priority mode (Av mode), a shutter speed priority mode (Tv mode), and a program AE mode (P mode). The still image shooting mode also includes various scene modes, a program AE mode, and / or a custom mode, etc., each of which performs shooting settings specific to a shooting scene.

[0061] The operation mode can be directly switched to any one of the multiple modes included in the still image shooting mode by the mode selection switch 103, or can be switched to any one of the multiple modes included in the still image shooting mode using other operation members after being switched to the still image shooting mode once by the mode selection switch 103. Similarly, the moving image recording mode and the reproduction mode may also include multiple modes.

[0062] The terminal cover 104 is a cover member for protecting a connector (not shown) that connects an external device and the digital camera 100 via a cable (such as a USB cable, etc.). The main electronic dial 105 is a rotary operation member included in the operation unit 270 to be described later, and the set values such as the shutter speed and the aperture diameter can be changed by rotating the main electronic dial 105. Figure 2 The power switch 106 is an operation member for switching between on / off (turning on / turning off) of the power supply to the digital camera 100. The sub-electronic dial 107 is a rotary operation member that can move a selected frame and / or scroll an image, etc. The cross key 108 is a movement instruction member that can perform an operation corresponding to the pressed portion of the cross key 108 when any one of the up, down, left, and right buttons of the four-way button is pressed. The SET (set) button 109 is a push-button type operation member mainly used for determining selected items, etc.

[0063]

[0064] ​The record button 110 is a push-button type operation member that is used to switch between on / off of the live view display in the still image shooting mode and to indicate the start and stop of moving image shooting (recording) in the moving image recording mode. The zoom button 111 is a push-button type operation member that is used to turn on / off the zoom display during the live view display and to change the magnification during the zoom display. In addition, the zoom button 111 is used to zoom in on the reproduced image and increase the magnification in the reproduction mode. By operating the main electronic dial 105 after turning on the zoom mode, the live view image can be zoomed in or out. In the reproduction mode, the main electronic dial 105 functions as a zoom button for zooming in on the reproduced image and increasing the magnification. The AE lock button 112 is a push-button type operation member that can fix the exposure state by being pressed in the shooting standby state.

[0065] The reproduction button 113 is a push-button type operation member that is used to switch between the shooting mode and the reproduction mode. By pressing the reproduction button 113 during the shooting mode, the operation mode is changed to the reproduction mode, and the latest image among the images recorded on the recording medium 250 can be displayed on the rear display unit 101. The menu button 114 is a push-button type operation member that displays a menu screen for various settings that can be made on the rear display unit 101 when pressed. The user can intuitively perform various settings using the menu screen displayed on the rear display unit 101, the cross keys 108, the SET button 109, or the multi-controller 115.

[0066] The AF-ON button 116 is an operation member that can indicate the functions of performing AE (automatic exposure) processing and AF (automatic focusing) processing on a predetermined subject in the live view image and switching the object of the AF processing to the subject specified by the user's line-of-sight input. Similar to the shutter release button 102 that will be described later, the AF-ON button 116 is a push-button type operation member that can perform a two-stage operation, which includes a first stage of turning on the AF-ON button 116 when it is being operated (half-pressed) to generate a first AF-ON signal SW3, and a second stage of turning on the AF-ON button 116 when the operation is completed (fully pressed) to generate a second AF-ON signal SW4. The system control unit 201 performs AE processing and AF processing on the subject when the AF-ON button 116 undergoes a first operation to the first stage, and performs the function of switching to the subject specified by the user's line-of-sight input when the AF-ON button 116 undergoes an operation that continues from the first stage to the second stage. The functions to be performed according to the operation of half-pressing the AF-ON button 116 and the operation of fully pressing the AF-ON button 116 can be used with reference to Figures 6A to 6EThe described setting screen, the cross key 108, the SET button 109, or the multi-controller 115 are used for assignment. Note that functions other than the functions of performing AE processing and AF processing and the function of switching the subject based on the line-of-sight input can be assigned to the half-press operation and the full-press operation of the AF-ON button 116. Note that in addition to the AF-ON button 116, the user can also set the functions to be executed for other operation members. Regarding the shutter release button 102, the function to be executed can be changed for the half-press operation. For example, whether to perform AE processing and AF processing according to the half-press operation of the shutter release button 102 can be changed by the user setting. However, when changing the assigned function for the full-press operation of the shutter release button 102 to which the shooting recording process function is assigned, shooting becomes impossible. Therefore, regarding the full-press operation of the shutter release button 102, the user cannot change the function to be executed (the function to be assigned).

[0067] The system control unit 201 performs display control of the rear display unit 101 and the in-viewfinder display unit 229, which will be described later, as an electronic viewfinder (hereinafter referred to as EVF) according to the above various operation modes.

[0068] The eyepiece unit 216 is an endoscope-type eyepiece viewfinder. The user can visually recognize the image displayed on the in-viewfinder display unit 229 through the eyepiece unit 216, and can confirm the focus and composition of the captured subject image through the lens unit 200.

[0069] The eye approach detection unit 217 is arranged near the eyepiece unit 216 and can detect the approach of any object to the eyepiece unit 216. As the eye approach detection unit 217, for example, an infrared proximity sensor is used.

[0070] The communication terminal 210 is an electrical contact for the digital camera 100 to communicate with the lens unit 200( Figure 2 ). The cover 118 is a member for opening or closing the slot for mounting the recording medium 250 to / removing the recording medium 250 from the digital camera 100. The grip portion 117 has a shape that is easily grasped by the user's right hand when the user holds up the digital camera 100. The shutter release button 102 and the main electronic dial 105 are arranged at positions where the grip portion 117 can be operated by the index finger of the right hand while holding the digital camera 100 by gripping the grip portion 117 with the little finger, ring finger, and middle finger of the right hand. In the same state, the sub-electronic dial 107 is arranged at a position where it can be operated by the thumb of the right hand.

[0071] Next, the internal configurations of the digital camera 100 and the lens unit 200 of this embodiment will be described with reference to Figure 2 In Figure 2 it is the same asFigure 1A and Figure 1B Components identical to those in Figure 1B are denoted by the same reference numerals.

[0072] In Figure 2 , the lens unit 200 is equipped with a photographing lens 207 and is detachable from the digital camera 100. The photographing lens 207 is generally composed of a plurality of lenses, but is simplified here and shown by only one lens. The communication terminal 206 is an electrical contact for the lens unit 200 to communicate with the digital camera 100. The communication terminal 210 is an electrical contact for the digital camera 100 to communicate with the lens unit 200. The lens unit 200 communicates with the system control unit 201 via the communication terminal 206, and the built-in lens control unit 204 controls the aperture drive circuit 202 to drive the aperture 205, and controls the AF drive circuit 203 to shift the position of the photographing lens 207, thereby focusing the subject image.

[0073] The focal plane shutter 221 can freely control the exposure time of the imaging unit 222 according to an instruction from the system control unit 201. The imaging unit 222 is an image sensor composed of an imaging element such as a CCD or a CMOS for converting a subject image into an electrical signal. The A / D converter 223 converts an analog signal of one pixel output from the imaging unit 222 into, for example, a 10-bit digital signal.

[0074] ​​The image processing unit 224 performs resizing processes such as predetermined pixel interpolation and reduction, and color conversion processes on the data from the A / D converter 223 or the data from the memory control unit 215. In addition, the image processing unit 224 performs predetermined arithmetic processes for photometry processing and distance measurement processing using the captured image data, and the system control unit 201 performs exposure control and distance measurement control based on the arithmetic results. Thus, TTL (through the lens) type AF processing, AE processing, and EF (flash pre-flash) processing are performed. In addition, the image processing unit 224 performs predetermined arithmetic processes for white balance processing using the captured image data, and performs TTL type AWB (auto white balance) processing based on the arithmetic results. The image processing unit 224 also performs subject detection processing for detecting the type, body part, and state (type) of the subject, and the position and size (area) of the subject, etc. using the captured image data. The image processing unit 224 can perform face AF or pupil AF. The face AF processing is a process of performing AF processing on the face detected by the subject detection processing in the image. The pupil AF processing is a process of performing AF processing on the pupil included in the face detected by the subject detection processing in the image. The system control unit 201 automatically or through user operation determines a predetermined subject from one or more subjects detected by the image processing unit 224, and displays a frame for indicating the objects of AE processing and AF processing for the predetermined subject.

[0075] The memory control unit 215 controls the exchange of data among the A / D converter 223, the image processing unit 224, and the memory 232. The digital data output from the A / D converter 223 is directly written into the memory 232 via both the image processing unit 224 and the memory control unit 215 or via the memory control unit 215. The memory 232 stores the image data obtained from the imaging unit 222 and the A / D converter 223, and the image display data for display on the rear display unit 101 or the in-viewfinder display unit 229. The memory 232 has a storage capacity sufficient to store a predetermined number of still images, and moving images and audio for a predetermined period of time. The memory 232 also serves as a memory for image display (video memory).

[0076] The D / A converter 219 converts the image display data stored in the memory 232 into an analog signal and supplies the analog signal to the rear display unit 101 or the in-viewfinder display unit 229. The display image data written to the memory 232 is displayed on the rear display unit 101 or the in-viewfinder display unit 229 via the D / A converter 219. The rear display unit 101 and the in-viewfinder display unit 229 display based on the analog signal from the D / A converter 219 on the display device. In this way, the digital signal stored in the memory 232 is converted into an analog signal, and the analog signal is sequentially sent to the rear display unit 101 or the in-viewfinder display unit 229 for display thereon, enabling it to be used as an electronic viewfinder (EVF) and perform live view (LV) image display (through-the-lens image display).

[0077] Via the out-of-viewfinder display unit driving circuit 244, various setting values of the camera such as shutter speed and aperture are displayed on the out-of-viewfinder display unit 243.

[0078] The non-volatile memory 256 is an electrically erasable / recordable memory and uses, for example, EEPROM or the like. In the non-volatile memory 256, constants and programs for the operating system control unit 201 are stored, for example. In this case, the "program" refers to a program for executing the flowchart described later.

[0079] The system control unit 201 includes a CPU and an MPU for overall control of the entire digital camera 100, and implements each process of the flowchart described later by executing the program stored in the non-volatile memory 256. The system memory 252 is, for example, a RAM and also serves as a working memory, in which constants and variables for the operating system control unit 201 and the program read out from the non-volatile memory 256 are loaded. The system control unit 201 controls the memory 232, the D / A converter 219, the rear display unit 101, and / or the in-viewfinder display unit 229, etc., for display control. The system timer 253 is a time measurement unit for measuring the time periods of various control operations and the time of the internal clock.

[0080] While the shutter release button 102 set on the digital camera 100 is being operated (i.e., half-pressed (shooting preparation indication)), the first shutter switch 211 is turned on and generates a first shutter switch signal SW1. When receiving the first shutter switch signal SW1, the system control unit 201 starts AE processing, AF processing, AWB processing, and EF processing, etc., through the image processing unit 224.

[0081] When the operation of the shutter release button 102 is completed (i.e., the shutter release button 102 is fully pressed (shooting instruction)), the second shutter switch 212 is turned on and generates a second shutter switch signal SW2. When the second shutter switch signal SW2 is received, the system control unit 201 starts a series of recording processes from reading signals from the imaging unit 222 to writing image data to the recording medium 250.

[0082] The operation unit 270 includes operation members such as various switches and buttons for accepting various operations from the user and notifying the accepted operations to the system control unit 201, and at least includes the following operation members: shutter release button 102, mode selection switch 103, main electronic dial 105, power switch 106, sub-electronic dial 107, cross key 108, SET button 109, record button 110, zoom button 111, AE lock button 112, playback button 113, menu button 114, multi-controller 115, and AF-ON button 116.

[0083] Note that the desired functions can be assigned to the respective operation members included in the operation unit 270 using the menu screen, as well as the cross key 108 and SET button 109 or the multi-controller 115.

[0084] The power control unit 280 is constituted by, for example, a battery detection circuit, a DC-DC converter, and a switch circuit for switching the blocks to be powered, and detects whether a battery has been inserted, the type of the battery, and its remaining capacity. In addition, the power control unit 280 controls the DC-DC converter according to the detection result and the instruction of the system control unit 201, and supplies a necessary voltage to each component including the recording medium 250 for a necessary time period.

[0085] The power supply unit 230 includes a primary battery such as an alkaline battery or a lithium battery, and a secondary battery such as a NiCd battery, a NiMH battery, or a lithium ion battery, or an AC adapter. The recording medium I / F 218 is an interface with the recording medium 250 such as a memory card or a hard disk. The recording medium 250 is a recording medium such as a memory card for recording captured images, and is constituted by a semiconductor memory, a magnetic disk, or the like.

[0086] The communication unit 254 is connected to an external device so as to be capable of communicating via a wireless antenna or a wired cable, and transmits and receives images and / or sounds. The communication unit 254 can also be connected to a wireless LAN (Local Area Network) and the Internet. The communication unit 254 can send the image data (including the live view image) captured by the imaging unit 222 and the image files recorded on the recording medium 250 to an external device, and can receive image data or various other information from the external device. Note that the communication unit 254 is not limited to a wireless LAN, but can use a wireless communication module such as infrared communication, (Bluetooth), Bluetooth Low Energy, or Wireless USB, or a wired connection component such as a USB cable, or an IEEE 1394.

[0087] The posture detection unit 255 detects the posture of the digital camera 100 with respect to the direction of gravity. Based on the posture detected by the posture detection unit 255, it can be determined whether the image captured by the imaging unit 222 is captured with the digital camera 100 held horizontally or vertically. The system control unit 201 can add the orientation information corresponding to the posture detected by the posture detection unit 255 to the image file of the image captured by the imaging unit 222, and rotate and record the captured image. An acceleration sensor or a gyro sensor, etc. can be used as the posture detection unit 255. The posture detection unit 255 can also detect the movement (panning, tilting, lifting, stationary, etc.) of the digital camera 100 by using an acceleration sensor or a gyro sensor.

[0088] In the operation unit 270, a touch panel 270a capable of detecting a touch operation on the rear display unit 101 is further included. The touch panel 270a and the rear display unit 101 can be configured as a single integrated unit. For example, the touch panel 270a is configured in such a way that the light transmittance will not interfere with the display presented by the rear display unit 101, and it is attached to the uppermost layer of the display surface of the rear display unit 101. In addition, the input coordinates on the touch panel 270a and the display coordinates on the rear display unit 101 are correlated. As a result, the GUI can be configured such that the user can directly manipulate the screen displayed on the rear display unit 101. The system control unit 201 can detect the following operations or states on the touch panel 270a.

[0089] · A finger or a pen that is not in contact with the touch panel 270a makes a new touch on the touch panel 270a, that is, starts a touch (hereinafter referred to as Touch-Down).

[0090] · A state in which a finger or a pen is touching the touch panel 270a (hereinafter referred to as Touch-On).

[0091] ·The finger or pen moves while maintaining contact with the touch panel 270a (hereinafter referred to as Touch-Move).

[0092] ·The finger or pen in contact with the touch panel 270a separates, i.e., the touch ends (hereinafter referred to as Touch-Up).

[0093] ·A state where the touch panel 270a is not touched by any object (hereinafter referred to as Touch-Off).

[0094] When a touch is detected, touch continuation is also detected simultaneously. After the touch, touch continuation is usually detected continuously unless a touch stop is detected. During the detection of touch continuation, touch movement is detected. Even during the detection of touch continuation, touch movement is not detected unless the touch position moves. After the touch stop of all fingers or pens that have detected a touch, the state changes to "not touched".

[0095] These operations / statuses and the position coordinates of the finger or pen touching the touch panel 270a are notified to the system control unit 201 via the internal bus. Based on the notified information, the system control unit 201 determines which operation (touch operation) has been performed on the touch panel 270a.

[0096] Regarding touch movement, the movement direction of the finger or pen moving on the touch panel 270a can also be determined based on the change in position coordinates for each vertical component and each horizontal component on the touch panel 270a. When a touch movement of more than a predetermined distance is detected, it is determined that a swipe operation (drag) has been performed. An operation of quickly moving a finger a certain distance while touching the touch panel 270a and then releasing the finger is called "flick". In other words, "flick" is an operation of quickly tracing on the touch panel 270a as if flicking with a finger. When a touch movement of more than a predetermined distance at a speed above a predetermined speed is detected and then a touch stop is detected, it can be determined that the user has performed a "flick" (it can be determined that a "flick" has been performed after a "drag"). In addition, a touch operation of touching multiple parts simultaneously (e.g., two points) and bringing the touch positions closer to each other is called "pinch", and a touch operation of moving the touch positions away from each other is called "spread". "Spread" and "pinch" are collectively referred to as pinch operations (or simply pinch).

[0097] The touch panel 270a can adopt any of the following methods: resistive film, capacitive, surface acoustic wave, infrared radiation, electromagnetic induction, image recognition, and optical sensing. There are methods for detecting a touch based on contact with the touch panel, as well as methods for detecting a touch based on the approach of a finger or a pen to the touch panel, and any method can be adopted.

[0098] The eye proximity detection unit 217 detects whether the eye (object) has approached or contacted (eye approach) or has moved away (eye separation) from the eyepiece unit 216 (proximity detection). The system control unit 201 switches between the back display unit 101 and the in-viewfinder display unit 229 between display (display state) and non-display (non-display state) according to the state detected by the eye proximity detection unit 217. The system control unit 201 sets the display destination to the back display unit 101 and sets the in-viewfinder display unit 229 to non-display during non-eye proximity detection at least when the switching of the shooting mode and the display destination is automatic. In addition, the system control unit 201 sets the display destination to the in-viewfinder display unit 229 and sets the back display unit 101 to non-display during eye proximity detection.

[0099] When an object has approached, the infrared light irradiated from the light emitting unit (not shown) of the eye proximity detection unit 217 is reflected and made incident on the light receiving unit (not shown) of the infrared proximity sensor. According to the incident light amount of the infrared light received by the infrared proximity sensor, the approach of a certain physical object to the eyepiece unit 216 can be detected, and the level of the distance (eye approach distance) at which the object has approached the eyepiece unit 216 can be distinguished. When the approach of an object to the eyepiece unit 216 is detected, the system control unit 201 can cause the display of the in-viewfinder display unit 229 to start. Thus, when the user views through the eyepiece unit 216, the in-viewfinder display unit 229 can display as much as possible without delay.

[0100] In addition, when it is detected that an object has approached within a predetermined distance with respect to the eyepiece unit 216 from a non-eye approach state (non-approach state), the eye approach detection unit 217 determines that eye approach has been detected and sends an eye approach detection notification to the system control unit 201. In addition, when it is detected that the approaching object is separated from the eye approach state (approach state) by more than a predetermined distance, the eye approach detection unit 217 determines that eye separation has been detected and sends an eye separation detection notification to the system control unit 201. The threshold for detecting eye approach and the threshold for detecting eye separation can be made different, for example, by setting hysteresis or the like. In addition, it is assumed that: after detecting eye approach, there is an eye approach state until eye separation is detected. In addition, it is assumed that: after detecting eye separation, there is a non-eye approach state until eye approach is detected. Thus, the system control unit 201 performs display control of the rear display unit 101 and the in-viewfinder display unit 229 based on the eye approach state or eye separation state detected by the eye approach detection unit 217.

[0101] Note that the eye approach detection unit 217 is not limited to an infrared proximity sensor, and other sensors can be used when the approach of an object or an eye can be detected as eye approach.

[0102] The line-of-sight detection unit 260 includes the following: a dichroic mirror 262, an imaging lens 263, a line-of-sight detection sensor 264, a line-of-sight detection circuit 265, and an infrared light-emitting element 266, and detects the position and movement of the user's line of sight in addition to the presence or absence of the line of sight on the in-viewfinder display unit 229.

[0103] The digital camera 100 according to the present embodiment detects the line of sight by using a method called pupil center corneal reflection through the line-of-sight detection unit 260. Pupil center corneal reflection is a method of detecting the position and direction of the line of sight based on the positional relationship between the reflected light obtained when the infrared light emitted from the infrared light-emitting element 266 is reflected by the eyeball (eye) 261 (more specifically, the cornea) and the pupil of the eyeball (eye) 261. There are various other methods of detecting the position and direction of the line of sight, such as a method called scleral reflection that uses the fact that the reflectance of light is different between the iris and the sclera. Note that a line-of-sight detection method other than the above-mentioned line-of-sight detection method can be used as long as the position and direction of the line of sight can be detected. In the digital camera 100 according to the present embodiment, when the line-of-sight input function is ON, the display setting of the line-of-sight pointer can be performed on the menu screen exemplified in Figure 12 In Figure 12On the sight line pointer display setting screen shown, the user can operate the operation unit 270 to set the display setting of the sight line pointer by selecting from "ON", "Only in the shooting standby state", and "OFF". When the display setting of the sight line pointer is set to "ON", in the case where the sight line input function is ON, the system control unit 201 controls to superimpose the sight line pointer indicating the sight line position detected by the sight line detection unit 260 on the live view image and display the image on the viewfinder internal display unit 229. By displaying the sight line pointer, the user can grasp the currently detected sight line position, and the user can pre-confirm the position to be specified when specifying a position through the sight line input function. When the display setting of the sight line pointer is set to "OFF", the system control unit 201 controls not to display the sight line pointer indicating the sight line position. When "Only in the shooting standby state" is set, the system control unit 201 controls to display the sight line pointer in the case where the sight line input function is ON. However, during the shooting preparation process of performing AF processing and AE processing by, for example, fully pressing or half-pressing the shutter release button 102, even if the sight line detection unit 260 detects a sight line, the sight line pointer is set to a non-display state. That is, only during the period when AF processing and AE processing are not performed, control is executed to display the sight line pointer. It is considered that during the execution of AF processing and AE processing, the user views the live view image to confirm whether the subject is in focus. However, when the sight line pointer is displayed at the sight line position, it is difficult to confirm the subject, and thus the setting "Only in the shooting standby state" of not displaying the sight line pointer during the shooting preparation process is set.

[0104] The infrared light emitting element 266 is a diode that emits infrared light to detect the sight line position of the user within the viewfinder screen and emits infrared light toward a portion around the center of the eyepiece unit 216 to irradiate the user's eyeball (eye) 261. The infrared light emitted from the infrared light emitting element 266 is reflected by the eyeball (eye) 261, and the reflected infrared light reaches the dichroic mirror 262. The dichroic mirror 262 has a function of only reflecting infrared light and allowing visible light to pass through, and the reflected infrared light with the changed optical path is imaged on the imaging surface of the sight line detection sensor 264 via the imaging lens 263.

[0105] The imaging lens 263 is an optical component that forms the line-of-sight detection optical system. The line-of-sight detection sensor 264 includes an image sensor such as a CCD or CMOS sensor. The line-of-sight detection sensor 264 photoelectrically converts the incident reflected infrared light into an electrical signal and outputs it to the line-of-sight detection circuit 265. Based on the output signal of the line-of-sight detection sensor 264, the line-of-sight detection circuit 265 detects the line-of-sight position of the user from the movement of the user's eyeball (eye) 261 and the position of the pupil, and outputs the detected information to the system control unit 201. Since the line-of-sight detection sensor 264 can detect the pupil of the human eye, even if other objects approach or contact the eyepiece unit 216, the line-of-sight detection sensor 264 will not detect the input of the human line of sight. Thus, the eyepiece unit 216 has the function of a line-of-sight operation unit, but the line-of-sight detection unit can be a separate component. Note that the enabling / disabling of the line-of-sight input function of the line-of-sight detection unit 260 can be set by the user via a menu screen, for example.

[0106] The system control unit 201 can detect the following operations or states related to the eyepiece unit 216 based on the detection results of the line-of-sight detection unit 260.

[0107] · The line of sight of the user who has approached the eyepiece unit 216 is newly input (detected) (start of line-of-sight input).

[0108] · The state in which the user who has approached the eyepiece unit 216 inputs the line of sight.

[0109] · The state in which the user who has approached the eyepiece unit 216 is gazing.

[0110] · The user who has approached the eyepiece unit 216 moves the input line of sight away from the object (end of line-of-sight input).

[0111] · The state in which the user who has approached the eyepiece unit 216 does not input the line of sight.

[0112] These operations / states and the input position of the line of sight on the eyepiece unit 216 are notified to the system control unit 201, and the operation (line-of-sight operation) performed on the eyepiece unit 216 can be determined based on the notified information.

[0113] Note that gazing indicates the situation where the line-of-sight position of the user does not exceed a predetermined movement amount within a predetermined time. That is, based on the detection information received from the line-of-sight detection circuit 265, when the period during which the user's line of sight is fixed to a given area exceeds a predetermined threshold, the system control unit 201 determines that the user is gazing at that area. Therefore, this area can be said to be the gazing position (gazing area) as the position at which the user is gazing. Note that "the line of sight is fixed to a given area" means that, for example, the average position of the movement of the line of sight is within that area until a predetermined period has elapsed, and the variation (variance) is less than a predetermined value.

[0114] <Control processing>

[0115] Next, the control processing of the digital camera 100 according to the first embodiment will be described with reference to Figures 3A to 6E the flowchart shown in FIGS.

[0116] Figure 3A , Figure 3B , Figure 4A and Figure 4B When the digital camera 100 is powered on and the system control unit 201 controls each component by deploying the program stored in the non - volatile memory 256 to the system memory 252 and executing the program, the processing shown in Figure 3A and Figure 3B is realized. Note that the processing shown in Figure 3A and Figure 3B can not only start immediately after starting the digital camera 100, but also start immediately after the operation mode is changed to the still - image shooting mode or the moving - image recording mode and the live - view image display is started. Figure 3A and Figure 3B The processing shown in FIGS. Figure 3A and Figure 3B shows an excerpt of the processing related to the operation of the AF - ON button 116 in the shooting standby state (a state where the shooting recording process by fully pressing the shutter release button 102 in the shooting mode is not executed). That is, in addition to the processing shown in Figure 3A and Figure 3B , the processing described in the device configuration is also executed. That is, the system control unit 201 executes shooting preparation processes such as AE processing, AF processing, AWB processing, and EF processing according to the half - press operation of the shutter release button 102 (ON of SW1). In addition, the system control unit 201 executes the recording process according to the full - press operation of the shutter release button 102 (ON of SW2).

[0117] In step S301, the system control unit 201 displays the live - view image on the rear display unit 101 while sequentially updating the live - view image captured by the imaging unit 222. During the processing shown in Figure 3A and Figure 3B , the display process of the live - view image is continuously executed.

[0118] In step S302, the system control unit 201 causes the image processing unit 224 to perform a subject detection process on the live - view image.

[0119] In step S303, the system control unit 201 determines whether the subject detection process of the image processing unit 224 has detected a predetermined subject. When it is determined that the predetermined subject has been detected, the system control unit 201 advances the process to step S304. When it is not determined that the predetermined subject has been detected, the system control unit 201 advances the process to step S305.

[0120] In step S304, the system control unit 201 receives the position information of the predetermined subject detected in step S302 from the image processing unit 224, and displays a subject frame that encloses the predetermined subject in the image displayed on the rear display unit 101. Note that when the user has selected an AF target subject through a user operation (for example, an operation of confirming the AF position at the line-of-sight position by a full press operation of the AF-ON button 116, or an operation of specifying the AF position by a touch operation on the rear display unit 101), a subject frame indicating that the subject has been selected may be displayed. Then, in the case where the subject automatically selected by the system control unit 201 replaces the subject selected by the user, a normal single-line subject frame is displayed, and in the case of the subject selected by the user, a double-line subject frame is displayed, so as to be displayed in different display forms (such as shape or color) to identify the selected subject. In addition, the image processing unit 224 can track the subject once selected by the user, and can display a subject frame at the position of the tracked subject.

[0121] In step S305, the system control unit 201 displays a fixed AF frame of a constant size at the AF position specified in the image displayed on the rear display unit 101 by the user using the cross keys 108 and the SET button 109 or the multi-controller 115. Note that when no subject is detected in step S302, the system control unit 201 may advance the process to step S306 without performing the process in step S305.

[0122] In step S306, the system control unit 201 receives the information of the user's line-of-sight position detected by the line-of-sight detection unit 260, and displays the line-of-sight position in the image displayed on the rear display unit 101. Note that when the line-of-sight input function of the digital camera 100 is disabled, the process in step S306 may be omitted.

[0123] In step S307, the system control unit 201 determines whether the AF-ON button 116 is half-pressed. When the first AF-ON signal SW3 is detected from the AF-ON button 116, the system control unit 201 determines that the AF-ON button 116 is half-pressed. When it is determined that the AF-ON button 116 is half-pressed, the system control unit 201 advances the process to step S308, and when it is determined that the AF-ON button 116 is not half-pressed, the system control unit 201 returns the process to step S301.

[0124] In step S308, the system control unit 201 performs AE processing by exposure control based on the photometric calculation result obtained by the image processing unit 224.

[0125] In step S309, the system control unit 201 causes the image processing unit 224 to determine the fixed AF frame or the subject frame determined as the AF object in the processing of steps S303 to S305 as the AF position. In the digital camera 100 according to the first embodiment, when the AE / AF processing is not performed during steps S301 to S306 in which the AF-ON button 116 is not operated, the AE / AF processing is performed at the timing when the AF-ON button 116 is half-pressed or fully pressed. In addition, the digital camera 100 also performs the AE / AF processing at the timing when the shutter release button 102 is half-pressed.

[0126] In step S310, the system control unit 201 performs AF processing by ranging control based on the ranging calculation result at the AF position determined by the image processing unit 224 in step S309, and displays an AF frame indicating the result of the executed AF processing on the rear display unit 101. The AF frame indicating the result of the executed AF processing is displayed by displaying the AF frame in a color and shape different from the subject frame and the fixed frame. Note that when the AF operation setting is set to single-shot (one-shot) (point) AF on the menu screen and the AF operation setting is set to single-shot (one-shot) (point) AF, the system control unit 201 controls to perform the AF processing only once at the timing of half-pressing the AF-ON button 116. When the AF operation setting is set to servo AF, the system control unit 201 controls to continuously perform the AF processing for the determined AF position and update the display of the AF frame indicating the AF result. When the AF operation setting is set to servo AF and subject tracking is also set on the menu screen, the system control unit 201 controls to perform subject tracking and perform AF processing by setting the position of the tracked subject as the AF position.

[0127] In step S311, the system control unit 201 determines whether the half-press operation of the AF-ON button 116 has been cancelled (i.e., whether the AF-ON button 116 is not being operated). When the first AF-ON signal SW3 is no longer detected from the AF-ON button 116, the system control unit 201 determines that the half-press operation of the AF-ON button 116 has been cancelled. When it is determined that the half-press operation of the AF-ON button 116 has been cancelled, the system control unit 201 returns the process to step S301. When it is determined that the half-press operation of the AF-ON button 116 has not been cancelled, the system control unit 201 advances the process to step S312.

[0128] In step S312, the system control unit 201 determines whether the AF-ON button 116 is fully pressed. When the second AF-ON signal SW4 is detected from the AF-ON button 116, the system control unit 201 determines that the AF-ON button 116 is fully pressed. When it is determined that the AF-ON button 116 is fully pressed, the system control unit 201 advances the process to step S313. When it is determined that the AF-ON button 116 is not fully pressed, the system control unit 201 returns the process to step S311.

[0129] In step S313, the system control unit 201 determines whether the line-of-sight input function of the digital camera 100 is enabled. When it is determined that the line-of-sight input function is enabled, the system control unit 201 advances the process to step S314. When it is determined that the line-of-sight input function is not enabled, the system control unit 201 returns the process to step S311.

[0130] In step S314, the system control unit 201 confirms the line-of-sight position detected by the line-of-sight detection unit 260.

[0131] In step S315, the system control unit 201 determines the line-of-sight position confirmed in step S314 as the AF position.

[0132] In step S316, the system control unit 201 causes the image processing unit 224 to perform AE processing and AF processing on the subject at the AF position determined in step S315, thereby displaying an AF frame on the rear display unit 101. Note that also in step S316, similar to step S310, the system control unit 201 switches between performing the AF processing only once or continuously performing the AF processing according to whether the AF operation setting is set to single-shot (one-point) AF or servo AF. In addition, the system control unit 201 controls to update the display of the AF frame indicating the AF result, and performs subject tracking when subject tracking is set and performs AF processing by setting the position of the tracked subject as the AF position.

[0133] In step S317, the system control unit 201 determines whether the full press operation of the AF-ON button 116 has been cancelled (i.e., whether the AF-ON button 116 is half-pressed). When the second AF-ON signal SW4 is no longer detected from the AF-ON button 116, the system control unit 201 determines that the full press operation of the AF-ON button 116 has been cancelled. The system control unit 201 stands by until it is determined that the full press operation of the AF-ON button 116 has been cancelled. When it is determined that the full press operation of the AF-ON button 116 has been cancelled, the system control unit 201 advances the process to step S318.

[0134] In step S318, the system control unit 201 determines whether the shooting operation has ended, for example, by changing the operation mode of the digital camera 100. When it is determined that the shooting operation has ended, the system control unit 201 ends the process. When it is determined that the shooting operation has not ended, the system control unit 201 returns the process to step S311.

[0135] Note that when it is determined in step S317 that the full press operation of the AF-ON button 116 has been cancelled, the process can advance to step S308, and AE processing and AF processing can be re-executed at the position of the subject frame or the fixed AF frame.

[0136] When the gaze input function is disabled, even if the AF-ON button 116 is fully pressed in step S312, in steps S308 to S310, AE processing and AF processing can continue at the position of the subject frame or the fixed AF frame.

[0137] Next, reference will be made to Figure 4A and Figure 4B to describe the control process in the case where the gaze input function of the digital camera 100 according to the first embodiment is disabled.

[0138] In Figure 3B when the gaze input function is disabled in step S313, the state immediately after performing AF processing at the position of the subject frame or the fixed AF frame by half-pressing the AF-ON button 116 in steps S307 to S310 is obtained. However, the control process shown in Figure 4A or Figure 4B can be executed.

[0139] Figure 4A shows the process of switching between pupil AF and face AF in the case where the gaze input function is disabled in step S313 of Figure 3B .

[0140] In steps S401 and S312, the same operations as in Figure 3A andFigure 3B The same processing as steps S301 to S312 in

[0141] When it is determined in step S313 that the gaze input function of the digital camera 100 is enabled, the system control unit 201 executes the processing in steps S314 and S315. When it is determined in step S313 that the gaze input function is not enabled, the system control unit 201 advances the processing to step S402.

[0142] In step S402, the system control unit 201 determines whether the AF processing (pupil AF function) for the pupil of the subject is enabled. When it is determined that the pupil AF function is enabled, the system control unit 201 advances the processing to step S403. When it is determined that the pupil AF function is not enabled, the system control unit 201 advances the processing to step S405.

[0143] In step S403, the system control unit 201 disables the pupil AF function and enables the AF processing (face AF function) for the face (entire face) of the subject.

[0144] In step S404, the system control unit 201 causes the image processing unit 224 to detect the face of the subject and determines the position of the detected face as the AF position. In step S407, the system control unit 201 performs AE processing and AF processing for the determined AF position, and thus displays an AF frame on the rear display unit 101. Note that in step S404, a rectangular area including the entire subject may be detected instead of the face of the subject.

[0145] In step S405, the system control unit 201 enables the pupil AF function.

[0146] In step S406, the system control unit 201 causes the image processing unit 224 to detect the pupil of the subject in the subject frame and determines the position of the detected pupil as the AF position. For the determined AF position, the system control unit 201 advances the processing to step S407 and performs AE processing and AF processing (step S316), and thus displays an AF frame on the rear display unit 101.

[0147] In step S407, the same processing as Figure 3B steps S316 to S318 in

[0148] Note that in steps S402 to S406, each time the full press operation of the AF-ON button 116 is repeated (after the full press operation of the AF-ON button 116 is canceled and the AF-ON button 116 is fully pressed again), the enabling / disabling of the pupil AF function is switched. Therefore, AF processing can be performed while switching the AF position between the face of the subject and the pupil. Note that each time the full press operation of the AF-ON button 116 is repeated, the AF position can be switched to any one of the face, right eye, and left eye of the subject, rather than switching the AF position to any one of the face and pupil of the subject. Alternatively, each time the full press operation of the AF-ON button 116 is repeated, the AF position can be switched between the right eye and the left eye of the subject.

[0149] Note that in steps S402 to S406, the pupil AF function can always be disabled, and only during the period when the AF-ON button 116 is fully pressed, the pupil AF function can be enabled to perform AF processing on the pupil of the subject.

[0150] Figure 4B Illustrates the process of switching the AF target subject in the case where the gaze input function is disabled.

[0151] In steps S401 and S351, the same processing as Figure 3A and Figure 3B steps S301 to S312 of

[0152] When it is determined in step S313 that the gaze input function of the digital camera 100 is enabled, the system control unit 201 performs the processing in steps S314 and S315. When it is determined in step S313 that the gaze input function is not enabled, the system control unit 201 advances the processing to step S408.

[0153] In step S408, the system control unit 201 searches for the subject detected in step S303 and displays a subject frame for a subject different from the subject determined at the AF position in step S309.

[0154] In step S409, the system control unit 201 determines the subject frame displayed in step S408 as the AF position. In step S407, the system control unit 201 performs AE processing and AF processing for the determined AF position, so as to display an AF frame on the rear display unit 101. Note that in step S408, a rectangular area including the entire subject can be detected instead of the face of the subject.

[0155] In step S407, the same processing as Figure 3B steps S316 to S318 of

[0156] Note that in steps S408 and S409, during the repeated half-press operation and full-press operation of the AF-ON button 116, the AF target subject can be sequentially switched to other subjects.

[0157] In addition, referring to Figure 4A and Figure 4B , when the AF-ON button 116 is fully pressed and the gaze input function is disabled, the processing in steps S402 to S406 or steps S408 and S409 is executed, but this processing can be executed without determining the enable / disable state of the gaze input function.

[0158] Next, the control processing according to the first embodiment will be described with reference to Figures 5A to 5F the live view screen.

[0159] In Figure 5A the screen shown, the live view image is displayed on the rear display unit 101, the image processing unit 224 detects the subject 501, and the subject frame 502 is displayed at the position of the face of the subject 501. In Figure 5A the screen shown, the gaze icon 503 is displayed at the gaze position detected by the gaze detection unit 260.

[0160] In Figure 5A the example shown, the user's gaze is near the upper left of the screen. Note that when the gaze input function is disabled, it is not necessary to display the gaze icon 503.

[0161] In Figure 5A the example shown, the subject frame 502 is displayed for the subject 501. However, when no subject is detected, the fixed AF frame 510 can be displayed at the position specified by the user, or the fixed AF frame 510 can be displayed simultaneously with the subject frame 502. Note that the size of the fixed AF frame 510 can be arbitrarily specified by the user.

[0162] Figure 5B The screen shown illustrates the state where the user half-presses the AF-ON button 116 on the screen shown in Figure 5A .

[0163] The system control unit 201 causes the image processing unit 224 to perform AE processing and AF processing on the subject frame 502 of the subject 501, thereby changing the subject frame 502 to the AF frame 504.

[0164] When no subject is detected, AE processing and AF processing are performed on the Figure 5A frame 510 shown, and the AF frame 504 is displayed at the position of the fixed AF frame 510.

[0165] During the above processing, the gaze detection process of the gaze detection unit 260 can always be executed, and the position of the gaze icon 503 is updated according to the user's gaze position.

[0166] In Figure 5B the example shown, the state where the user's gaze is at the same position as in Figure 5A is illustrated.

[0167] Figure 5C The screen shown illustrates the state where the user's gaze changes from the state shown in Figure 5B to the state of the subject 505.

[0168] During the time from Figures 5B to 5C similar to the example shown in Figure 5B the gaze detection process of the gaze detection unit 260 can always be executed.

[0169] Different from the example shown in Figure 5A in the example shown in Figure 5C the position of the gaze icon 503 moves near the subject 505, and the user's gaze changes from the subject 501 to another subject 505.

[0170] Figure 5D The screen shown illustrates the state where the user fully presses the AF-ON button 116 in the state shown in Figure 5C The system control unit 201 confirms the gaze position detected by the gaze detection unit 260 at the position of the subject 505.

[0171] The system control unit 201 causes the image processing unit 224 to execute AE processing and AF processing for the subject 505 at the confirmed gaze position, thereby displaying the AF frame 504.

[0172]

[0173] Note that even after AF processing is performed on the subject at the gaze position in the state shown in Figure 5D the gaze detection process of the gaze detection unit 260 can continue, and the gaze icon 503 can continue to be displayed.

[0174] Figure 5E The screen shown illustrates the state where when the AF-ON button 116 is fully pressed, the pupil AF function is enabled and AE processing and AF processing are performed on the pupil of the subject 501.

[0175] Figure 5E In Figure 5EIn the example shown, a pupil AF icon 506 indicating that the pupil AF function is enabled is displayed. When the pupil AF function is disabled, it is not necessary to display the pupil AF icon 506, and an icon indicating that the pupil AF function is disabled may be displayed.

[0176] In Figure 5E the example shown, a pupil AF frame 507 indicating that AE processing and AF processing have been performed on the pupil of the subject 501 is displayed.

[0177] In Figure 4A when the gaze input function is disabled in step S402 of

[0178] the system control unit 201 enables the pupil AF function in step S405 and displays the pupil AF icon 506.

[0179] In Figure 4A when the pupil AF function is disabled in step S403 of Figure 4A the system control unit 201 causes the image processing unit 224 to perform AE processing and AF processing on the face of the subject 501 in step S406 of

[0180] Note that in Figure 5E the state shown, the pupil AF function can be performed on the subject 501 regardless of whether the gaze input function is enabled or disabled.

[0181] Figure 5F The screen shown in

[0182] illustrates the following state: when the AF-ON button 116 is fully pressed, the subject changes from the state where the AF-ON button 116 is half-pressed, and AE processing and AF processing are performed. Figure 5F In Figure 4A and Figure 4B when the AF-ON button 116 is half-pressed in step S401 of Figure 3A the steps S307 to S310 of

[0183] a dotted line frame 508 is displayed on the face of the subject 501 at the AF position. Figure 4A and Figure 4B when the AF-ON button 116 is fully pressed in step S312 of the system control unit 201 searches for candidates for a subject different from the subject 501 from the subjects detected by the image processing unit 224. Suppose a subject 509 different from the subject 501 is found.

[0184] In this case, the system control unit 201 causes the image processing unit 224 to perform AE processing and AF processing on the face of the subject 509, thereby displaying the AF frame 504.

[0185] As described above, the user can switch the AF target subject only by fully pressing the AF-ON button 116.

[0186] More specifically, when the gaze input function is enabled, the user can switch the AF target subject according to the user's gaze position only by fully pressing the AF-ON button 116. When the gaze input function is disabled, it is possible to switch to pupil AF or face AF, or switch the AF target subject only by fully pressing the AF-ON button 116.

[0187] Note that by repeating the half-press operation and the full-press operation of the AF-ON button 116, AE processing and AF processing can be performed while sequentially switching the AF target subject.

[0188] Next, with reference to Figures 6A to 6E A method of assigning functions to the operation members included in the operation unit 270 according to the first embodiment will be described.

[0189] Figures 6A to 6E A setting screen for assigning functions to the AF-ON button 116 according to the first embodiment is illustrated.

[0190] As an example of assigning functions to the operation members included in the operation unit 270, a method of setting the functions that can be performed when the AF-ON button 116 is half-pressed or fully pressed will be described below.

[0191] Figure 6A A setting screen 601 for displaying a list of functions that can be assigned to the AF-ON button 116 and functions assigned to other operation members is illustrated.

[0192] In the display area 602, the name of the operation member corresponding to the position of the cursor 604 moved by the user using the cross key 108 or the multi-controller 115 and the functions that can be assigned to the operation member are displayed.

[0193] In the display area 603, the name of the operation member and an abbreviation of the function assigned to the operation member are displayed.

[0194] In Figure 6A In the example shown, the AF-ON button 116 is selected, the name of the AF-ON button 116 and the name of the current function are displayed in the display area 602, and the cursor 604 is displayed in the display area 603 of the AF-ON button 116.

[0195] When the display area 603 at the position of the cursor 604 is touched or the SET button 109 is operated in a state where the display area 603 at the position of the cursor 604 is selected, a setting screen 605 for setting the function to be assigned to the AF-ON button 116 is displayed ( Figure 6B ).

[0196] Figure 6B Illustrated is the setting screen 605 displayed when the SET button 109 is operated in a state where the AF-ON button 116 is selected on the screen shown in Figure 6A .

[0197] In the display area 606, the names (Settings 1 to 5 (Set1-Set5)) and contents of the functions that can be executed when the AF-ON button 116 is half-pressed or fully pressed are displayed.

[0198] In the display area 607, options that can be assigned to the AF-ON button 116 and that each represent a combination of the function executed by the half-press operation and the function executed by the full-press operation are simply displayed.

[0199] When one of the options in the display area 607 is touched or the SET button 109 is operated in a state where one of the options in the display area 607 is selected, a screen 611 for setting the function executed by half-pressing the AF-ON button 116 and the function executed by fully pressing the AF-ON button 116 is displayed.

[0200] When the cursor moves from the option 607a in the display area 607 to the option 607b, the display area 606 is updated to the abbreviation and name of the function corresponding to the option 607b.

[0201] When setting the function that can be executed by the half-press operation and the function that can be executed by the full-press operation for the AF-ON button 116, while the cursor 604 is on the option 607a, by touching the INFO (Information) button 609, the Figure 6C shown setting screen 611 is displayed.

[0202] Figure 6C Illustrated is the setting screen 611 for setting the function that can be executed by the half-press operation and the function that can be executed by the full-press operation for the AF-ON button 116.

[0203] The function display area 612 for the half-press operation of the AF-ON button 116 and the function display area 613 for the half-press operation of the AF-ON button 116 are displayed on the screen 611, and each can be selected by moving the cursor 604 using the multi-controller 115 or the cross key 108.

[0204] In the function display area 612, the functions to be executed when the AF-ON button 116 is half-pressed can be confirmed. In the function display area 613, the functions to be executed when the AF-ON button 116 is fully pressed can be confirmed.

[0205] In Figure 6C In the example shown, "AE processing and AF processing" is set as the function to be executed when the AF-ON button 116 is half-pressed, and "Moving the AF frame by line of sight" is set as the function to be executed when the AF-ON button 116 is fully pressed.

[0206] When the cursor 604 moves on the function display area 612 and the function selection touch button 614 is touched or the SET button 109 is operated, as Figure 6D shown, a screen 615 for selecting the function to be executed is displayed.

[0207] Figure 6D An example of a screen for selecting the function to be executed by half-pressing the AF-ON button 116 is illustrated.

[0208] Note that when the cursor 604 moves on the Figure 6C screen shown on the function display area 613 and the function selection touch button 614 or the SET button 109 is operated, a screen similar to the Figure 6D screen shown for selecting the function to be executed by fully pressing the AF-ON button 116 is displayed.

[0209] In Figure 6D the example shown, the cursor is on the option 616, and "AE processing and AF processing" of the option 616 is selected for the half-press operation of the AF-ON button 116.

[0210] For example, when the cursor moves to Figure 6D "Function A" of the option 617 on the screen 615 shown, the setting for executing "Function A" of the option 617 can be made by half-pressing the AF-ON button 116.

[0211] Note that in the first embodiment, when the cursor 604 is moved on the Figure 6A screen 601 shown to select the AF-ON button 116, the Figure 6B screen 605 shown is displayed, and the combination of the functions executed by the half-press operation and the functions executed by the full-press operation that can be assigned to the AF-ON button 116 can be selected. However, Figure 6C the screen 611 shown can be displayed from the Figure 6B screen 601 without the intervention of the Figure 6A screen 605 shown.

[0212] Figure 6E Illustrates a screen for enabling or disabling the line-of-sight input function.

[0213] When "Enable" of option 617 is selected, the line-of-sight input function can be enabled to perform the line-of-sight detection process by the line-of-sight detection unit 260. When "Disable" of option 618 is selected, the line-of-sight input function can be disabled to not perform the line-of-sight detection process by the line-of-sight detection unit 260.

[0214] In the first embodiment, when option 618 is selected, since the line-of-sight input function is disabled even when the AF-ON button 116 is fully pressed, AE processing and AF processing can be performed by switching the enabling or disabling of the pupil AF function or switching the AF target subject as described in Figure 4A and Figure 4B above.

[0215] As described above, according to the first embodiment, the functions for performing AF (autofocus) processing and AE (autoexposure) processing on the subject in the live view image and the function for switching the AF target to the subject specified by the user's line-of-sight input can be appropriately used by half-pressing or fully pressing the AF-ON button 116. In this way, different functions related to AF processing can be indicated by the half-press operation and the full-press operation of the AF-ON button 116, thereby reducing the number of operation steps.

[0216] [Second Embodiment]

[0217] According to the second embodiment, the user can not only set the function to be executed by fully pressing the AF-ON button 116, but also set the function to be executed by half-pressing the AF-ON button 116. Since the device configuration according to the second embodiment is the same as that in the first embodiment, and the control processing according to the second embodiment is partially the same as that in the first embodiment, the same reference numerals denote the same processing, and their descriptions will be omitted.

[0218] The function assignment of the AF-ON button 116 on the menu screen will be described with reference to Figures 7A to 9F below.

[0219] Figure 7A Illustrates the function assignment setting screen 700 of the AF-ON button 116.

[0220] On the function assignment setting screen 700 of the AF-ON button 116, items 721 to 727 are displayed as setting items to which functions can be assigned to the AF-ON button 116. In addition, a cursor 701 indicating the selected item, a setting content display area 710 of the selected item, an advanced setting icon 702, and an OK icon 703 are displayed.

[0221] On the function assignment setting screen 700 of the AF-ON button 116, the user can operate the cross keys 108 to move the cursor 701 to one of the items 721 to 727, thereby changing the selected item. Items 721 to 727 respectively correspond to AF-ON1 to AF-ON7, and as Figure 7B shown, for each of AF-ON1 to AF-ON7, a combination of functions for the half-press operation and the full-press operation of the AF-ON button 116 is predetermined. Note that in Figure 7B , regarding the AF-ON button half-press operation of AF-ON1 and the AF-ON button full-press operation of AF-ON2 for which "user settings" are set, "metering / AF start" is set as the default setting, but the assigned functions can be changed by user selection. Since the user can set the functions to be assigned to the AF-ON button half-press operation and the AF-ON button full-press operation from the combinations of AF-ON1 to AF-ON7, the user can easily set the functions to be assigned to these two operations.

[0222] In the setting content display area 710, when the selected item is displayed, the function 711 assigned to the AF-ON button half-press operation and the function 712 assigned to the AF-ON button full-press operation are displayed. Each of the functions 711 and 712 is normally displayed when the function can be changed by user settings, and is grayed out in a distinguishable manner when the function cannot be changed. In this embodiment, the unchangeable functions are grayed out in a distinguishable manner, but can be displayed in a distinguishable manner by other methods (for example, when the function is changeable, an icon for indicating that the function is changeable is additionally displayed).

[0223] In Figure 7A , AF-ON1 (item 721) is selected by the cursor 701, where "user settings" are set for the AF-ON button half-press operation, and "disabled" is set for the AF-ON button full-press operation. Therefore, the item 712 is grayed out to indicate "disabled". Since the user can select the function to be assigned for the AF-ON button half-press operation, the item 711 is not grayed out but is normally displayed. As the function name, "metering / AF start", which is the default setting of the user settings, is displayed.

[0224] The Advanced Settings icon 702 indicates that advanced settings can be performed by pressing the INFO (Information) button (not shown) of the digital camera 100, and advanced settings can also be performed by touching the Advanced Settings icon 702. When the INFO button is pressed or a touch operation is performed on the Advanced Settings icon 702, an advanced settings screen for the selected item is displayed. The advanced settings screen will be described later with reference to Figures 8A to 8D and Figures 9A to 9F describe the advanced settings screen.

[0225] The OK icon 703 indicates that the functions to be assigned to the half-press operation and the full-press operation of the AF-ON button can be set by pressing the SET button 109 or performing a touch operation on the OK icon 703.

[0226] When the SET button 109 is pressed or a touch operation is performed on the OK icon 703, the system control unit 201 assigns the function corresponding to the selected item (i.e., the function displayed in the setting content display area 710) to the half-press operation and the full-press operation of the AF-ON button.

[0227] Figure 8A and Figure 8B each illustrate the advanced settings screen of AF-ON1 (Item 721).

[0228] Basically, the item name 801 to be the object of advanced settings, the functions 802 and 803 assigned to the half-press operation and the full-press operation of the AF-ON button respectively when setting the item to be the object of advanced settings, the cursor 804, the Advanced Settings icon 805, and the Return icon 806 are displayed on the advanced settings screens of AF-ON1 to AF-ON7.

[0229] Figure 8A and Figure 8B each shows the advanced settings screen of AF-ON1, so the icon representing AF-ON1 is displayed as the item name 801. The "Metering / AF Start" function as the default setting is displayed as the function 802 of the half-press operation, and "Disabled" is displayed as the function 803 of the full-press operation. The function 802 of the half-press operation of AF-ON1 can be changed by user settings and is thus displayed normally. On the contrary, "Disabled" as the function 803 of the full-press operation is an unchangeable fixed setting and is thus grayed out. The cursor 804 indicates which one of the function 802 of the half-press operation and the function 803 of the full-press operation is currently selected, and the selection of the function 802 of the half-press operation or the function 803 of the full-press operation can be changed by operating the cross keys 108 or a touch operation. When the INFO button is pressed or the Advanced Settings icon 805 is touched, when the function currently selected by the cursor 804 can be changed by user settings, the screen changes toFigure 8C The function change screen shown. That is, as Figure 8A and Figure 8B shown, in the case of AF-ON1, as Figure 8A shown, when the INFO button or the touch advanced setting icon 805 is pressed while the function 802 of the half-press operation that can be changed by user settings is selected, the screen changes to the function change screen. However, as Figure 8B shown, even when the INFO button is pressed while the function 803 of the full-press operation that cannot be changed by user settings is selected, the screen does not change to the function change screen. When an item that cannot be changed by user settings is selected, the screen cannot change to the function change screen, and thus as Figure 8B shown, the advanced setting icon 805 can be in a non-display state. In addition, when the menu button 114 is pressed or a touch operation is performed on the return icon 806 on the advanced setting screen, the settings on the advanced setting screen are confirmed (the setting object), and the screen returns to the previous screen (the function assignment setting screen 700 of the AF-ON button 116). In the confirmation of the settings on the advanced setting screen, regarding the item 801 as the setting object, when the item 801 is set, the functions to be assigned to the half-press operation and the full-press operation of the AF-ON button are set to the functions 802 and 803.

[0230] Figure 8C The function change screen 810 is illustrated, and a screen for changing the function assigned to the operation unit by user operation is shown. The item 811 indicates the operation unit to which the function selected on the function change screen 810 is set. In the Figure 8C shown example, the function change screen is used to set the function assigned to the half-press operation of the AF-ON button. On the function change screen 810, function icons corresponding to the functions that can be assigned are displayed, a cursor 813 is displayed for the currently selected function icon, and the text indicating the function is displayed as the item 812 for the currently selected function. When the SET button 109 is pressed or a touch operation is performed on the OK icon 815, the settings on the function change screen 810 are confirmed, and the function selected on the function change screen 810 is displayed on the advanced setting screen 800 in a state where it is set for the setting object operation unit 811. For some of the multiple functions displayed on the function change screen 810, further advanced settings can be made. When a function for which advanced settings can be made is selected, the advanced setting icon 814 is displayed, and the function advanced setting screen 820 is displayed by pressing the INFO button or the advanced setting icon 814.

[0231] Figure 8DIllustrated is the function advanced setting screen 820 for the photometry / AF start function. On the function advanced setting screen 820, the function name 821 that is the object of advanced setting, the initial setting icon 822 for returning to the initial setting, the return icon 823 for confirming the setting and returning to the previous screen (function change screen 810), and setting items for advanced setting, etc. are displayed. By performing a touch operation on the initial setting icon 822, the function advanced setting can return to the initial setting. When the menu button 114 is pressed or a touch operation is performed on the return icon 823, the settings on the function advanced setting screen 820 are reflected in the function 821 that is the object of advanced setting, and the screen returns to the function change screen 810 (the display is switched to the display of the function change screen 810).

[0232] Figures 9A to 9F Function change screens for AF-ON2 to AF-ON7 are respectively illustrated.

[0233] Figure 9A Illustrated is the function change screen for AF-ON2. In AF-ON2, "disabled" is set for the half-press operation of the AF-ON button, and since user settings can be made, "photometry / AF start" is initially displayed as the default value for the full-press operation of the AF-ON button. On the function change screen for AF-ON2, the "disabled" for the half-press operation of the AF-ON button cannot be changed and is thus grayed out, and user settings can be made for the full-press operation of the AF-ON button and the default value is usually displayed.

[0234] Figure 9B Illustrated is the function change screen for AF-ON3. In AF-ON3, "photometry / AF start" is set for the half-press operation of the AF-ON button, and "move the AF frame by line of sight" is set for the full-press operation of the AF-ON button. Therefore, on the function change screen for AF-ON3, the functions of both the half-press operation and the full-press operation of the AF-ON button cannot be set by the user and are thus grayed out.

[0235] Figure 9C Illustrated is the function change screen for AF-ON4. In AF-ON4, "photometry / AF start" is set for the half-press operation of the AF-ON button, and "pupil AF" is set for the full-press operation of the AF-ON button. Therefore, on the function change screen for AF-ON4, the functions of both the half-press operation and the full-press operation of the AF-ON button cannot be set by the user and are thus grayed out.

[0236] Figure 9DIllustrates the function change screen of AF-ON5. In AF-ON5, "Metering / AF Start" is set for the half-press operation of the AF-ON button, and "AF Stop" is set for the full-press operation of the AF-ON button. Therefore, on the function change screen of AF-ON5, the functions of both the half-press operation and the full-press operation of the AF-ON button cannot be set by the user and are thus grayed out.

[0237] Figure 9E Illustrates the function change screen of AF-ON6. In AF-ON6, "Metering / AF Start" is set for the half-press operation of the AF-ON button, and "Subject Selection Change" is set for the full-press operation of the AF-ON button. Therefore, on the function change screen of AF-ON6, the functions of both the half-press operation and the full-press operation of the AF-ON button cannot be set by the user and are thus grayed out.

[0238] Figure 9F Illustrates the function change screen of AF-ON7. In AF-ON7, "Metering / AF Start" is set for the half-press operation of the AF-ON button, and "One Shot / Servo Switch" is set for the full-press operation of the AF-ON button. Therefore, on the function change screen of AF-ON7, the functions of both the half-press operation and the full-press operation of the AF-ON button cannot be set by the user and are thus grayed out.

[0239] As Figures 9B to 9F shown, in AF-ON3 to AF-ON7, "Metering / AF Start" is set for the half-press operation of the AF-ON button and cannot be changed. However, "Metering / AF Start" is a function that can be set for advanced settings. Therefore, the advanced setting icon is displayed on the function change screen of each of AF-ON3 to AF-ON7, and when a touch operation is performed on the advanced setting icon or the INFO button is pressed, the Figure 8D function advanced setting screen 820 as shown is displayed so that the user can perform advanced settings of the function.

[0240] Figure 10 、 Figure 11A and Figure 11B are flowcharts showing the control processing of the digital camera 100 according to the second embodiment.

[0241] When the system control unit 201 controls each component by deploying the program stored in the non-volatile memory 256 to the system memory 252 and executing the program, the Figure 10 、 Figure 11A and Figure 11B processing as shown is implemented. Note that Figure 10, Figure 11A and Figure 11B The processing shown extracts the processing related to the operation of the AF-ON button 116 in the shooting standby state (a state where shooting recording processing by fully pressing the shutter release button 102 in the shooting mode is not performed). Since Figure 10 , Figure 11A and Figure 11B the processing shown is partly the same as the control processing of the first embodiment ( Figure 3A , Figure 3B , Figure 4A and Figure 4B ), the same reference numerals denote the same processing, and the description thereof will be omitted.

[0242] First, immediately after starting the digital camera 100 or immediately after the operation mode is changed to the still image shooting mode or the moving image recording mode and the display of the live view image is started, the control processing is started, and the processing in steps S301 to S306 is executed similarly to the first embodiment.

[0243] When it is determined in step S307 that the AF-ON button 116 is half-pressed, the system control unit 201 advances the processing to step S1001. When it is determined that the AF-ON button 116 is not half-pressed, similarly to the first embodiment, the system control unit 201 returns the processing to step S301.

[0244] In step S1001, the system control unit 201 determines whether the function assigned to the half-press operation of the AF-ON button 116 on the function assignment setting screen 700 is "metering / AF start". When it is determined that the function assigned to the half-press operation of the AF-ON button is "metering / AF start", the system control unit 201 advances the processing to step S308. When it is determined that the function assigned to the half-press operation of the AF-ON button is not "metering / AF start", the system control unit 201 advances the processing to step S1002.

[0245] In steps S308 to S311, the system control unit 201 executes the same processing as in steps S308 to S311 of the first embodiment's Figure 3A .

[0246] In step S1002, the system control unit 201 determines whether the function assigned to the half-press operation of the AF-ON button 116 on the function assignment setting screen 700 is "disabled". The case where the function assigned to the half-press operation of the AF-ON button is "disabled" means that no function is assigned to be executed according to the half-press operation. When it is determined that the function assigned to the half-press operation of the AF-ON button is "disabled" (i.e., no such function is assigned), the system control unit 201 advances the process to step S311 and controls not to execute the process for the half-press operation of the AF-ON button 116. When it is determined that the function assigned to the half-press operation of the AF-ON button is not "disabled", the system control unit 201 advances the process to step S1003.

[0247] In step S1003, the system control unit 201 executes the function assigned to the half-press operation of the AF-ON button and advances the process to step S311.

[0248] In step S311, the system control unit 201 determines whether the half-press operation of the AF-ON button 116 is canceled. When it is determined that the half-press operation of the AF-ON button 116 is canceled, the system control unit 201 returns the process to step S301. When it is determined that the half-press operation of the AF-ON button 116 is not canceled, the system control unit 201 advances the process to step S312.

[0249] In step S312, the system control unit 201 determines whether the AF-ON button 116 is fully pressed. When it is determined that the AF-ON button 116 is fully pressed, the system control unit 201 advances the process to step S1101. When it is determined that the AF-ON button 116 is not fully pressed, the system control unit 201 returns the process to step S311.

[0250] In step S1101, the system control unit 201 determines whether the function assigned to the full-press operation of the AF-ON button 116 on the function assignment setting screen 700 is "move the AF frame by line of sight". When it is determined that the function assigned to the full-press operation of the AF-ON button is "move the AF frame by line of sight", the system control unit 201 advances the process to step S314.

[0251] In steps S314 and S315, the system control unit 201 executes the same processes as in steps S314 and S315 of the first embodiment Figure 3B in the

[0252] In step S316, the system control unit 201 performs AE processing and AF processing on the subject at the AF position determined in step S315, and displays an AF frame for the subject at the AF position. When it is determined in step S1101 that the function assigned to the full press operation of the AF-ON button is not "move the AF frame by line of sight", the system control unit 201 advances the process to step S1102.

[0253] In step S1102, the system control unit 201 determines whether the function assigned to the full press operation of the AF-ON button on the function assignment setting screen 700 of the AF-ON button is "pupil AF". When it is determined that the function assigned to the full press operation of the AF-ON button is "pupil AF", the system control unit 201 advances the process to step S402.

[0254] In steps S402 to S406, the system control unit 201 performs the same processing as in steps S402 to S406 of the Figure 4A first embodiment, and then advances the process to step S316. In step S316, the system control unit 201 performs AE processing and AF processing on the subject at the AF position determined in step S404 or S406 to display an AF frame for the subject at the AF position, and advances the process to step S317. When it is determined in step S1102 that the function assigned to the full press operation of the AF-ON button is not "pupil AF", the system control unit 201 advances the process to step S1103.

[0255] In step S1103, the system control unit 201 determines whether the function assigned to the full press operation of the AF-ON button on the function assignment setting screen 700 of the AF-ON button is "change subject selection". When it is determined that the function assigned to the full press operation of the AF-ON button is "change subject selection", the system control unit 201 advances the process to step S1104. When it is determined that the function assigned to the full press operation of the AF-ON button is not "change subject selection", the system control unit 201 advances the process to step S1105.

[0256] In step S1104, the system control unit 201 determines a new AF position as a subject different from the subject currently set at the AF position based on the result of the subject detection process of the live view image by the image processing unit 224. That is, the AF target subject is changed from the currently selected subject to another subject. When only one subject can be detected through the subject detection process, the AF target subject may remain unchanged. In the case where two or more subjects are detected, each time the AF-ON button is fully pressed, the selection of the subject is changed in order among the detected subjects based on the size of the subject, the position of the subject, the priority, etc. Then, the system control unit 201 advances the process to step S316 and performs AE processing and AF processing on the subject (AF target subject) at the AF position determined in step S1104 to display an AF frame for the subject at this AF position. Thereafter, the system control unit 201 advances the process to step S317.

[0257] In step S1105, the system control unit 201 determines whether the function assigned to the full press operation of the AF-ON button on the function assignment setting screen 700 of the AF-ON button is "single-shot / servo switching". When it is determined that the function assigned to the full press operation of the AF-ON button is "single-shot / servo switching", the system control unit 201 advances the process to step S1106. When it is determined that the function assigned to the full press operation of the AF-ON button is not "single-shot / servo switching", the system control unit 201 advances the process to step S1107.

[0258] In step S1106, when the current AF operation setting is single-shot AF, the system control unit 201 changes the setting to servo AF, and when the current AF operation setting is servo AF, changes the setting to single-shot AF. Then, the system control unit 201 advances the process to step S316 and performs AE processing and AF processing using the AF operation setting switched in step S1106.

[0259] In step S1107, the system control unit 201 determines whether the function assigned to the full press operation of the AF-ON button on the function assignment setting screen 700 of the AF-ON button is "AF stop". When it is determined that the function assigned to the full press operation of the AF-ON button is "AF stop", the system control unit 201 advances the process to step S1108. When it is determined that the function assigned to the full press operation of the AF-ON button is not "AF stop", the system control unit 201 advances the process to step S1109.

[0260] In step S1108, when the AF operation setting is servo AF, the system control unit 201 temporarily stops the servo AF process. When the AF operation setting is single-shot AF, the AF process is not continuously executed and thus this process is not performed. During the period when the AF-ON button is fully pressed, the system control unit 201 temporarily stops the servo AF process of step S1107, and when the operation on the AF-ON button is canceled, the servo AF process is started again. Alternatively, in the case where the "metering / AF start" function is assigned to the half-press operation of the AF-ON button, when the full-press operation of the AF-ON button 116 is canceled, even if the AF-ON button 116 is half-pressed, the system control unit 201 also starts the servo AF process again. In the case where other functions are assigned to the half-press operation of the AF-ON button, when both the full-press operation and the half-press operation of the AF-ON button 116 are canceled, the system control unit 201 may start the servo AF process again.

[0261] In step S1109, the system control unit 201 determines whether the function assigned to the full-press operation of the AF-ON button on the function assignment setting screen 700 of the AF-ON button is "disabled". The case where the function assigned to the full-press operation of the AF-ON button is "disabled" means that no function is assigned to be executed according to the full-press operation of the AF-ON button. When it is determined that the function assigned to the full-press operation of the AF-ON button is "disabled" (i.e., no such function is assigned), the system control unit 201 advances the process to step S317 and performs control not to execute the process for the full-press operation of the AF-ON button. When it is determined that the function assigned to the full-press operation of the AF-ON button is not "disabled", the system control unit 201 advances the process to step S1110.

[0262] In step S1110, the system control unit executes the function assigned to the full-press operation of the AF-ON button on the function assignment setting screen 700 of the AF-ON button and advances the process to step S317.

[0263] In step S317, the system control unit 201 determines whether the full-press operation of the AF-ON button 116 has been canceled. The system control unit 201 stands by until the full-press operation of the AF-ON button 116 is canceled. When it is determined that the full-press operation of the AF-ON button 116 has been canceled, the system control unit 201 advances the process to step S318.

[0264] In step S318, the system control unit 201 determines whether the shooting operation has ended by, for example, changing the operation mode of the digital camera 100. When it is determined that the shooting operation has ended, the system control unit 201 ends the process. When it is determined that the shooting operation has not ended, the system control unit 201 returns the process to step S311.

[0265] As described above, according to the second embodiment, on the function assignment setting screen 700 of the AF-ON button 116, functions can be assigned to each of the half-press operation and the full-press operation of the AF-ON button 116. As Figure 7B shown, the functions assigned to the AF-ON button 116 can be set by a predetermined combination. Since the AF-ON button 116 is basically an operation unit set to indicate "metering / AF start", in each of AF-ON3 to AF-ON7, the "metering / AF start" function is set for the half-press operation. For each of AF-ON3 to AF-ON7 in which the "metering / AF start" function is set for the half-press operation, the operability is improved by assigning the process related to the "metering / AF start" function performed by the half-press operation to the full-press operation, and thus the function related to the AF process is set for the full-press operation. In addition, since the operation of changing the AF target subject is usually performed after the "metering / AF start" function is executed, in each of AF-ON3, AF-ON4, and AF-ON6, the function for changing the AF target subject is assigned to the full-press operation.

[0266] When the "Metering / AF Start" function is set for the half-press operation of the AF-ON button 116 and the "Move AF Frame by Gaze" is set for the full-press operation (i.e., when AF-ON3 is set on the function assignment setting screen 700 of the AF-ON button 116), the following processing is performed for the display of the gaze pointer. When AF-ON3 is set, during the period when the AF-ON button 116 is pressed (i.e., during the AF process and the AE process (metering process)), the system control unit 201 controls to display the gaze pointer regardless of the setting on the gaze pointer display setting screen. When the "Metering / AF Start" function is set for the half-press operation of the AF-ON button 116 and "OFF" or "Only in the shooting standby state" is set as the display setting of the gaze pointer, the gaze pointer is not normally displayed during the period when the AF-ON button 116 is pressed. However, when the "Move AF Frame by Gaze" is set for the full-press operation of the AF-ON button 116, the user cannot predict in advance the subject to which the frame will move by the full-press operation unless the gaze pointer is displayed before the full-press operation of the AF-ON button 116. To address this situation, when the "Move AF Frame by Gaze" is set for the full-press operation of the AF-ON button 116, even if the setting for not displaying the gaze pointer is made during the half-press operation of the AF-ON button 116, the system control unit 201 controls to display the gaze pointer according to the half-press operation of the AF-ON button 116. Note that the gaze pointer can be displayed only during the half-press operation of the AF-ON button 116, or can be displayed during both the half-press operation and the full-press operation of the AF-ON button 116.

[0267] According to the second embodiment, "AF Stop" is set for the full-press operation of the AF-ON button 116 in AF-ON5, but "Start / Stop of Global Tracking" can be set. In this case, when AF-ON5 is set on the function assignment setting screen 700 of the AF-ON button and the AF-ON button 116 is fully pressed, the following operations are performed. When the function assigned to the full-press operation of the AF-ON button 116 is "Start / Stop of Global Tracking", the system control unit 201 determines whether the AF process (face AF function) for the face of the subject is enabled. When the AF process (face AF function) for the face of the subject is enabled, the system control unit 201 enables the AF process for the fixed frame and proceeds to Figure 11B the processing in step S316 and subsequent steps; in other cases, the system control unit 201 enables the AF process (face AF function) for the face of the subject and proceeds to Figure 11BProcessing in step S316 and subsequent steps. Note that each time the full press operation of the AF-ON button 116 is repeated (after the full press operation of the AF-ON button 116 is cancelled and the AF-ON button 116 is fully pressed again), the AF processing for the face of the subject (face AF function) and the AF processing for the fixed frame can be alternately enabled. Therefore, the AF processing can be performed while switching the AF position to the face of the subject or the position of the fixed frame. Note that when the pupil AF function is enabled, each time the full press operation of the AF-ON button 116 is repeated, the AF position can be switched to the pupil of the subject or the position of the fixed frame. As described above, the user can use the function of performing AF (autofocus) processing and AE (autoexposure) processing in the live view image in different ways by half-pressing or fully pressing the AF-ON button 116, or switch the AF object to the face, pupil or fixed frame position of the subject. By assigning "start / stop of global tracking" to the full press operation of the AF-ON button 116, when autofocusing on the face of an unintended subject, the operation of changing the AF object to the position initially autofocused while switching the AF object to the position of the fixed frame can be performed in a small number of steps.

[0268] In addition, "zoom in / zoom out" can be set for the full press operation of the AF-ON button 116 in AF-ON5. In this case, when AF-ON5 is set on the function assignment setting screen 700 of the AF-ON button 116 and the AF-ON button 116 is fully pressed, the following operations are performed. When the function assigned to the full press operation of the AF-ON button 116 is "zoom in / zoom out", the system control unit 201 magnifies the live view image for the face, pupil or fixed frame position of the subject (hereinafter referred to as the zoom position) while maintaining the AE processing result / AF processing result, and proceeds to Figure 11B Processing in step S317 and subsequent steps. Note that when the AF operation setting is single-shot AF, "zoom in / zoom out" is enabled. When the AF operation setting is servo AF, the zoom position always moves continuously, so the system control unit 201 proceeds to Figure 11BThe processing in step S317 and subsequent steps. Whenever the full press operation of the AF-ON button 116 is repeated (after the full press operation of the AF-ON button 116 is canceled and the AF-ON button 116 is fully pressed again), the enabling / disabling (equal magnification) of the magnification of the live view image can be switched for the magnified position in the live view image. Whenever the full press operation of the AF-ON button 116 is repeated (after the full press operation of the AF-ON button 116 is canceled and the AF-ON button 116 is fully pressed again), the magnification can be changed to ×5, ×10, and equal magnification in sequence for display for the magnified position in the live view image. In the second embodiment, the magnification is set to ×5 or ×10, but the changed magnification is not limited to this. The order of changing the magnification can be freely changed. As described above, the user can use the functions of performing AF (autofocus) processing and AE (autoexposure) processing in the live view image or the function of magnifying / reducing the display of the magnified position in the live view image in different ways by half-pressing or fully pressing the AF-ON button 116. The user can assign "magnify / reduce" to the full press operation of the AF-ON button 116 and perform the magnification display of the live view image by fully pressing the AF-ON button 116 and the confirmation of whether the subject is autofocused in a small number of steps.

[0269] In the above embodiments, one of AF-ON1 to AF-ON7 can be set on the function assignment setting screen 700 as the function assigned to the half-press operation and full-press operation of the AF-ON button 116. However, in each of the shooting mode and the playback mode, different functions can be set for the half-press operation and full-press operation of the AF-ON button 116. The functions set in each of the items (AF-ON1 to AF-ON7) that can be set on the function assignment setting screen 700 can be different between the shooting mode and the playback mode. In addition, the number of items ( Figure 7A AF-ON1 to AF-ON7) that can be set on the function assignment setting screen 700 can be different between the shooting mode and the playback mode.

[0270] [Other Embodiments]

[0271] The present invention can be implemented by supplying a program for realizing one or more functions in the above embodiments to a system or device via a network or a storage medium and causing one or more processors in the computer of the system or device to read and execute the program. The present invention can also be implemented by a circuit system (e.g., ASIC) for realizing one or more functions.

[0272] The above embodiments can be combined and implemented.

[0273] The present invention is not limited to the above embodiments, and various changes and modifications can be made within the spirit and scope of the present invention. Therefore, the appended claims are made to inform the public of the scope of the present invention.

[0274] This application claims the benefit of Japanese Patent Application No. 2022-175677 filed on November 1, 2022 and Japanese Patent Application No. 2023-176879 filed on October 12, 2023, the entire contents of which are incorporated herein by reference.

[0275] Explanation of reference numerals

[0276] 100…Digital camera, 101…Rear display unit, 116…AF-ON button, 201…System control unit, 222…Imaging unit, 224…Image processing unit, 260…Gaze detection unit

Claims

1. A camera device, characterized in that, Comprising: An imaging component; A processing component for performing a predetermined process on a subject in an image captured by the imaging component; A first operation unit configured to issue a shooting instruction; A second operation unit different from the first operation unit; And A control component for controlling to perform the predetermined process on a first subject in the image according to a first pressing operation on the second operation unit, and for switching an object of the predetermined process according to a second pressing operation on the second operation unit after the first pressing operation.

2. The imaging device according to claim 1, wherein, Comprising: A gaze detection component for detecting a gaze position of a user, wherein the control component controls to perform the predetermined process on a first subject in the image according to a first pressing operation on the second operation unit, and for switching an object of the predetermined process to a subject corresponding to the user's gaze position according to a second pressing operation on the second operation unit.

3. The imaging device according to claim 1, characterized in that, The control component controls to perform the predetermined process on a first subject in the image according to a first pressing operation on the second operation unit, and for switching an object of the predetermined process between the entire face and the pupil of the first subject according to a second pressing operation on the second operation unit.

4. The imaging device according to claim 3, wherein, The control component controls to perform the predetermined process on a first subject in the image according to a first pressing operation on the second operation unit, and for switching an object of the predetermined process between the entire face, the right eye and the left eye of the first subject according to a second pressing operation on the second operation unit.

5. The imaging device according to claim 1, wherein, The control component controls to perform the predetermined process on a first subject in the image according to a first pressing operation on the second operation unit, and for switching an object of the predetermined process between the right eye and the left eye of the first subject according to a second pressing operation on the second operation unit.

6. The imaging device according to any one of claims 1 to 5, characterized in that, The first pressing operation on the second operation unit is a half-pressing operation on the second operation unit, and the second pressing operation on the second operation unit is a full-pressing operation on the second operation unit.

7. The imaging device according to any one of claims 1 to 6, characterized in that, Comprising: A subject detection component for detecting a subject from an image captured by the imaging component, wherein the first subject is one of a subject determined by the subject detection component and a subject designated by the user.

8. The imaging device according to claim 2, wherein Comprising: A setting component for enabling or disabling a gaze input function based on detection of a gaze by the gaze detection component, wherein, when the gaze input function is disabled, the control component performs the predetermined process on the pupil of the first subject without switching the subject that is an object of the predetermined process corresponding to the user's gaze position according to a second pressing operation on the second operation unit.

9. The imaging device according to claim 8, characterized in that, When the first pressing operation and the second pressing operation on the second operation unit are repeated during the period when the line-of-sight input function is disabled, each time the second pressing operation is performed on the second operation unit, the control component switches the object of the predetermined process to one of the pupil of the first subject and the face of the first subject.

10. The imaging device according to claim 2, characterized in that, Comprising: A setting component for enabling or disabling a line-of-sight input function based on the detection of the line of sight by the line-of-sight detection component. Wherein, when the second pressing operation is performed on the second operation unit during the period when the line-of-sight input function is disabled, the control component performs the predetermined process on a subject determined independently of the line-of-sight position of the user and different from the first subject.

11. The imaging device according to claim 10, wherein, When the first pressing operation and the second pressing operation on the second operation unit are repeated, each time the second pressing operation is performed on the second operation unit, the control component switches the subject that is the object of the predetermined process.

12. The imaging device according to any one of claims 1 to 11, characterized in that, When the state returns to the state where the first pressing operation is performed after the second pressing operation is performed on the second operation unit, the control component performs the predetermined process on the subject that is the object of the predetermined process switched according to the second pressing operation.

13. The imaging device according to any one of claims 1 to 12, characterized in that, The control component performs control to perform the predetermined process on the subject in the image according to the first pressing operation on the first operation unit, and perform a recording process for the imaging component to capture and record the image according to the second pressing operation on the first operation unit.

14. The imaging device according to any one of claims 1 to 13, characterized in that, Comprising: An allocation component for allocating, according to a user operation, a first function to be performed according to the first pressing operation on the second operation unit and a second function to be performed according to the second pressing operation on the second operation unit to the second operation unit.

15. The imaging device according to any one of claims 1 to 13, characterized in that, Comprising: An allocation component for allocating, according to a user operation, a function to be performed according to an operation on the operation unit of the imaging device. Wherein, the control component performs control to perform the predetermined process on the subject in the image according to the first pressing operation on the first operation unit, and perform a recording process for the imaging component to capture and record the image according to the second pressing operation on the first operation unit, and The allocation component can allocate, according to a user operation, a function to be performed according to the second pressing operation on the second operation unit, and cannot allocate, according to a user operation, a function to be performed according to the second pressing operation on the first operation unit.

16. The imaging device according to any one of claims 1 to 15, characterized in that, The control component performs control not to perform the predetermined process during the period when the second operation unit is not operated, and perform the predetermined process according to the first pressing operation on the second operation unit.

17. The imaging device according to any one of claims 1 to 16, characterized in that, The predetermined process is a process for performing photometry on the subject in the image and focusing on the subject.

18. The imaging device according to any one of claims 1 to 17, characterized in that, The first operation unit is a shutter release button.

19. A method for controlling a camera device, wherein: The imaging device includes: An imaging component; A processing component for performing a predetermined process on the subject in the image captured by the imaging component; A first operation unit configured to issue a shooting instruction; and A second operation unit, which is different from the first operation unit, wherein the control method includes the following steps: Perform control to execute the predetermined process on a first subject in the image according to a first pressing operation on the second operation unit, and switch the object of the predetermined process according to a second pressing operation on the second operation unit after the first pressing operation.

20. A program for causing a computer to function as an imaging device according to any one of claims 1 to 18.

Images