Imaging device, control method, and program

Abstract

To switch a display destination by determining whether it is a temporary eye separation state or a permanent eye separation state.SOLUTION: An imaging device includes: a first display unit visible to a user by peering into it; a second display unit visible to a user without peering into it; eye-on detection means for detecting an eye-on or eye separation state relative to the first display unit; posture detection means that detects posture change in the imaging device; and control means that performs control to switch a display destination to the first display unit or the second display unit according to detection results of the eye-on detection means. After the eye-on state is detected by the eye-on detection means and the display destination is switched to the first display unit, when the eye separation state is detected, the control means detects relative motion of the imaging device relative to the user based on the detection information of the posture detection means to determine whether or not it is a temporary eye separation state. When it is determined that it is a temporary eye separation state, the display destination is controlled not to switched to the second display unit.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present invention relates to a control technique for switching display destinations in an imaging device equipped with a plurality of display units. [Background technology]

[0002] Some imaging devices, such as digital cameras (single-lens reflex or mirrorless), are equipped with multiple displays: an eyepiece display that can be viewed by the user looking into it, and a rear display that can be viewed without the user looking into it. In these imaging devices, when the photographer is in the eyepiece state looking into the eyepiece display, the rear display is hidden and the eyepiece display is displayed; when the photographer is in the eye-away state looking away from the eyepiece display, the eyepiece display is hidden and the rear display is displayed. Whether the photographer is looking into the eyepiece display is detected by an eyepiece detection unit provided in the eyepiece of the imaging device.

[0003] If the eyepiece display is hidden when the photographer temporarily looks away from the eyepiece display to view the subject, there is a possibility that the photographer will miss a photographic opportunity in the time it takes for the eyepiece display to be displayed again when the photographer looks at the eyepiece display again.

[0004] Against this background, Patent Documents 1 and 2 propose a technique for controlling whether to continue displaying on the eyepiece display unit depending on the operation status of the imaging device by the photographer and changes in the output value of the eyepiece detection unit. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Publication No. 2018-037861 [Patent Document 2] Japanese Patent Application Laid-Open No. 2011-059373 Summary of the Invention [Problem to be solved by the invention]

[0006] However, in Patent Document 1, the display on the eyepiece display cannot be maintained if the photographer temporarily looks away from the eyepiece display without performing any operations. Also, in Patent Document 2, vertical movement of the imaging device cannot be detected solely from the output value of the eyepiece detection unit.

[0007] The present invention has been made in consideration of the above-mentioned problems, and its purpose is to realize a technology that can determine whether the eye is in a temporary or permanent state and switch the display destination based on the determination result. [Means for solving the problem]

[0008] In order to solve the above problems and achieve the object, the imaging device of the present invention has a first display unit that can be seen by the user by looking into it, a second display unit that can be seen without the user looking into it, an eye-close detection means for detecting whether the user is in eye-close or eye-away state with respect to the first display unit, an attitude detection means for detecting changes in attitude of the imaging device, and a control means for controlling switching of the display destination between the first display unit and the second display unit depending on the detection result by the eye-close detection means, and after the eye-close state is detected by the eye-close detection means and the display destination is switched to the first display unit, if the eye-away state is detected, the control means detects the relative movement of the imaging device with respect to the user based on the detection information of the attitude detection means and determines whether the eye-away state is temporary, and if it determines that the eye-away state is temporary, controls not to switch the display destination to the second display unit. [Effects of the Invention]

[0009] According to the present invention, it is possible to determine whether the eye is in a temporary or permanent eye-away state, and to switch the display destination based on the determination result. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is a block diagram illustrating a hardware configuration of an imaging apparatus according to an embodiment of the present invention. [Figure 2] FIG. 4 is a diagram for explaining control for switching the display destination according to the first embodiment. [Figure 3] 5A to 5C are diagrams illustrating changes in the posture of the imaging apparatus according to the first embodiment. [Figure 4] 10 is a flowchart illustrating a control process for switching the display destination according to the first embodiment. [Figure 5] 10 is a flowchart illustrating a control process for switching the display destination according to the second embodiment. [Figure 6] FIG. 11 is a diagram illustrating the configuration of an eyepiece detection unit according to a third embodiment. [Figure 7] 11A and 11B are diagrams illustrating examples of temporal changes in output values ​​of an eyepiece detection unit according to the third embodiment. [Figure 8] 11 is a flowchart illustrating a control process for switching the display destination according to the third embodiment. [Figure 9] 10A and 10B are diagrams illustrating images captured by the image sensor of the fourth embodiment. [Figure 10] 10 is a flowchart illustrating a control process according to the fourth embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the invention claimed. Although multiple features are described in the embodiments, not all of these multiple features are necessarily essential to the invention, and multiple features may be combined arbitrarily. Furthermore, in the accompanying drawings, the same reference numerals are used to designate the same or similar components, and redundant explanations will be omitted.

[0012] Hereinafter, an embodiment in which an imaging device of the present invention is applied to a digital camera (single-lens reflex or mirrorless type) capable of taking still images and recording moving images will be described in detail with reference to the accompanying drawings.

[0013] In this embodiment, an example will be described in which a digital camera has multiple display units, including an eyepiece-type display unit and a non-eyepiece-type display unit, and the display destination of the live view is switched between the eyepiece-type display unit and the non-eyepiece-type display unit depending on whether the user is holding their eye close to the eyepiece-type display unit or not.

[0014] The imaging device of this embodiment is not limited to a digital camera, but can be applied to home appliances, medical equipment, electronic binoculars, eyeglass-type terminals, goggle-type terminals, etc. as a display control device that has multiple display units including an eyepiece-type display unit and switches the display destination of the live view depending on whether the user's eye is close to or far from the eyepiece-type display unit.

[0015] <Device Configuration> First, the configuration and functions of an image capture device 100 of this embodiment will be described with reference to FIG.

[0016] FIG. 1 is a block diagram showing the hardware configuration of an image capturing apparatus 100 according to this embodiment.

[0017] The control unit 101 includes at least one processor and controls the entire imaging device 100. The control unit 101 loads a program stored in the nonvolatile memory 106 into the system memory 108 and executes it to implement each process in the flowcharts described below. Note that instead of the control unit 101 controlling the entire device, the entire device may be controlled by a plurality of hardware components sharing the processing load.

[0018] The control unit 101 includes a system timer that measures the time used for various controls and the time of an internal clock.

[0019] The power supply control unit 102 is composed of a battery detection circuit, a DC-DC converter, a switch circuit for switching between powered blocks, etc., and detects whether a battery is installed, the type of battery, and the remaining battery power. Furthermore, the power supply control unit 102 controls the DC-DC converter based on the detection results and instructions from the control unit 101, and supplies the required voltage for the required period to each unit, including the recording medium 107.

[0020] The power supply unit 103 includes a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as an NiCd battery, an NiMH battery, or a lithium ion battery, an AC adapter, or the like.

[0021] The operation unit 104 is an operation member that receives various operations from the user and notifies the control unit 101, and is made up of any one or a combination of switches, buttons, dials, a touch panel, a voice recognition device, and the like.

[0022] The operation unit 104 includes at least a touch panel, a still image capture button, a video capture button, a mode dial, and a power switch.

[0023] The still image capture button is a push-type operating member for instructing the control unit 101 to perform still image capture processing. The video capture button is a push-type operating member for instructing the control unit 101 to perform video capture processing.

[0024] The mode dial is a rotary operating member for switching the operation mode of the imaging device 100. The mode dial can switch the operation mode of the imaging device 100 between a still image capture mode, a video capture mode, and a playback mode.

[0025] The power switch is a rotary operating member that turns the power of the imaging device 100 on and off.

[0026] In the still image shooting mode, when the still image shooting button is pressed halfway, the control unit 101 starts AE control and AF control. When the still image shooting button is pressed all the way, the control unit 101 executes a still image shooting process for recording image data captured by the imaging unit 105 onto the recording medium 107.

[0027] In addition, in the video shooting mode, when the video shooting button is pressed for the first time, the control unit 101 performs AE control and AF control on the image data (frames) captured by the imaging unit 105, continues the video shooting process of recording a video for a predetermined period of time on the recording medium 107, and stops the video shooting process when the video shooting button is pressed again.

[0028] The imaging unit 105 includes an image sensor such as a CCD or CMOS that converts an optical image of a subject formed by the lens unit 114 into an electrical signal. The imaging unit 105 also includes an A / D conversion unit that generates still image data or video data composed of digital signals from still image data and video data composed of analog signals.

[0029] The control unit 101 performs various types of image processing on image data generated by the imaging unit 105. The control unit 101 generates image files by compressing and encoding the processed still image data in a format such as JPEG, or by encoding the moving image data in a moving image compression format such as MP4, and records the generated image files on the recording medium 107. The control unit 101 also decodes still image files read from the recording medium 107, or decodes moving image files read from the recording medium 107.

[0030] Furthermore, the control unit 101 performs automatic exposure (AE) processing and autofocus (AF) processing by controlling the lens unit 114 based on the results of predetermined calculation processing using the image data that has been subjected to image processing.

[0031] The nonvolatile memory 106 is an electrically erasable and recordable memory, and may be, for example, a flash ROM. The nonvolatile memory 106 stores constants, programs, etc. for the operation of the control unit 101. The programs referred to here are programs for executing the flowcharts described below.

[0032] The recording medium 107 is detachable from the image capturing device 100 and is made up of a semiconductor memory such as a memory card or a magnetic disk such as a hard disk for recording captured images.

[0033] The system memory 108 is a volatile memory, such as a RAM. The system memory 108 is also used as a work memory for storing constants and variables for the operation of the control unit 101, and programs read from the nonvolatile memory 106. The system memory 108 also stores image data captured by the imaging unit 105 and image display data to be displayed on the rear display unit 109 and the eyepiece display unit 110.

[0034] The rear display unit 109 is a non-eyepiece type display unit that can be viewed by the user without looking directly at it. The rear display unit 109 is a display device such as a liquid crystal or organic EL provided on the rear surface of the device body. The rear display unit 109 displays still images and videos recorded on the recording medium 107, live views of still images being captured and videos being recorded, various configurable menu screens, and the like. The rear display unit 109 is provided with a touch panel. The touch panel is an operating member that can detect contact (touch operation) with the display surface of the rear display unit 109 (touch operation surface of the touch panel).

[0035] The eyepiece display unit 110 is an eyepiece-type display unit known as an electronic viewfinder that can be viewed by the user by peering into it. The eyepiece display unit 110 is a display device such as a liquid crystal or organic electroluminescence (EL) display provided in the eyepiece on the back of the device body. The eyepiece display unit 110 displays still images and videos recorded on the recording medium 107, live views of still images being captured and videos being recorded, various configurable menu screens, and the like. The user can view the image displayed on the eyepiece display unit 110 and check the focus and composition of the subject image captured through the lens unit 114.

[0036] The eyepiece detection unit 111 is disposed near the eyepiece display unit 110 and is capable of detecting the approach of an object to the eyepiece display unit 110. The eyepiece detection unit 111 is, for example, an infrared proximity sensor.

[0037] The eyepiece detection unit 111 detects whether the eye (object) is approaching (eye proximity) or moving away (eye distance) from the eyepiece display unit 110 (approach detection). The control unit 101 switches between displaying (display state) and hiding (hidden state) the rear display unit 109 and the eyepiece display unit 110 according to the state detected by the eyepiece detection unit 111. At least in the shooting mode, the control unit 101 sets the display destination to the rear display unit 109 when the eyepiece display unit is not in view and hides the eyepiece display unit 110. Furthermore, when the eyepiece display unit is in view, the display destination is set to the eyepiece display unit 110 and hides the rear display unit 109.

[0038] The orientation detection unit 112 detects the orientation of the imaging device 100 with respect to the direction of gravity. The orientation detection unit 112 detects vertical movement of the imaging device 100, horizontal movement of the imaging device 100, rotation of the imaging device 100 about the vertical direction, rotation of the imaging device 100 about the horizontal direction, a first orientation in which the imaging device 100 is in a horizontal state, and a second orientation in which the imaging device 100 is in a vertical state. The orientation detection unit 112 can use an acceleration sensor, a gyro sensor, or the like. By using an acceleration sensor or a gyro sensor, the orientation detection unit 112 can also detect movement (pan, tilt, etc.) of the imaging device 100.

[0039] The lens connection section 113 includes an attachment / detachment mechanism that mechanically and electrically connects the lens unit 114 to the image capture device 100, electrical contacts, communication terminals, and the like.

[0040] The lens unit 114 includes a focus lens, a zoom lens, an aperture, and drive mechanisms and drive circuits for these lenses, and is detachable from the imaging device 100 .

[0041] [Embodiment 1] Next, a control process for switching the display destination according to the first embodiment will be described with reference to FIGS.

[0042] In the first embodiment, the display destination is switched based on the detection information from the eyepiece detection unit 111 and the detection information from the orientation detection unit 112.

[0043] First, with reference to FIG. 2, a shooting situation of the imaging device 100 assumed in this embodiment will be described.

[0044] FIG. 2( a ) illustrates a situation in which a photographer 201 is looking into the eyepiece display unit 110 of the imaging device 100 and photographing a subject 202 .

[0045] 2(a), when the photographer 201 temporarily looks away from the eyepiece display unit 110 to view the subject 202, the photographer 201 tends to move the imaging device 100 held in his / her hand downward, as shown in FIG. 2(b). Also, when the photographer 201 temporarily looks away from the eyepiece display unit 110 to view the rear display unit 109, the photographer 201 tends to tilt the imaging device 100 held in his / her hand forward, as shown in FIG. 2(c).

[0046] If the photographer 201 temporarily looks away from the eyepiece display unit 110 as shown in Figure 2(b), but immediately returns the imaging device 100 to its original position and looks at the eyepiece display unit 110, it is assumed that the photographer will want the eyepiece display unit 110 to immediately return to its display state.

[0047] However, in the imaging device 100, it is difficult to distinguish between a case where the photographer 201 has simply temporarily looked away from the eyepiece display unit 110 and does not want the display to switch from the eyepiece display unit 110 to the rear display unit 109 (temporary eye-away) and a case where the photographer wants to switch the display from the eyepiece display unit 110 to the rear display unit 109 (permanent eye-away) based on the detection results of the eye-closed or eye-away state by the eye-closed detection unit 111.

[0048] Therefore, in this embodiment, it is determined whether or not the user has temporarily looked away from the camera based on a change in the posture of the image capturing device 100 held by the user. FIG. 4 is a flowchart illustrating a control process for switching the display destination according to the first embodiment.

[0049] The processing in FIG. 4 is realized by the control unit 101 loading a program stored in the nonvolatile memory 106 into the system memory 108, executing the program, and controlling each component of the imaging device 100.

[0050] The process in FIG. 4 starts when the power supply of the imaging device 100 is turned on and the imaging device 100 is started up, with the eyes not in contact with the camera (step S401).

[0051] After the imaging device 100 is started, in step S402, the control unit 101 determines whether or not an eye-contact state has been detected by the eye-contact detection unit 111. If the control unit 101 determines that the eye-contact state has not been detected by the eye-contact detection unit 111, the process proceeds to step S403. If the control unit 101 determines that the eye-contact state has been detected by the eye-contact detection unit 111, the process proceeds to step S404.

[0052] In step S403, the control unit 101 turns off the eyepiece display unit 110 to put it in a non-display state, and turns on the rear display unit 109 to put it in a display state.

[0053] In step S404, the control unit 101 switches the display destination from the rear display unit 109 to the eyepiece display unit 110. The control unit 101 turns off the rear display unit 109 to put it in a non-display state, and turns on the eyepiece display unit 110 to put it in a display state.

[0054] In step S405, the control unit 101 determines whether or not an eye-contact state has been detected by the eye-contact detection unit 111. If the control unit 101 determines that an eye-contact state has been detected by the eye-contact detection unit 111, the process returns to step S402. If the control unit 101 determines that an eye-contact state has not been detected by the eye-contact detection unit 111 (i.e., an eye-away state has been detected), the process proceeds to step S406.

[0055] In steps S406 to S410, the control unit 101 determines whether the eye movement is temporary or permanent.

[0056] Here, with reference to FIG. 3, a description will be given of changes in the posture of the image capturing device 100 of this embodiment and information detected by the posture detecting unit 112. FIG.

[0057] The left-right direction of the imaging device 100 is defined as the X-axis, the up-down direction as the Y-axis, and the front-to-back direction as the Z-axis. Of the movement of the imaging device 100 in the X-axis direction, the direction of the grip part 100a on the right side when viewed from the back of the imaging device 100 is defined as the grip direction. Of the movement of the imaging device 100 in the Y-axis direction, the direction of the top part 100b of the imaging device 100 is defined as the top direction, and the direction of the bottom part 100c of the imaging device 100 is defined as the bottom direction.

[0058] Furthermore, rotation of the imaging device 100 around the Y axis is defined as yaw, rotation around the X axis as pitch, and rotation around the Z axis as roll.

[0059] A first attitude in which the Y axis of the imaging device 100 is perpendicular to the ground is defined as a normal position, and a second attitude in which the X axis of the imaging device 100 is perpendicular to the ground is defined as a vertical position.

[0060] In this embodiment, whether the eye averting state is temporary or permanent is determined based on the change in attitude of the imaging device 100 after the eye averting state is detected, more specifically, based on the detection information of the attitude detection unit 112, such as the normal position, vertical position, movement in the Y-axis direction, and whether or not there is rotation in the pitch direction or yaw direction.

[0061] In step S406, the control unit 101 determines whether the image capturing device 100 is in the normal position based on the detection information from the orientation detection unit 112. If the control unit 101 determines that the image capturing device 100 is in the normal position, the process proceeds to step S407. If the control unit 101 determines that the image capturing device 100 is not in the normal position, the process proceeds to step S408.

[0062] In step S407, the control unit 101 determines whether or not rotation in the pitch direction has been detected by the attitude detection unit 112 after the eye-away state has been detected in step S405. If the control unit 101 determines that rotation in the pitch direction of the image capture device 100 has not been detected, it determines that the eye-away state is temporary, and proceeds to step S409. If the control unit 101 determines that rotation in the pitch direction of the image capture device 100 has been detected, it determines that the eye-away state is permanent, and returns to step S402. In step S402, the control unit 101 again determines whether or not the eye-away state has been detected by the eye-contact detection unit 111, and if it determines that the eye-away state has been detected, it proceeds to step S403, and switches the display destination from the eyepiece display unit 110 to the rear display unit 109.

[0063] In step S409, the control unit 101 determines whether the image capture device 100 is moving in the bottom direction of the Y axis based on the detection information from the orientation detection unit 112. If the control unit 101 determines that the image capture device 100 is moving in the bottom direction of the Y axis, it determines that the eye has temporarily moved away, and proceeds to step S411. If the control unit 101 determines that the image capture device 100 is not moving in the bottom direction of the Y axis, it determines that the eye has permanently moved away, and returns to step S402. In step S402, the control unit 101 again determines whether the eye-away state has been detected by the eyepiece detection unit 111, and if it determines that the eye-away state has been detected, it proceeds to step S403, and switches the display destination from the eyepiece display unit 110 to the rear display unit 109.

[0064] In step S408, the control unit 101 determines whether or not rotation in the yaw direction has been detected by the attitude detection unit 112 after the eye-away state has been detected in step S405. If the control unit 101 determines that rotation in the yaw direction of the image capture device 100 has not been detected, it determines that the eye-away state is temporary, and proceeds to step S410. If the control unit 101 determines that rotation in the yaw direction of the image capture device 100 has been detected, it determines that the eye-away state is permanent, and returns to step S402. In step S402, the control unit 101 again determines whether or not the eye-away state has been detected by the eye-contact detection unit 111, and if it determines that the eye-away state has been detected, it proceeds to step S403, and switches the display destination from the eyepiece display unit 110 to the rear display unit 109.

[0065] In step S410, the control unit 101 determines whether or not the imaging device 100 is moving in the grip direction of the X axis based on the detection information from the orientation detection unit 112. If the control unit 101 determines that the imaging device 100 is moving in the grip direction of the X axis, it determines that the eye has been temporarily averted, and proceeds to step S411. If the control unit 101 determines that the imaging device 100 is not moving in the grip direction of the X axis, it determines that the eye has been permanently averted, and returns to step S402. In step S402, the control unit 101 again determines whether or not the eye-averted state has been detected by the eye-contact detection unit 111, and if it determines that the eye-averted state has been detected, it proceeds to step S403, and switches the display destination from the eyepiece display unit 110 to the rear display unit 109.

[0066] In step S411, if the control unit 101 determines in the processing of steps S406 to S410 that there is a high possibility that the photographer has temporarily looked away, it maintains the display on the eyepiece display unit 110 without switching to the rear display unit 109.

[0067] In step S412, the control unit 101 determines whether or not the eyepiece detection unit 111 has detected an eye-close state, i.e., whether or not the photographer continues to temporarily look away from the camera. The control unit 101 continues to maintain the display destination in step S411 on the eyepiece display unit 110 while the photographer continues to temporarily look away from the camera. If the control unit 101 determines that an eye-close state has been detected, the control unit 101 returns the process to step S402. In step S402, the control unit 101 again determines whether or not the eye-close state has been detected by the eyepiece detection unit 111. If it determines that an eye-close state has been detected, the control unit 101 proceeds to step S403, where the display destination is switched from the eyepiece display unit 110 to the rear display unit 109. Note that a system timer built into the control unit 101 may be used to control the process to return from step S412 to step S402 after a predetermined time has elapsed.

[0068] As described above, according to the first embodiment, by controlling the switching of the display destination based on the detection information from the eyepiece detection unit 111 and the detection information from the orientation detection unit 112, it is possible to maintain the display destination on the eyepiece display unit 110 without switching it to the rear display unit 109, even if the photographer temporarily looks away from the eyepiece display unit 110 to view the subject. As a result, it is possible to set the display destination in line with the photographer's intention.

[0069] [Embodiment 2] Next, a control process for switching the display destination according to the second embodiment will be described with reference to FIG.

[0070] In the second embodiment, the display destination is switched based on the detection information from the eyepiece detection unit 111 and the detection information from the orientation detection unit 112, as well as the operation instruction from the operation unit 104 and information from the lens unit 114.

[0071] In the second embodiment, in order to improve the accuracy of determining whether the eye has been moved away temporarily or permanently, the display destination switching control of the first embodiment is assumed, and the determination is made based on the operating status of the image capture device 100, the operating status of the operation unit 104, the time elapsed since the eye has been moved away, the attachment status of accessories, etc. Accessories are auxiliary devices used for shooting, such as lenses, external flashes, and external microphones, and can be attached to the image capture device 100.

[0072] The configuration of the imaging device of the second embodiment is the same as that of the first embodiment shown in FIG.

[0073] FIG. 5 is a flowchart illustrating a control process for switching the display destination according to the second embodiment.

[0074] The processing in FIG. 5 is realized by the control unit 101 loading a program stored in the nonvolatile memory 106 into the system memory 108, executing the program, and controlling each component of the imaging device 100.

[0075] The processing in steps S502 to S512 is the same as that in steps S402 to S412 in FIG.

[0076] After the imaging device 100 starts up in step S521, the control unit 101 acquires the attachment status of the accessory in step S522. The attachment status of the accessory is, for example, the weight and length of the lens unit 114 acquired from the lens unit 114 attached to the imaging device 100.

[0077] In step S523, the control unit 101 sets thresholds for rotation and movement of the imaging device 100 based on the attachment status of the accessory acquired in step S522. Note that the accessory is not limited to the lens unit 114. The attachment status of an accessory attached to an accessory contact portion (not shown) located on the top portion 100b of the imaging device 100 may be acquired and the thresholds for rotation and movement of the imaging device 100 may be changed. The reason for setting thresholds for rotation and movement of the imaging device 100 is that the amount of rotation and movement of the imaging device 100 may change depending on the weight and length of the accessory attached to the imaging device 100.

[0078] In step S524, the control unit 101 determines whether the focal length of the lens unit 114 is equal to or greater than a predetermined threshold. If the control unit 101 determines that the focal length of the lens unit 114 is equal to or greater than the predetermined threshold, the control unit 101 proceeds to step S502. If the control unit 101 determines that the focal length of the lens unit 114 is less than the predetermined threshold, the control unit 101 proceeds to step S525, where the control unit 101 controls the switching of the display destination based solely on the detection information of the eyepiece detection unit 111. As the focal length increases, the angle of view of the imaging device 100 becomes narrower compared to the angle of view of the actual field of view when photographing while looking through the eyepiece display unit 110. This increases the likelihood that the photographer will lose sight of the subject and temporarily look away to check the subject. For example, the possibility of losing sight of the subject increases when photographing while looking through the eyepiece display unit 110 using a telephoto lens with a focal length of 200 mm or more. In the control of the second embodiment, the display destination is maintained on the eyepiece display unit 110 when it is determined that the subject has temporarily looked away. Therefore, the control may be performed only when the focal length is long, which increases the likelihood of temporary looking away.

[0079] The processes in steps S502 and S504 are the same as those in steps S402 and S404 in FIG.

[0080] In step S505, the control unit 101 determines whether or not an eye-contact state has been detected by the eye-contact detection unit 111. If the control unit 101 determines that an eye-contact state has been detected by the eye-contact detection unit 111, the process returns to step S504. If the control unit 101 determines that an eye-contact state has not been detected by the eye-contact detection unit 111 (i.e., an eye-away state has been detected), the process proceeds to step S526.

[0081] In step S526, the control unit 101 determines whether an image captured in response to a shooting instruction from the operation unit 104 is currently being displayed. If the control unit 101 determines that a captured image is currently being displayed, the process returns to step S502. In step S502, the control unit 101 again determines whether an eye-away state has been detected by the eyepiece detection unit 111. If it determines that an eye-away state has been detected, the process proceeds to step S503, where the display destination is switched from the eyepiece display unit 110 to the rear display unit 109. The reason for this control is that while a captured image is being displayed, it is unlikely that the photographer will temporarily look away from the camera to check the captured subject, but it is more likely that the photographer will permanently look away from the camera to look at the rear display unit 109. Note that the display destination may be immediately switched to the rear display unit 109 without being maintained on the eyepiece display unit 110, not only while a captured image is being displayed, but also when the imaging device 100 is in a specific mode, such as when a menu screen for configuring various settings for the imaging device 100 is being displayed.

[0082] If it is determined that the captured image is not being displayed, the control unit 101 determines that the eye averting is likely to be temporary, and proceeds to step S506. The processes from step S506 to S510 determine whether the eye averting is temporary or permanent, based on the detection information from the posture detection unit 112.

[0083] The processing of steps S506 to S510 is the same as the processing of steps S406 to S410 in Figure 4, and the control unit 101 determines whether rotation or movement equal to or greater than the threshold set in step S523 has been detected, and if it determines that there is a high possibility that the photographer has temporarily looked away, the processing proceeds to step S527.

[0084] In step S527, the control unit 101 starts a system timer built into the control unit 101, and in step S511, the display destination is maintained on the eyepiece display unit 110.

[0085] The processing in step S512 is the same as the processing in step S412 in FIG. 4, and the control unit 101 determines whether or not the eye-closed state has been detected by the eye-closed detection unit 111, i.e., whether or not the photographer continues to temporarily look away from the camera. If the control unit 101 determines that the photographer continues to temporarily look away from the camera, the control unit 101 proceeds to step S528. If the control unit 101 determines that the eye-closed state has been detected, the control unit 101 returns to step S502 and stops the system timer in step S527. In step S502, the control unit 101 again determines whether or not the eye-closed state has been detected by the eye-closed detection unit 111. If the control unit 101 determines that the eye-closed state has been detected, the control unit 101 proceeds to step S503, where it switches the display destination from the eye-closed display unit 110 to the rear display unit 109.

[0086] In step S528, the control unit 101 determines whether an operation instruction has been received from the operation unit 104 by the user operating the operation unit 104. If the control unit 101 determines that an operation instruction has been received from the operation unit 104, the process returns to step S502 and stops the system timer in step S527. In step S502, the control unit 101 again determines whether an eye-away state has been detected by the eyepiece detection unit 111. If it determines that an eye-away state has been detected, the process proceeds to step S503, where the display destination is switched from the eyepiece display unit 110 to the rear display unit 109. The reason for this control is that when the photographer operates the operation unit 104, it is unlikely that the photographer will temporarily look away from the eye to view the subject, but is more likely to permanently look away from the eye and look at the rear display unit 109. If the control unit 101 determines that an operation instruction has not been received from the operation unit 104, the process proceeds to step S529.

[0087] In step S529, the control unit 101 determines, using the timer started in step S527, whether a predetermined time (e.g., 3 seconds) has elapsed in step S511 with the display destination maintained on the eyepiece display unit 110. If the control unit 101 determines in step S511 that the predetermined time has not elapsed with the display destination maintained on the eyepiece display unit 110, the control unit 101 returns the process to step S511, and continues the state in which the display destination is maintained on the eyepiece display unit 110. If the control unit 101 determines in step S511 that the predetermined time has elapsed with the display destination maintained on the eyepiece display unit 110, the control unit 101 returns the process to step S502, determines that the display destination is permanent, and stops the system timer in step S527. In step S502, the control unit 101 again determines whether or not the eye-away state has been detected by the eyepiece detection unit 111, and if it determines that the eye-away state has been detected, the process proceeds to step S503, where the display destination is switched from the eyepiece display unit 110 to the rear display unit 109. The reason for this control is that if the eye-away state is not detected for a predetermined period of time while the display destination is maintained on the eyepiece display unit 110, it is highly likely that the photographer is looking at the rear display unit 109 or has stopped shooting, so the display destination is immediately switched to the rear display unit 109.

[0088] As described above, according to the second embodiment, by switching the display destination based on information such as the operating status of the imaging device 100, the operating status of the operation unit 104, the time elapsed since the eye movement was detected, and the state of attachment of accessories, it is possible to set the display destination in accordance with the photographer's intentions for shooting.

[0089] [Embodiment 3] Next, a control process for switching the display destination in the third embodiment will be described with reference to FIGS.

[0090] In the third embodiment, the detection information of the orientation detection unit 112 is not used, but rather the detection information of the multiple sensors of the eye contact detection unit 111 is used to determine whether the eye is moving away temporarily or permanently.

[0091] The configuration of the imaging device of the third embodiment is the same as that of the first embodiment shown in FIG. 1, but the orientation detection unit 112 may not be provided.

[0092] In the third embodiment, the eye contact detection unit 111 detects the movement of the photographer's face in the directions of the X and Y axes defined in Fig. 3. Fig. 6 illustrates the configuration of the eye contact detection unit 111 in the third embodiment.

[0093] 6(a) illustrates an example of an eyepiece where the eyepiece display unit 110 of the imaging device 100 is arranged. The eyepiece detection unit 111 includes a proximity sensor 602 arranged adjacent to an optical window 601 of the eyepiece display unit 110. The proximity sensor 602 is an infrared sensor that detects the approach of an object to the eyepiece display unit 110 based on the amount of infrared light received by the proximity sensor 602 after infrared light emitted from a light projecting unit 603 is reflected off an object (for example, the face of the photographer) and enters a light receiving unit 605.

[0094] The eye proximity detection unit 111 of the third embodiment is configured such that the light receiving unit 605 of the proximity sensor 602 is divided into a plurality of regions (A to D) as shown in FIG. 6(a).

[0095] The proximity sensor 602 may acquire information at predetermined intervals (for example, several tens of ms to 100 ms) under the control of the control unit 101, or may acquire the output value of the proximity sensor 602 when an interrupt from the proximity sensor 602 is detected.

[0096] In addition to the configuration shown in Fig. 6(a), the eyepiece detection unit 111 may have proximity sensors 602 arranged above, below, and to the left and right of the optical window 601 of the eyepiece display unit 110, as shown in Fig. 6(b), and determine whether the eye movement is temporary or permanent based on the output values ​​of the multiple proximity sensors 602. Note that the example in Fig. 6(b) uses a proximity sensor 602 whose light receiving unit 605 is configured as a single area.

[0097] FIG. 7 illustrates the relationship between the movement of the photographer's face and the output value of the proximity sensor 602 in FIG. 6(a).

[0098] 7, the directions relative to the imaging device 100 will be explained using the XYZ axes defined in FIG.

[0099] FIG. 7(a) illustrates an example of a persistent eye-away action (for example, when photographing is interrupted) and an output value of the proximity sensor 602.

[0100] FIG. 7B illustrates an example of a temporary eye-away movement in which the photographer's face moves in the X-axis and Y-axis directions defined in FIG. 3 relative to the image capturing apparatus 100, and the output value of the proximity sensor 602.

[0101] 7(a) and 7(b), the vertical axis represents the output value of proximity sensor 602, and the horizontal axis represents time. Furthermore, solid lines 704 to 707 and 714 to 717 in the graphs of Figures 7(a) and 7(b) illustrate the temporal changes in the output values ​​corresponding to regions A to D that constitute light receiving unit 605 of proximity sensor 602 shown in Figure 6(a). In the example of Figure 7, solid lines 704 and 714 represent the output value of region A, solid lines 705 and 715 represent the output value of region B, solid lines 706 and 716 represent the output value of region C, and solid lines 707 and 717 represent the output value of region D.

[0102] An example of persistent eye-away movement is the movement of the photographer's face moving away along the Z axis defined in FIG. 3, as shown in states 701 to 703 in FIG. 7(a).

[0103] In this case, the temporal change in the output values ​​corresponding to each area (A to D) constituting the light receiving section 605 of the proximity sensor 602 is as shown by the solid lines 704 to 707 in the graph of Figure 7(a), and the difference in output values ​​between the four areas constituting the light receiving section 605 is small.

[0104] On the other hand, an example of a temporary eye-away action is an action in which the photographer's face moves in the X-axis and Y-axis directions defined in FIG. 3 relative to the imaging device 100, as shown in states 711 to 713 in FIG. 7(b).

[0105] In states 711 to 713 in FIG. 7(b), the upper row shows the state as seen from the side of the photographer, and the lower row shows the state as seen from behind the photographer.

[0106] When the photographer looks at the subject, as in state 711 in Figure 7(b), the photographer's face moves from looking into the eyepiece display unit 110 to state 713, which is toward the upper right of the eyepiece display unit 110.

[0107] State 721 shows the state in which infrared light from the light-emitting portion 603 of the proximity sensor 602 reflected by the photographer's face is incident on each area (A to D) of the light-receiving portion 605, and the shade indicates the light intensity, with the incident light being strong in area B, which is closest to the photographer's face, and weak in area C, which is farthest from the photographer's face.

[0108] The temporal change in the output values ​​of each area (A to D) constituting the light receiving section 605 of the proximity sensor 602 from state 711 to state 713 is shown by solid lines 714 to 717 in Figure 7(a), and the difference in output values ​​between the four areas constituting the light receiving section 605 is large.

[0109] In the third embodiment, as shown in FIGS. 6 and 7, it is determined whether the eye position is permanent or temporary based on the difference between a plurality of pieces of detection information from the eye proximity detection unit 111.

[0110] FIG. 8 is a flowchart illustrating a control process for switching the display destination according to the third embodiment.

[0111] The processing in FIG. 8 is realized by the control unit 101 loading a program stored in the nonvolatile memory 106 into the system memory 108, executing the program, and controlling each component of the imaging device 100.

[0112] In the third embodiment, as shown in FIG. 6(a), an example will be described in which the eye proximity detection unit 111 includes a proximity sensor 602 having a light receiving unit 605 divided into multiple regions.

[0113] The process in FIG. 8 starts when the power supply of the imaging device 100 is turned on and the image capturing device 100 is in an eyepiece state in which the display destination is set to the eyepiece display unit 110 (step S801).

[0114] In step S802, the control unit 101 acquires output values ​​from a plurality of regions that constitute the light receiving unit 605 of the proximity sensor 602, as shown in FIG. 6(a).

[0115] In step S803, the control unit 101 determines whether at least one output value from the multiple regions constituting the light receiving unit 605 of the proximity sensor 602, acquired in step S802, is below a predetermined threshold for determining an eye-away state. If the control unit 101 determines that the output value from any region of the light receiving unit 605 is below the predetermined threshold, the control unit 101 proceeds to step S804. If the control unit 101 determines that none of the output values ​​from any region of the light receiving unit 605 is below the predetermined threshold, the control unit 101 returns to step S802 and acquires the output value of the proximity sensor 602 again after a predetermined time has elapsed.

[0116] In step S804, the control unit 101 detects the difference in output values ​​between the areas of the light receiving unit 605 acquired in step S802. For example, among the output values ​​from the four areas of the light receiving unit 605 that make up the proximity sensor 602, the control unit 101 calculates the difference between the maximum and minimum values ​​using the following formula 1, and determines whether the calculated value is equal to or greater than a predetermined value. (Formula 1) I_DIFF=MAX(I_A,I_B,I_C,I_D)-MIN(I_A,I_B,I_C,I_D) I_A, I_B, I_C, and I_D indicate output values ​​from the four regions of the light receiving section 605, and IDIFF indicates the difference between the maximum and minimum values ​​of the outputs from the four regions.

[0117] As shown in FIG. 7(a), the further the photographer's face is from the eyepiece display unit 110 in the X-axis and Y-axis directions, the greater the difference between the output values ​​of the four regions of the light receiving unit 605 that make up the proximity sensor 602.

[0118] Therefore, in step S804, if the difference in output values ​​from the four areas of the light receiving unit 605 is greater than or equal to a predetermined value, the control unit 101 determines that the eye has been temporarily moved away, proceeds to step S807, and maintains the display destination on the eyepiece display unit 110.

[0119] On the other hand, if the difference between the output values ​​from the four regions of the light receiving unit 605 is less than a predetermined value, the control unit 101 determines that the photographer's face is permanently away from the eyepiece display unit 110 along the Z-axis direction in Figure 3, and proceeds to step S805, switching the display destination to the rear display unit 109.

[0120] In step S806, the control unit 101 performs eyepiece detection processing to determine whether the photographer has placed his or her eye close to the eyepiece display unit 110.

[0121] In steps S803 and S804, it is detected that the photographer's face is moving in the X-axis and Y-axis directions in Figure 3, but the subsequent movement of the photographer's face may be a temporary or permanent eye averting.

[0122] In the case of a permanent eye-away, leaving the eyepiece display unit 110 in a display state may affect the photographer's next operation. For this reason, in steps S808 to S811, it is determined again whether the eye-away is temporary or permanent, and control is performed to switch the display to the most suitable one for the photographer.

[0123] The control unit 101 starts the system timer in step S808, and acquires output values ​​from the four regions of the light receiving unit 605 that constitutes the proximity sensor 602 again in step S809.

[0124] In step S810, the control unit 101 calculates the difference between the maximum and minimum values ​​from the output values ​​from the four regions of the light receiving unit 605 that constitute the proximity sensor 602 acquired in step S809, and determines whether the calculated value is equal to or greater than a predetermined threshold value. The calculation formula and threshold value may be the same as or different from those in step S804.

[0125] In step S810, if the difference in output values ​​from the four areas of the light receiving unit 605 is greater than or equal to a predetermined value, the control unit 101 determines that the eye has temporarily moved away from the eye, returns the process to step S807, and maintains the display destination on the eyepiece display unit 110.

[0126] On the other hand, if the difference between the output values ​​from the four areas of the light receiving unit 605 is less than a predetermined value, the control unit 101 determines that the photographer's face is permanently away from the eyepiece display unit 110 along the Z-axis direction in Figure 3, and proceeds to step S811.

[0127] In step S811, the control unit 101 determines whether all of the output values ​​from the four regions of the light receiving unit 605 acquired in step S809 are below the threshold value and whether the system timer in step S808 has counted a predetermined time (for example, 2 to 3 seconds). If the control unit 101 determines that all of the output values ​​from the four regions of the light receiving unit 605 acquired in step S809 are below the threshold value and the system timer in step S808 has counted a predetermined time, the control unit 101 proceeds to step S812. If the control unit 101 determines that any of the output values ​​from the four regions of the light receiving unit 605 acquired in step S809 are not below the threshold value or that the system timer in step S808 has not counted a predetermined time, the control unit 101 returns to step S807 and maintains the display destination on the eyepiece display unit 110.

[0128] In step S812, the control unit 101 switches the display destination to the rear display unit 109.

[0129] In step S813, the control unit 101 performs eyepiece detection processing to determine whether the photographer has placed his or her eye close to the eyepiece display unit 110.

[0130] As described above, according to the third embodiment, the relative movement of the imaging device 100 with respect to the photographer, for example, the direction in which the photographer's face has moved relative to the imaging device 100, is detected based on the output values ​​of the multiple light receiving elements 605 of the proximity sensor 602, and by determining whether the photographer has looked away temporarily or permanently, the display destination can be switched in accordance with the photographer's intention.

[0131] The configuration of the eyepiece detection unit 111 in embodiment 3 is not limited to the example shown in Figure 6(a), and may also be configured as shown in Figure 6(b), in which multiple proximity sensors 602 are arranged around the optical window 601 of the eyepiece display unit 110.

[0132] Furthermore, in the third embodiment, an infrared proximity sensor 602 is exemplified, but similar processing can be performed when various types of sensors, such as a capacitance type, are used.

[0133] [Embodiment 4] Next, a control process for switching the display destination according to the fourth embodiment will be described with reference to FIGS.

[0134] In the fourth embodiment, the detection information from the orientation detection unit 112 is not used, but rather the detection information from the eye contact detection unit 111, which is equipped with an image sensor type sensor unit, is used to determine whether the eye is moving away temporarily or permanently.

[0135] The configuration of the imaging device of the fourth embodiment is the same as that of the first embodiment shown in FIG. 1, but the orientation detection unit 112 may not be provided.

[0136] FIG. 9 illustrates the configuration of the eye proximity detection unit 111 according to the fourth embodiment.

[0137] 9, the directions relative to the imaging device 100 will be explained using the XYZ axes defined in FIG.

[0138] 9(a), the eyepiece detection unit 111 of the fourth embodiment is an image sensor 901 arranged adjacent to the eyepiece display unit 110. The image sensor 901 of the fourth embodiment has a function of detecting whether a human body or a human face is included in a captured image. If a human body or a face is included in the captured image, the image sensor 901 of the fourth embodiment also has a function of measuring the size of the detected subject and analyzing the direction in which the human body or face moved by recognizing the pattern of the detected subject.

[0139] Images 912 to 914 in Figure 9(b) are examples of images captured by the image sensor 901 in the eye-away state 902 and the eye-closed state 904. In the eye-away state 902, a human body and face are detected, but at a small size, as in image 912. In the eye-closed state 904, a close-up of a face is detected, as in image 914.

[0140] Images 932 to 934 in Figure 9(c) are examples of images captured by the image sensor 901 when the photographer temporarily moves his or her eyes away from the camera. In the eyepiece state 922, a close-up of the face is detected, as in image 932. As the photographer gradually moves his or her eyes away in the X-axis and Y-axis directions in Figure 3 (state 923), the image captured by the image sensor 901 changes to image 933, in which the position of the face moves to the left of the captured screen and the proportion of the area occupied by the face in the captured screen decreases. As the photographer further moves his or her eyes away from the eyepiece display unit 110 (state 924), the image captured by the image sensor 901 changes to image 934.

[0141] Here, the size of the face on the captured image can be a trigger for determining whether the eyes have been averted, but the area ratio of the face on the captured image may be similar in image 912 of a permanently averted eye state and image 934 of a temporarily averted eye state, and this alone cannot distinguish between the two.

[0142] Therefore, facial features are detected, changes between image frames are analyzed, and information such as the direction in which the face is moving is used to determine whether the eye deviation is temporary or permanent.

[0143] The image sensor 901 may be disposed inside the eyepiece display unit 110.

[0144] FIG. 10 is a flowchart illustrating a control process for switching the display destination according to the fourth embodiment.

[0145] The processing in FIG. 10 is realized by the control unit 101 loading a program stored in the nonvolatile memory 106 into the system memory 108, executing the program, and controlling each component of the imaging device 100.

[0146] The process of FIG. 10 starts when the power supply of the imaging device 100 is turned on and the image capturing device 100 is in an eyepiece state in which the display destination is set to the eyepiece display unit 110 (step 1001).

[0147] In step S1002, the control unit 101 acquires detection information from the image sensor 901, which is the eye proximity detection unit 111 (for example, the presence or absence of a human body or face, the size of the face, etc.).

[0148] As shown in a state 924 in FIG. 9(c), the size of the human body and face detected by the image sensor 901 becomes smaller as the photographer moves in the X-axis and Y-axis directions in FIG.

[0149] If a human body or face is detected in step S1003, the control unit 101 compares the size information of the photographer's human body or face acquired from the image sensor 901 with a first preset threshold value related to size. If the size of the detected face exceeds the threshold value, it determines that the eyepiece state is continuing, and returns to step S1002 while maintaining the display destination on the eyepiece display unit 110.

[0150] If the size information of the photographer's body or face acquired from the image sensor 901 is below the first threshold, the control unit 101 determines that there is a possibility of eye movement, proceeds to step S1004, and compares the information on the movement direction and movement amount of the detected body or face with a second threshold value related to the movement direction and movement amount that has been set in advance.

[0151] As shown in images 912 and 934 in Figure 9, the size information of the detected human body or face may not be enough to distinguish between permanent and temporary eye aberrations. Therefore, facial features are detected and changes between image frames are analyzed to identify in which direction and how far the detected photographer's face has moved, and this information is used for judgment.

[0152] The presence or absence of movement is determined by dividing the sensor surface of the image sensor into 10 regions vertically and horizontally, and determining whether the extracted feature points of the photographer's face have moved to an adjacent region. This distinguishes between cases where the photographer looks away from the eyepiece display unit 110 to check the subject, which is the detection target of the fourth embodiment, and cases where the photographer's face moves slightly, which may occur during shooting and should not be detected.

[0153] In step S1004, if the amount of movement of the detected human body or face in the X-axis and Y-axis directions is less than the second threshold, the control unit 101 determines that the eye movement is permanent, and in step S1005, switches the display destination to the rear display unit 109.

[0154] In step S1006, the control unit 101 performs eyepiece detection processing to determine whether the photographer has placed his or her eye close to the eyepiece display unit 110.

[0155] If the amount of movement of the human body or face in the X-axis and Y-axis directions is equal to or greater than the threshold in step S1004, the process proceeds to step S1007, where the control unit 101 maintains the eyepiece display unit 110 as the display destination.

[0156] As explained in the third embodiment, even if it is detected that the photographer's face is moving in the X-axis and Y-axis directions, there are cases where the photographer's eyes are moving temporarily and cases where the eyes are moving permanently.

[0157] In the case of a permanent eye-away, leaving the eyepiece display unit 110 in a display state may affect the photographer's next operation. For this reason, in steps S1008 to S1011, it is determined again whether the eye-away is temporary or permanent, and control is performed to switch the display to the most suitable one for the photographer.

[0158] The control unit 101 starts the system timer in step S1008, and again acquires from the image sensor 901 the latest information regarding the detection results of the human body or face and the moving direction of the detected object in step S1009.

[0159] In step S1010, the control unit 101 determines whether the size of the human body or face acquired in step S1009 is equal to or greater than a first threshold. If the control unit 101 determines that the size of the human body or face acquired in step S1009 is equal to or greater than the first threshold, it determines that the eye distance is temporary, and returns the process to step S1009. If the control unit 101 determines that the size of the human body or face acquired in step S1009 is less than the first threshold, it determines that the eye distance is likely to be permanent, and proceeds to step S1011.

[0160] In step S1011, the control unit 101 determines whether the size of the human body or face acquired in step S1009 is less than the first threshold and whether the predetermined time has elapsed in the system timer of step S1008. If the control unit 101 determines that the size of the human body or face acquired in step S1009 is less than the first threshold and that the predetermined time has elapsed in the system timer of step S1008, it determines that the eye movement is permanent, and switches the display destination to the rear display unit 109 in step S1012.

[0161] In step S1013, the control unit 101 performs eyepiece detection processing to determine whether the photographer has placed his or her eye close to the eyepiece display unit 110.

[0162] If the control unit 101 determines that the size of the human body or face acquired in step S1009 is equal to or larger than the first threshold value, or that the system timer in step S1008 has not yet determined that the predetermined time has elapsed, the control unit 101 returns the process to step S1009, determines that the photographer may look at the eyepiece display unit 110 immediately after temporarily looking away from the subject, and maintains the display destination on the eyepiece display unit 110.

[0163] As described above, according to the fourth embodiment, the direction in which the photographer's face has moved relative to the imaging device 100 is detected based on the detection information of the image sensor 901, and it is determined whether the eye movement is temporary or permanent, thereby making it possible to switch the display destination in accordance with the photographer's intention.

[0164] [Other embodiments] The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0165] The invention is not limited to the above-described embodiments, and various changes and modifications can be made without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention.

[0166] The disclosure of this specification includes the following imaging device, control method, and program. [Configuration 1] a first display unit that can be viewed by a user looking into it; a second display unit that can be viewed by a user without looking into it; an eye proximity detection means for detecting whether the first display unit is in eye proximity or not; an attitude detection means for detecting an attitude change of the imaging device; a control unit that controls switching of the display destination between the first display unit and the second display unit in accordance with a detection result by the eye proximity detection unit, The control means detects the eye-closed state by the eye-close detection means and switches the display destination to the first display unit, and then, when the eye-away state is detected, detects the relative movement of the imaging device with respect to the user based on the detection information of the posture detection means and determines whether the eye-away state is temporary, and if it determines that the eye-away state is temporary, controls the display destination not to be switched to the second display unit. [Configuration 2] The image capturing device described in configuration 1 is characterized in that, when the eye-closed state is detected by the eye-closed state detection means and the display destination is switched to the first display unit, and then the eye-away state is detected, if the control means determines that the eye-away state is not a temporary state based on the relative movement of the image capturing device with respect to the user based on the detection information of the posture detection means, it controls the display destination to be switched to the second display unit. [Configuration 3] The imaging device according to configuration 1 or 2, wherein the attitude detection means detects vertical movement of the imaging device, horizontal movement of the imaging device, rotation around the vertical direction, rotation around the horizontal direction, a first attitude in which the imaging device is in a horizontal state, and a second attitude in which the imaging device is in a vertical state. [Configuration 4] The image capturing device described in configuration 3 is characterized in that the control means controls the display not to be switched to the second display unit when, after the eye-away state is detected by the eye-closeness detection means, rotation about the horizontal direction is not detected when the image capturing device is in the first attitude and downward movement in the vertical direction is detected. [Configuration 5] The image capturing device described in configuration 3 is characterized in that the control means controls the display not to be switched to the second display unit when, after the eye-away state is detected by the eye-closeness detection means, rotation about the vertical direction is not detected when the image capturing device is in the second attitude and downward movement in the horizontal direction is detected. [Configuration 6] The image capturing device described in configuration 3 is characterized in that, when the eye-away state is detected by the eye-closeness detection means, rotation about the horizontal direction of the image capturing device is not detected in the first attitude, and downward movement in the vertical direction is detected, the control means controls the image capturing device so that the display destination is not switched to the second display unit until a predetermined time has elapsed without a predetermined operation being performed on the image capturing device. [Configuration 7] the control means controls the display destination based on the detection result of the eyepiece detection means when the captured image is being displayed; 7. The imaging device according to configuration 6, wherein control is performed so that the display destination is not switched to the second display unit when a captured image is not being displayed. [Configuration 8] the control means controls the display destination based on the detection result of the eyepiece detection means when the menu screen is being displayed; 7. The imaging device according to configuration 6, wherein the display destination is controlled not to be switched to the second display unit when a menu screen is not being displayed. [Configuration 9] The imaging device according to configuration 6, wherein the control means sets thresholds for rotation and movement of the imaging device to control switching of the display destination when an accessory is attached to the imaging device. [Configuration 10] The imaging device described in configuration 9 is characterized in that, when the accessory attached to the imaging device is a lens unit and the focal length of the lens unit is equal to or greater than a predetermined value, the control means controls switching of the display destination based on detection information from the eyepiece detection means and the attitude detection means, and when the focal length is less than the predetermined value, the control means controls switching of the display destination based on detection information from the eyepiece detection means. [Configuration 11] a first display unit that can be viewed by a user looking into it; a second display unit that can be viewed by a user without looking into it; an eye proximity detection means for detecting whether the first display unit is in eye proximity or not; a control unit that controls switching of the display destination between the first display unit and the second display unit in accordance with a detection result by the eye proximity detection unit, the eye proximity detection means has a sensor unit disposed adjacent to the first display unit, The control means detects the relative movement of the imaging device with respect to the user based on the detection information of the sensor unit in the eye-closed state in which the display destination is set to the first display unit, and determines whether the state is temporary eye-away. If it determines that the state is temporary eye-away, the control means controls the imaging device so that the display destination is not switched to the second display unit. [Configuration 12] 12. The imaging device according to claim 11, wherein the control means controls the display destination to be switched to the second display unit when it is determined that the temporary eye-away state is not present. [Configuration 13] the eye proximity detection means includes a plurality of sensor units disposed adjacent to the first display unit, The imaging device described in configuration 11 or 12, characterized in that the control means controls so that the display destination is not switched to the second display unit when any of the detection information of the plurality of sensor units is below a threshold value and the difference between the detection information of the plurality of sensor units is equal to or greater than a predetermined value. [Configuration 14] The imaging device described in configuration 13, characterized in that the control means controls the display destination to be switched to the second display unit when any of the detection information of the plurality of sensor units falls below a threshold value and the difference between the detection information of the plurality of sensor units is less than a predetermined value. [Configuration 15] The imaging device described in configuration 13 or 14, characterized in that the control means controls the display to be switched to the second display unit when, while the display destination is maintained on the first display unit, the difference in detection information of the multiple sensor units becomes less than a predetermined value, the detection information of all of the multiple sensor units falls below a threshold, and a predetermined time has elapsed. [Configuration 16] the sensor unit has an image sensor, The imaging device described in configuration 11 or 12, characterized in that the control means controls so that the display destination is not switched to the second display unit when the size of the subject detected by the image sensor is less than a first threshold and the amount of movement of the subject detected by the image sensor in the imaging screen is equal to or greater than a second threshold. [Configuration 17] The imaging device described in configuration 16, characterized in that the control means controls the display destination to be switched to the second display unit when the size of the subject detected by the image sensor is less than a first threshold and the amount of movement of the subject detected by the image sensor in the imaging screen is less than a second threshold. [Configuration 18] The imaging device described in configuration 16 or 17, characterized in that the control means controls the display to be switched to the second display unit when the size of the subject detected by the image sensor is less than a first threshold and a predetermined time has elapsed while the display is maintained on the first display unit. [Configuration 19] The imaging device according to configuration 17 or 18, wherein the control means switches the display destination to the second display unit, and then controls the switching of the display destination based on detection information from the eyepiece detection means. [Configuration 20] A control method for an imaging device, comprising: The imaging device is a first display unit that can be viewed by a user looking into it; a second display unit that can be viewed by a user without looking into it; an eye proximity detection means for detecting whether the first display unit is in eye proximity or not; and an attitude detection unit that detects an attitude change of the imaging device, The control method includes: a control step of controlling switching of a display destination between the first display unit and the second display unit in accordance with a detection result by the eye proximity detection means, In the control step, after the eye-closed state is detected by the eye-closed state detection means and the display destination is switched to the first display unit, if the eye-away state is detected, the relative movement of the imaging device with respect to the user is detected based on the detection information of the posture detection means to determine whether the eye-away state is temporary, and if it is determined that the eye-away state is temporary, the control method is characterized in that it controls so that the display destination is not switched to the second display unit. [Configuration 21] A control method for an imaging device, comprising: The imaging device is a first display unit that can be viewed by a user looking into it; a second display unit that can be viewed by a user without looking into it; an eye-closeness detection means for detecting whether the first display unit is in eye-close or eye-away state, the eye proximity detection means has a sensor unit disposed adjacent to the first display unit, The control method includes: a control step of controlling switching of a display destination between the first display unit and the second display unit in accordance with a detection result by the eye proximity detection means, In the control step, in the eye-closed state in which the display destination is set to the first display unit, the relative movement of the imaging device with respect to the user is detected based on the detection information of the sensor unit to determine whether the state is temporary eye-away, and if it is determined that the state is temporary eye-away, the control method is characterized in that it controls so that the display destination is not switched to the second display unit. [Configuration 22] 20. A program for causing a computer to function as the imaging device according to any one of claims 1 to 19. [Explanation of symbols]

[0167] 100: Imaging device, 101: Control unit, 109: Rear display unit, 110: Eyepiece display unit, 111: Eyepiece detection unit, 112: Orientation detection unit

Claims

1. a first display unit that can be viewed by a user looking into it; a second display unit that can be viewed by a user without looking into it; an eye-contact detection means for detecting whether the first display unit is in eye-contact with the eye or not; an attitude detection means for detecting an attitude change of the imaging device; a control unit that controls switching of the display destination between the first display unit and the second display unit in accordance with a detection result by the eye proximity detection unit, The control means detects an eye-closed state by the eye-close detection means and switches the display destination to the first display unit, and then, when the eye-away state is detected, detects the relative movement of the imaging device with respect to the user based on the detection information of the posture detection means and determines whether the eye-away state is temporary, and if it determines that the eye-away state is temporary, controls the display destination not to be switched to the second display unit.

2. The image capturing device of claim 1, characterized in that, when the eye-away state is detected after the eye-close state is detected by the eye-close detection means and the display destination is switched to the first display unit, the control means controls the display destination to be switched to the second display unit if the eye-away state is detected and, based on the detection information of the posture detection means, the relative movement of the image capturing device with respect to the user is determined to be not a temporary eye-away state.

3. 3. The imaging device according to claim 2, wherein the attitude detection means detects vertical movement of the imaging device, horizontal movement of the imaging device, rotation about the vertical direction, rotation about the horizontal direction, a first attitude in which the imaging device is in a horizontal state, and a second attitude in which the imaging device is in a vertical state.

4. The imaging device according to claim 3, characterized in that the control means controls the display not to be switched to the second display unit when, after the eye-away state is detected by the eye-near detection means, rotation about the horizontal direction is not detected when the imaging device is in the first attitude and downward movement in the vertical direction is detected.

5. The imaging device according to claim 3, characterized in that the control means controls the display not to be switched to the second display unit when, after the eye-away state is detected by the eye-near detection means, rotation about the vertical direction is not detected when the imaging device is in the second attitude and downward movement in the horizontal direction is detected.

6. The imaging device according to claim 3, characterized in that, when the eye-away state is detected by the eye-near detection means, no rotation about the horizontal direction is detected when the imaging device is in the first attitude, and downward movement in the vertical direction is detected, the control means controls the display not to be switched to the second display unit until a predetermined time has elapsed without a predetermined operation being performed on the imaging device.

7. the control means controls the display destination based on the detection result of the eyepiece detection means when the captured image is being displayed; 7. The imaging device according to claim 6, wherein control is performed so that the display destination is not switched to the second display unit when a captured image is not being displayed.

8. the control means controls the display destination based on the detection result of the eyepiece detection means when the menu screen is being displayed; 7. The imaging device according to claim 6, wherein the display destination is controlled not to be switched to the second display unit when a menu screen is not being displayed.

9. The imaging device according to claim 6, characterized in that the control means sets thresholds for rotation and movement of the imaging device to control switching of the display destination when an accessory is attached to the imaging device.

10. The imaging device described in claim 9, characterized in that when the accessory attached to the imaging device is a lens unit and the focal length of the lens unit is equal to or greater than a predetermined value, the control means controls switching of the display destination based on detection information from the eyepiece detection means and the attitude detection means, and when the focal length is less than the predetermined value, controls switching of the display destination based on detection information from the eyepiece detection means.

11. a first display unit that can be viewed by a user looking into it; a second display unit that can be viewed by a user without looking into it; an eye-contact detection means for detecting whether the first display unit is in eye-contact with the eye or not; a control unit that controls switching of the display destination between the first display unit and the second display unit in accordance with a detection result by the eye proximity detection unit, the eye proximity detection means has a sensor unit disposed adjacent to the first display unit, The control means detects the relative movement of the imaging device with respect to the user based on the detection information of the sensor unit in the eye-closed state in which the display destination is set to the first display unit, and determines whether the state is temporary eye-away.If it determines that the state is temporary eye-away, the control means controls the imaging device so that the display destination is not switched to the second display unit.

12. 12. The imaging device according to claim 11, wherein the control means controls the display destination to be switched to the second display unit when it is determined that the temporary eye-away state is not present.

13. the eye proximity detection means includes a plurality of sensor units disposed adjacent to the first display unit, The imaging device according to claim 12, characterized in that the control means controls so that the display destination is not switched to the second display unit when any of the detection information of the plurality of sensor units is below a threshold value and a difference between the detection information of the plurality of sensor units is equal to or greater than a predetermined value.

14. The imaging device according to claim 13, characterized in that the control means controls the display to be switched to the second display unit when any of the detection information of the plurality of sensor units falls below a threshold value and a difference between the detection information of the plurality of sensor units is less than a predetermined value.

15. The imaging device described in claim 13, characterized in that the control means controls the display to be switched to the second display unit when, while the display unit is maintained as the first display unit, the difference in detection information of the multiple sensor units becomes less than a predetermined value, the detection information of all of the multiple sensor units falls below a threshold, and a predetermined time has elapsed.

16. the sensor unit has an image sensor, The imaging device described in claim 12, characterized in that the control means controls so that the display destination is not switched to the second display unit when the size of the subject detected by the image sensor is less than a first threshold and the amount of movement of the subject detected by the image sensor in the imaging screen is equal to or greater than a second threshold.

17. The imaging device according to claim 16, characterized in that the control means controls the display destination to be switched to the second display unit when the size of the subject detected by the image sensor is less than a first threshold and the amount of movement of the subject detected by the image sensor in the imaging screen is less than a second threshold.

18. The imaging device according to claim 16, characterized in that the control means controls the display to be switched to the second display unit when, while the display unit is maintained on the first display unit, the size of the subject detected by the image sensor is less than a first threshold and a predetermined time has elapsed.

19. 18. The imaging device according to claim 17, wherein the control means performs control to switch the display destination based on detection information from the eye proximity detection means after switching the display destination to the second display unit.

20. A control method for an imaging device, comprising: The imaging device is a first display unit that can be viewed by a user looking into it; a second display unit that can be viewed by a user without looking into it; an eye-contact detection means for detecting whether the first display unit is in eye-contact with the eye or not; and an attitude detection unit that detects an attitude change of the imaging device, The control method includes: a control step of controlling switching of a display destination between the first display unit and the second display unit in accordance with a detection result by the eye proximity detection means, In the control step, after the eye-closed state is detected by the eye-closed state detection means and the display destination is switched to the first display unit, if the eye-away state is detected, the relative movement of the imaging device with respect to the user is detected based on the detection information of the posture detection means to determine whether the eye-away state is temporary, and if it is determined that the eye-away state is temporary, the control method is characterized in that it controls so that the display destination is not switched to the second display unit.

21. A control method for an imaging device, comprising: The imaging device is a first display unit that can be viewed by a user looking into it; a second display unit that can be viewed by a user without looking into it; an eye-contact detection unit that detects whether the first display unit is in eye contact with the eye or not, the eye proximity detection means has a sensor unit disposed adjacent to the first display unit, The control method includes: a control step of controlling switching of a display destination between the first display unit and the second display unit in accordance with a detection result by the eye proximity detection means, In the control step, in the eye-closed state in which the display destination is set to the first display unit, the relative movement of the imaging device with respect to the user is detected based on the detection information of the sensor unit to determine whether the state is temporary eye-away, and if it is determined that the state is temporary eye-away, the control method is characterized in that it controls so that the display destination is not switched to the second display unit.

22. A program for causing a computer to function as the imaging device according to any one of claims 1 to 19.

Images