Imaging device, control method thereof, and recording medium

Abstract

To provide an imaging apparatus that can set a position for enlarging and displaying from an entire image area and visually present to a user whether or not the execution of AF at the set position is possible.SOLUTION: A system control section 218 of an imaging apparatus 100 includes an imaging element having pixels that photoelectrically convert incident light from a subject, which has passed through different regions of an exit pupil of an imaging optical system, to generate a plurality of imaging signals. The system control section sets a focus adjustment region used in focus adjustment with respect to an imaging region, detects a defocus amount of the imaging optical system on the basis of the plurality of imaging signals obtained from the focus adjustment region, determines whether or not the focus adjustment in the focus adjustment region is possible on the basis of the defocus amount, switches display of a live view image on a display section 108 between same magnification display, which displays an entire imaging region, and enlargement display, which enlarges and displays the focus adjustment region, and varies a display method of the focus adjustment region between the same magnification display and the enlargement display in accordance with a determination result of whether or not the focus adjustment is possible at that time.SELECTED DRAWING: Figure 8

Description

[Technical field]

[0001] The present invention relates to an imaging apparatus and a control method and program thereof, and more particularly to a technique for controlling image display during imaging. [Background technology]

[0002] There is an imaging device that includes an imaging element having an imaging surface phase difference detection function, and displays a region focused using an AF (autofocus) function with a frame or the like on an LV (live view) image displayed on a liquid crystal display device, etc. There is also an imaging device that uses the AF function to focus on a subject at a touched position when a user performs a touch operation on a display screen such as a liquid crystal display device on which the LV image is displayed.

[0003] In such an imaging device, a technique is known that displays which part of the entire imaging area is the enlarged display area when the LV image is switched from the normal size display to the enlarged display so that the user can confirm whether the desired position or area is focused on. For example, Patent Document 1 proposes a technique for enlarging and displaying the AF area focused by AF and its vicinity by MF (Manual Focus) operation. Patent Document 2 also proposes a technique for setting the AF area and the enlarged display area separately. Specifically, Patent Document 2 proposes an imaging device that changes the position of the enlarged display area in conjunction with the position of the AF area when changing the position of the AF area, and changes the position of the enlarged display area without changing the position of the AF area when changing the position of the enlarged display area. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2010-141767 A [Patent Document 2] JP 2013-201527 A Summary of the Invention [Problem to be solved by the invention]

[0005] In the technology described in Patent Document 1, it is not possible to enlarge and display an image from an image area other than the vicinity of the AF focus area. In addition, since the image is enlarged and displayed from the vicinity of the AF focus area, it is not possible to enlarge and display an image from an image area where AF cannot be performed. In addition, in the technology described in Patent Document 2, when an instruction is given to change the position of the enlarged display area, the position of the AF area is not changed accordingly, so in order to perform AF from the position after the enlarged display area is changed, it is necessary to give an instruction to change the position of the AF area.

[0006] The present invention aims to provide an imaging device that can set a position for enlarged display from the entire image area and visually indicates to the user whether or not AF can be performed at the set position. [Means for solving the problem]

[0007] The imaging device of the present invention comprises an imaging element having pixels that photoelectrically convert incident light from a subject that has passed through different areas of an exit pupil of an imaging optical system to generate multiple imaging signals, a setting means for setting a focus adjustment area to be used for focus adjustment of the imaging optical system in an imaging area by the imaging element, a detection means for detecting a defocus amount of the imaging optical system based on the multiple imaging signals obtained from the focus adjustment area, a judgment means for judging whether focus adjustment is possible in the focus adjustment area based on the defocus amount, and a control means for switching the display of a live view image on a display device between a life-size display that displays an image of the entire imaging area and an enlarged display that displays an enlarged image of the focus adjustment area, and the control means is characterized in that it uses different display methods of the focus adjustment area between the life-size display and the enlarged display depending on the judgment result by the judgment means. Effect of the Invention

[0008] According to the present invention, it is possible to set a position for enlarged display from the entire image area, and to visually indicate to the user whether or not AF can be performed at the set position. [Brief description of the drawings]

[0009] [Figure 1] 1 is a perspective view showing an external configuration of an imaging device according to an embodiment. [Diagram 2] FIG. 1 is a block diagram of an imaging system in which a lens unit is attached to an imaging device. [Diagram 3] FIG. 2 is a diagram showing a schematic configuration of a twin lens unit. [Figure 4] 2 is a front view showing an example of a pixel array of an imaging element included in the imaging section; FIG. [Diagram 5] 4 is a flowchart of a live view shooting mode process executed by the imaging apparatus. [Figure 6] 13 is a flowchart of the LV magnification shooting mode process in S516. [Figure 7] 13A and 13B are diagrams showing an example of the display of the focus adjustment area and the enlarged display area when displaying the LV at normal magnification and enlarged magnification. [Figure 8] 13 is a flowchart of the display process of the focus adjustment area in S512 and S606. [Figure 9] 11A and 11B are diagrams illustrating a focus adjustment area and the relationship between its center position and a focus adjustable range. [Figure 10] 13 is a flowchart of the FG process executed in S515. [Figure 11] 1A to 1C are diagrams showing specific examples of first to fourth indicator display forms. [Figure 12] 13A and 13B are diagrams showing examples of displays S804 and S805 when a single lens is attached. [Figure 13] 13A and 13B are diagrams showing examples of displays S804 and S805 when a twin lens is attached. [Figure 14] 13A and 13B are diagrams showing examples of display in S804 and S805 in the case where the focus adjustment area has moved during subject detection in a state where a single lens is attached. [Figure 15] FIG. 13 is a diagram showing another example of display of S804 and S805 when a single lens is attached. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0011] Fig. 1 is a perspective view showing an external configuration of an imaging device 100 according to an embodiment. Fig. 1(a) is a view of the imaging device 100 as viewed obliquely from above on the front side, and Fig. 1(b) is a view of the imaging device 100 as viewed obliquely from above on the rear side. Here, a so-called mirrorless single-lens type digital camera is taken as the imaging device 100. In a mirrorless single-lens type digital camera, a lens unit (interchangeable lens) can be attached and detached to the camera body, but in the description of this embodiment, "imaging device 100" refers to the camera body and does not include the lens unit.

[0012] On the top surface of the imaging device 100, a shutter button 101, a power switch 102, a mode changeover switch 103, a main electronic dial 104, a sub electronic dial 105, a movie button 106, and an outside viewfinder display unit 107 are provided.

[0013] The shutter button 101 is an operation unit for preparing for shooting and issuing shooting instructions. The power switch 102 is an operation unit for switching the power of the imaging device 100 on / off. The mode changeover switch 103 is an operation unit for switching the operation mode of the imaging device 100 to one of a still image shooting mode, a video shooting mode, and a playback mode. The main electronic dial 104 is a rotary operation unit for changing settings such as shutter speed and aperture. The sub electronic dial 105 is a rotary operation unit for moving a selection frame (cursor) displayed on a display unit 108 arranged on the rear surface of the imaging device 100, forwarding images, etc. The video button 106 is an operation unit for issuing an instruction to start or stop video shooting (recording). The outside-finder display unit 107 is a liquid crystal display device (LCD) or the like, and displays various settings such as shutter speed and aperture.

[0014] A display unit 108, a touch panel 109, a direction key 110, a SET button 111, an AE (auto exposure) lock button 112, an AF frame selection / magnification button 113, a playback button 114, and a menu button 115 are provided on the rear surface of the imaging device 100. An eyepiece unit 116, an eyepiece detection unit 118, a touch bar 119, and a thumb rest unit 121 are provided on the rear surface of the imaging device 100. When viewed from the rear surface side, the imaging device 100 is provided with a grip unit 120 on the right side, a slot cover 123 on the right side, and a terminal cover 122 on the left side. Furthermore, a lens mount unit (camera side mount unit) 125 is provided on the front surface of the imaging device 100, and a communication terminal 124 is provided inside the lens mount unit 125.

[0015] Display unit 108 is an LCD, an organic EL device, or the like, and displays images and various information. Touch panel 109 is arranged in a superimposed manner on the display screen of display unit 108, and is an operation unit that detects a touch operation on the display screen of display unit 108. By associating input coordinates on touch panel 109 with coordinates on the display screen of an image displayed on display unit 108, a graphical user interface (GUI) is configured as if the user were directly operating the screen displayed on display unit 108. The touch detection method in touch panel 109 may be a known method, and is not limited to any particular method.

[0016] The directional keys 110 are an operation section consisting of keys that can be pressed up, down, left and right (four-way keys), and can move a cursor displayed on the display section 108 or advance images according to the direction of each key. The SET button 111 is an operation section that is pressed mainly to confirm a selection item. The AE lock button 112 is an operation section that is pressed to fix the exposure state in a shooting standby state.

[0017] The AF frame selection / enlargement button 113 is a shared operation unit that enables the selection operation of an AF frame that can be moved in LV (live view) display in shooting mode, and the switching operation of switching the enlargement mode on / off. When the enlargement mode is on, the LV image can be enlarged or reduced by operating the main electronic dial 104. The AF frame selection / enlargement button 113 is also used to enlarge the playback image and change the magnification ratio in playback mode.

[0018] The playback button 114 is an operation section for switching between the shooting mode and the playback mode. When the playback button 114 is pressed while the shooting mode is set, the mode is switched to the playback mode, and the most recently shot image among the images recorded in the storage medium 228 (see FIG. 2) is displayed on the display section 108. The menu button 115 is an operation section that is pressed when displaying a menu screen for performing various settings on the display section 108. The user can intuitively perform various settings using the menu screen displayed on the display section 108, the direction key 110, and the SET button 111.

[0019] The eyepiece 116 is a portion where the user places his / her eye on the peer-type eyepiece finder 117. The user can view an image displayed on an EVF (electronic viewfinder) 217 ​​(see FIG. 2) arranged inside the eyepiece 116 through the eyepiece 116. The eyepiece detection unit 118 is a sensor that detects whether the user places his / her eye on the eyepiece 116. The touch bar 119 is a line-shaped operation unit (line touch sensor) that can receive a touch operation. The touch bar 119 is arranged at a position where the user can perform a touch operation with the thumb of the right hand when the user holds the grip unit 120 in the right hand (with the little finger, ring finger, and middle finger) so that the user can press the shutter button 101 with the index finger of the right hand. Therefore, the user can operate the touch bar 119 in a state where the user can press the shutter button 101. The touch bar 119 can receive tap operations (operations of touching and then releasing the touched position within a predetermined time without moving it) and slide operations to the left and right (operations of touching and then moving the touched position while keeping the touched position), etc. The touch bar 119 is a multi-function bar that does not have a display function, and functions as, for example, an M-Fn bar.

[0020] The grip section 120 is a holding section formed in a shape that allows the user to easily hold the imaging device 100 with the right hand. The shutter button 101 and the main electronic dial 104 are disposed at positions that can be operated with the index finger of the right hand when the user holds the imaging device 100 by gripping the grip section 120 with the little finger, ring finger, and middle finger of the right hand. The sub electronic dial 105 and the touch bar 119 are disposed at positions that can be operated with the thumb of the right hand in the same state.

[0021] The terminal cover 122 protects a connector (not shown) for connecting the imaging device 100 to an external device. The slot lid 123 closes a slot (not shown) for storing a storage medium 228 (see FIG. 2) to protect the storage medium 228 and the slot. The lens mount section 125 is a portion for attaching and detaching the lens unit 200 (see FIG. 2). The communication terminal 124 is a contact terminal that enables communication between the imaging device 100 and the lens unit 200 when the lens unit 200 is attached to the lens mount section 125.

[0022] Fig. 2 is a block diagram of an imaging system in which a lens unit 200 is attached to an imaging device 100. Note that the same components as those described with reference to Fig. 1 for the imaging device 100 are denoted by the same reference numerals, and descriptions thereof will be omitted as appropriate.

[0023] The lens unit 200 is a type of interchangeable lens that is detachable from the imaging device 100, and is specifically a general single lens. The lens unit 200 includes an aperture 201, a lens 202, an aperture drive circuit 203, an AF drive circuit 204, a lens system control circuit 205, and a communication terminal 206.

[0024] The diaphragm 201 is a member that adjusts the aperture diameter, and is composed of multiple blades. The diaphragm driving circuit 203 adjusts the amount of light incident from a subject to the imaging device 100 by controlling the aperture diameter of the diaphragm 201. The lens 202 is typically represented as one lens in FIG. 2, but is composed of multiple lenses. The AF driving circuit 204 drives the focus lens that constitutes the lens 202 to focus on the subject. The lens system control circuit 205 controls the diaphragm 201 via the diaphragm driving circuit 203 and controls the position of the focus lens via the AF driving circuit 204 according to an instruction from the system control unit 218 of the imaging device 100. The communication terminal 206 is connected to the communication terminal 124 of the imaging device 100 when the lens unit 200 is attached to the imaging device 100, and enables communication between the lens system control circuit 205 and the system control unit 218 of the imaging device 100.

[0025] The imaging device 100 includes a shutter 210, an imaging unit 211, an A / D converter 212, a memory control unit 213, an image processing unit 214, a memory 215, a D / A converter 216, an EVF 217, an eyepiece unit 116, and a display unit 108. The imaging device 100 also includes a system control unit 218, a system memory 219, a non-volatile memory 220, a system timer 221, a communication unit 222, an attitude detection unit 223, and an eyepiece detection unit 118. The imaging device 100 further includes an outside-finder display unit 107, an outside-finder display drive circuit 224, a power control unit 225, a power supply unit 226, a recording medium I / F 227, and an operation unit 229.

[0026] The shutter 210 is a focal plane shutter that controls the exposure time of the imaging unit 211, and the driving of the shutter 210 is controlled by the system control unit 218. The imaging unit 211 is an image sensor (imaging element) such as a CCD sensor or a CMOS sensor that has a photoelectric conversion element that converts an optical image that passes through the lens unit 200 and is formed on the imaging surface into an electrical signal. Note that the image sensor provided in the imaging unit 211 in this embodiment is an imaging surface phase difference sensor having a photoelectric conversion element that outputs defocus amount information to the system control unit 218.

[0027] The A / D converter 212 generates image data by converting an analog signal output from the imaging unit 211 into an image signal consisting of a digital signal. The image processing unit 214 performs a predetermined process (for example, pixel interpolation, resizing such as reduction, color conversion, etc.) on the image data output from the A / D converter 212 or the image data taken out from the memory control unit 213. The image processing unit 214 also performs a predetermined calculation process on the image data output from the A / D converter 212, and the system control unit 218 performs exposure control and distance measurement control based on the obtained calculation result. This makes it possible to execute AF processing, AE processing, EF (flash pre-flash) processing, etc. of the TTL (through-the-lens) method. The image processing unit 214 further performs a predetermined calculation process on the image data output from the A / D converter 212, and performs AWB (auto white balance) processing of the TTL method based on the obtained calculation result.

[0028] The image data output from the A / D converter 212 is written into the memory 215 via the image processing unit 214 and the memory control unit 213, or is written into the memory 215 via the memory control unit 213 without via the image processing unit 214. The memory 215 stores the image data output from the A / D converter 212 and image data to be displayed on the display unit 108 and the EVF 217 (display image data). The memory 215 has a storage capacity sufficient to store a predetermined number of still images and a predetermined period of moving images and audio. The memory 215 also serves as an image display memory (video memory).

[0029] The D / A converter 216 converts the display image data stored in the memory 215 into an analog signal and supplies it to the display unit 108 or the EVF 217. That is, the display image data written in the memory 215 is converted into an image and displayed on the display unit 108 or the EVF 217 via the D / A converter 216. The display unit 108 or the EVF 217 is, for example, a display device such as an LCD or an organic EL, and displays an image according to an analog signal transmitted from the D / A converter 216. Note that the image data (digital signal) output from the A / D converter 212 and stored in the memory 215 is converted into an analog signal by the D / A converter 216 and sequentially transferred to and displayed on the display unit 108 or the EVF 217, thereby performing LV display.

[0030] The system control unit 218 is a control unit including at least one processor and / or at least one circuit, and is responsible for overall control of the imaging device 100. That is, the system control unit 218 realizes each process of the flowcharts described below by executing a predetermined program stored in the non-volatile memory 220. The system control unit 218 also performs display control by controlling the memory 215, the D / A converter 216, the display unit 108, and the EVF 217.

[0031] The system memory 219 may be, for example, a RAM, and may store constants and variables for the operation of the system control unit 218, programs read from the non-volatile memory 220, etc. The non-volatile memory 220 may be, for example, an EEPROM, which is an electrically erasable and storeable memory. The non-volatile memory 220 stores constants and programs for the operation of the system control unit 218 (programs for executing the flowcharts described later), etc.

[0032] The system timer 221 is a timing unit that measures the time used for various controls and the time of a built-in clock. The communication unit 222 transmits and receives video signals and audio signals to and from an external device (not shown) connected by wireless communication or a wired cable. The communication unit 222 also connects to a wireless LAN or the Internet, and communicates with external devices by Bluetooth (registered trademark) or the like. The imaging device 100 can transmit images (including LV images) captured by the imaging unit 211 and images stored in a storage medium 228 to external devices via the communication unit 222, and conversely, can receive various data from external devices.

[0033] The attitude detection unit 223 detects the attitude of the imaging device 100 with respect to the direction of gravity. Based on the attitude detected by the attitude detection unit 223, the system control unit 218 determines whether the image captured by the imaging unit 211 was captured with the imaging device 100 held horizontally or vertically. The system control unit 218 adds orientation information corresponding to the attitude detected by the attitude detection unit 223 to the image file of the captured image, and also rotates and stores the image. For example, an acceleration sensor or a gyro sensor is used for the attitude detection unit 223. It is also possible to detect the movement of the imaging device 100 (panning, tilting, lifting, whether it is stationary, etc.) using the attitude detection unit 223.

[0034] The eyepiece detection unit 118 is a sensor that detects the approach (approach) and departure (away) of an object (usually the eye of the user (photographer)) to the eyepiece unit 116 of the eyepiece finder 117 incorporating the EVF 217. For example, an infrared sensor is used for the eyepiece detection unit 118, but it is not limited to this. The infrared sensor determines the distance from the eyepiece unit 116 to the object (eye) based on the amount of reflected light of the emitted infrared light received from the object (eye). The eyepiece detection unit 118 detects the approach (approach) when it detects an object approaching within a predetermined distance from the eyepiece unit 116 from a non-approaching state (non-eyepiece state), and detects the departure (away) when the object moves away from the approaching state (eyepiece state) by more than a predetermined distance. After detecting the approach (approach), the eyepiece detection unit 118 is in the eyepiece state until it detects the departure (away), and after detecting the departure (away), it is in the non-eyepiece state until it detects the approach (approach). In addition, the threshold for detecting eye contact and the threshold for detecting eye separation may be made different by providing hysteresis in the approach (eye contact) detection process and the separation (eye separation) detection process, for example.

[0035] The system control unit 218 switches between display / non-display (display on / off) of the display unit 108 and the EVF 217 depending on the detection state by the eyepiece detection unit 118. Specifically, in a non-eyepiece state, the display of the display unit 108 is turned on and the display of the EVF 217 is turned off, and in a eyepiece state, the display of the EVF 217 is turned on and the display of the display unit 108 is turned off.

[0036] The outside-finder display unit 107 displays various settings of the image capture device 100, such as the shutter speed and aperture, via the outside-finder display drive circuit 224. The power supply control unit 225 is configured with a battery detection circuit, a DC-DC converter, a switch circuit for switching between current-carrying blocks, and the like, and detects whether a battery is attached, the type of battery, and the remaining battery level. The power supply control unit 225 also controls the DC-DC converter based on various detection results and instructions from the system control unit 218, and supplies the necessary voltage to each unit including the storage medium 228 for the necessary period. The power supply unit 226 is a primary battery such as an alkaline battery or a Li battery, a secondary battery such as a NiCd battery, a NiMH battery, or a Li-ion battery, an AC adapter, or the like. The recording medium I / F 227 is an interface that enables communication between the storage medium 228 and the system control unit 218. A memory card is used as the storage medium 228, but is not limited thereto. The storage medium 228 may be detachable from the image capture device 100 or may be built in the image capture device 100.

[0037] The operation unit 229 is an input unit that accepts an operation by a user (user operation) and instructs the system control unit 218 to perform various operations and processes. The operation unit 229 includes the shutter button 101, the power switch 102, the mode switching switch 103, the touch panel 109, and other operation members 230. The other operation members 230 include the main electronic dial 104, the sub electronic dial 105, the video button 106, the direction key 110, the SET button 111, the AE lock button 112, and the AF frame selection / enlargement button 113. The other operation members 230 also include a playback button 114, a menu button 115, and a touch bar 119. The other operation members 230 have been described with reference to FIG. 1, and therefore will not be described here.

[0038] The shutter button 101 has a first shutter switch 231 and a second shutter switch 232. The first shutter switch 231 is turned on when the shutter button 101 is halfway pressed (so-called halfway down), and generates a first shutter signal SW1 that instructs the system control unit 218 to prepare for shooting. When the system control unit 218 receives the first shutter signal SW1, it starts shooting preparation processing such as AF processing, AE processing, AWB processing, and EF processing. The second shutter switch 232 is turned on when the shutter button 101 is fully pressed (so-called full down), and generates a second shutter signal SW2 that instructs the system control unit 218 to perform a shooting operation. When the system control unit 218 receives the second shutter signal SW2, it executes a series of shooting processes from reading out a signal from the imaging unit 211 to storing a shot image in the storage medium 228.

[0039] 3 is a diagram showing an example of a schematic configuration of the twin lens unit 300, and shows in a simplified manner the twin lens unit 300 attached to the imaging device 100. The twin lens unit 300 is one of the interchangeable lenses that can be attached to and detached from the lens mount portion 125 of the imaging device 100.

[0040] The twin lens unit 300 is attached to the imaging device 100 by, for example, bayonet coupling between a camera mount section (lens side mount section) 304 and a lens mount section 125 of the imaging device 100. When the twin lens unit 300 is attached to the imaging device 100, the system control section 218 and the lens system control circuit 303 are electrically connected via the communication terminal 124 of the imaging device 100 and the communication terminal 306 of the twin lens unit 300.

[0041] The twin lens unit 300 has a right eye optical system 301R (first optical system) having multiple lenses and reflecting mirrors, etc., a left eye optical system 301L (second optical system) having multiple lenses and reflecting mirrors, etc., and a lens system control circuit 303.

[0042] The right-eye optical system 301R and the left-eye optical system 301L each have a lens 302R, 302L arranged on the subject side so that the optical axes are approximately parallel. The lenses 302R, 302L are fisheye lenses capable of capturing a range of approximately 180 degrees. The right-eye optical system 301R and the left-eye optical system 301L each obtain a range of the front hemisphere of approximately 180 degrees in the left-right direction (horizontal angle, azimuth angle, yaw angle) and approximately 180 degrees in the up-down direction (vertical angle, elevation angle, pitch angle) as a right image (first image) and a left image (second image) having parallax. In other words, the twin-eye lens unit 300 is configured as a lens unit capable of shooting in a standard format for stereoscopic 180-degree VR video (so-called VR180) of a VR image format capable of twin-eye stereoscopic viewing. The lenses 302R and 302L form a right image formed via the right eye optical system 301R and a left image formed via the left eye optical system 301L having parallax with respect to the right image on one or two imaging elements of the imaging device to which the lens unit 200 is attached.

[0043] It is sufficient that the right-eye optical system 301R and the left-eye optical system 301L can obtain an image capable of two-eye VR display as VR 180. Therefore, the lenses 302R and 302L may be lenses capable of capturing a wide viewing angle range (for example, about 160 degrees) narrower than the range of 180 degrees.

[0044] The twin lens unit 300 includes a first focus ring (not shown) for adjusting the focus of a right image formed via the right-eye optical system 301R, and a second focus ring (not shown) for adjusting the focus of a left image formed via the left-eye optical system 301L. Note that the configuration is not limited to this, and may include, for example, a focus ring for simultaneously adjusting the focus of the right and left images, and a focus ring for adjusting the focus of either the right or left image.

[0045] In this embodiment, the right and left images are formed side by side on the imaging unit 211 (imaging element). That is, two optical images (subject images) are formed on one imaging element by the right eye optical system 301R and the left eye optical system 301L, so that two images having parallax can be acquired simultaneously (as a set). Then, by dividing the acquired images into an image for the left eye and an image for the right eye and displaying them in VR, the user can view a stereoscopic VR image (so-called VR180) in a range of approximately 180 degrees.

[0046] Fig. 4 is a front view showing an example of a pixel array of an imaging element included in the imaging unit 211. Fig. 4 shows a part of the imaging pixels of the imaging element, specifically, a range of 4 columns x 4 rows of imaging pixels of a two-dimensional CMOS sensor (a range of 8 columns x 4 rows as the array of focus detection pixels) cut out. Note that when the y direction shown in Fig. 4 is parallel to the vertical direction, the x direction and z direction are parallel to the horizontal direction, and the z direction is the front-rear direction of the imaging device 100.

[0047] The pixel group 400 is composed of pixels in 2 columns x 2 rows, and is covered with color filters in a Bayer array. In the pixel group 400, a pixel 400R having a spectral sensitivity of R (red) is arranged at the upper left position, a pixel 400G having a spectral sensitivity of G (green) is arranged at the upper right and lower left positions, and a pixel 400B having a spectral sensitivity of B (blue) is arranged at the lower right position. The image sensor has a plurality of photodiodes (PDs) as photoelectric conversion units for one microlens 401 so that focus detection can be performed by an image plane phase difference method. In this embodiment, each pixel is composed of two PDs 402, 403 arranged in 2 columns x 1 row.

[0048] The imaging element of the imaging unit 211 is configured by arranging a large number of pixel groups 400 (repeatedly arranged in the x and y directions) on an imaging surface, each of which is made up of 2 columns x 2 rows of pixels (4 columns x 2 rows of PDs) as shown in FIG. 4, and acquires an imaging signal and a focusing signal. In each pixel of the imaging element, a light beam is separated by a microlens 401 and an image is formed on the PDs 402 and 403. In other words, each light beam that has passed through a different region of the exit pupil of the imaging optical system is imaged on the PDs 402 and 403. A signal (A image signal+B image signal) obtained by adding together the signals output from the PDs 402 and 403 is used as an imaging signal, and two signals (A image signal, B image signal) read out from each of the PDs 402 and 403 are used as focusing signals.

[0049] The imaging signal and the focus signal may be read out separately, but in consideration of the processing load, the following may be used. That is, the imaging signal (A image signal+B image signal) and one of the focus signals (e.g., A image signal) of the PDs 402 and 403 may be read out and the difference may be taken to obtain the other focus signal (e.g., B image signal). In addition, in this embodiment, each pixel has two PDs 402 and 403 for one microlens 401, but the number of PDs is not limited to two and may be three or more. Also, a plurality of pixels having different aperture positions of the light receiving portion for the microlens 401 may be provided. That is, it is sufficient as long as at least two signals that enable detection of a phase difference, such as the A image signal and the B image signal, are obtained as a result. Furthermore, in this embodiment, all pixels have a plurality of PDs, but the present invention is not limited to this, and focus detection pixels may be provided discretely within normal pixels that constitute the imaging element.

[0050] 5 is a flowchart of the LV shooting mode process that is executed when the lens unit 200 is attached to the imaging device 100. Each process (step) indicated by an S number in this flowchart is realized by the system control unit 218 loading a program stored in the non-volatile memory 220 into the system memory 219 and comprehensively controlling the operation of each unit of the imaging device 100. When the power switch 102 of the imaging device 100 is turned on to set the LV shooting mode, the process of S501 is started.

[0051] In S501, the system control unit 218 determines whether the LV display mode is the enlarged mode. Whether the LV display mode is the enlarged mode or not is stored in the non-volatile memory 220. If the system control unit 218 determines that the LV display mode is the enlarged mode (Yes in S501), it executes the process of S516, and if it determines that the LV display mode is not the enlarged mode (specifically, the same magnification mode) (No in S501), it executes the process of S502.

[0052] In S502, the system control unit 218 performs LV display on the display unit 108. The system control unit 218 displays the LV image as a shooting standby image on the display unit 108 and also displays various information. The LV display at this time is a life-size display in which the entire LV image, that is, the entire range of the imaging angle of view (image output from the entire imaging area of ​​the imaging element) is displayed so as to fit on the display unit 108. At this time, if the focus mode is set to the AF mode (autofocus mode), an autofocus frame (hereinafter referred to as the "AF frame") is displayed on the LV image. If the focus mode is set to the MF mode (manual focus mode) and a focus guide is set, a focus guide frame (hereinafter referred to as the "FG frame") indicating the target area for focus adjustment is displayed on the LV image. However, if the MF mode is set but the focus guide is not set, the FG frame is not displayed on the LV image.

[0053] In S503, the system control unit 218 determines whether the AF frame selection / magnification button 113 has been pressed (operated). It is assumed that the AF frame selection function is enabled. If the system control unit 218 determines that the AF frame selection / magnification button 113 has been pressed (Yes in S503), it executes the process of S504, and if it determines that the AF frame selection / magnification button 113 has not been pressed (No in S503), it executes the process of S514.

[0054] In S504, the system control unit 218 determines whether the focus mode is set to the AF mode. If the system control unit 218 determines that the focus mode is set to the AF mode (Yes in S504), it executes the process of S505, and if the system control unit 218 determines that the focus mode is not set to the AF mode (set to the MF mode) (No in S504), it executes the process of S507.

[0055] In S505, the system control unit 218 determines whether or not an operation to move the AF frame has been performed. The operation to move the AF frame can be performed by a series of operations (drag) on ​​the display unit 108 (touch panel 109), including touch down (touch on), touch move, and touch up. Note that the operation to move the AF frame may also be performed by the direction key 110. If the system control unit 218 determines that an operation to move the AF frame has been performed (Yes in S505), it executes the process of S506, and if it determines that an operation to move the AF frame has not been performed (No in S505), it executes the process of S512.

[0056] In S506, the system control unit 218 moves the display position of the AF frame in accordance with the AF frame moving operation determined in S505, and then executes the process of S512.

[0057] In S507, the system control unit 218 determines whether or not a focus guide is set. If the system control unit 218 determines that a focus guide is set (Yes in S507), it executes the process of S508, and if the system control unit 218 determines that a focus guide is not set (No in S507), it executes the process of S510.

[0058] In S508, the system control unit 218 determines whether or not an operation to move the FG frame has been performed. The operation to move the FG frame can be performed in the same manner as the operation to move the AF frame. If the system control unit 218 determines that an operation to move the FG frame has been performed (Yes in S508), it executes the process of S509, and if it determines that an operation to move the FG frame has not been performed (No in S508), it executes the process of S512.

[0059] In S509, the system control unit 218 moves the display position of the FG frame in accordance with the FG frame moving operation determined in S508, and then executes the process of S512.

[0060] In S510, the system control unit 218 determines whether or not a movement operation of the enlargement display frame has been performed. The enlargement display frame, which will be described later with reference to FIG. 7, is displayed on the display unit 108 so as to be superimposed on the LV image when the MF mode and the same magnification mode are set. In addition, since the AF frame, FG frame, and enlargement display frame are in a frame selectable state by S503, their positions can be changed in response to the operation of the direction key 110 or the touch operation of the touch panel 109. If the system control unit 218 determines that a movement operation of the enlargement display frame has been performed (Yes in S510), it executes the process of S511, and if it determines that a movement operation of the enlargement display frame has not been performed (No in S510), it executes the process of S513.

[0061] In S511, the system control unit 218 moves the display position of the enlargement display frame in accordance with the movement operation of the enlargement display frame determined in S510, and then executes the process of S513.

[0062] In S512, the system control unit 218 performs processing for displaying the focus adjustment area, and then executes processing in S513. Details of the processing for displaying the focus adjustment area in S512 will be described later with reference to the flowchart in FIG.

[0063] In S513, the system control unit 218 determines whether or not the AF frame selection / magnification button 113 has been pressed (operated). Here, as a result of the determination in S503, various frames are available for selection, and the magnification function is enabled. If the system control unit 218 determines that the AF frame selection / magnification button 113 has not been pressed (No in S513), it executes the process of S514, and if it determines that the AF frame selection / magnification button 113 has been pressed (Yes in S513), it executes the process of S516.

[0064] In S514, the system control unit 218 determines whether or not a focus guide is set. Note that the focus guide can only be set in the MF mode. Therefore, if the system control unit 218 determines that the focus guide is set in the MF mode (Yes in S514), it executes the process of S515, and if it determines that the focus guide is not set (No in S514), it executes the process of S517.

[0065] In S515, the system control unit 218 performs focus guide processing (FG processing), and then executes the processing of S517. Details of the FG processing of S515 will be described later with reference to the flowchart in FIG.

[0066] In S516, the system control unit 218 performs LV magnification shooting mode processing, and then executes processing in S517. Details of the processing in S516 will be described later with reference to the flowchart in FIG.

[0067] In S517, the system control unit 218 determines whether or not the first shutter signal SW1 of the shutter button 101 has been turned on. If the system control unit 218 determines that the first shutter signal SW1 has been turned on (Yes in S517), it executes the process of S518, and if it determines that the first shutter signal SW1 has not been turned on (No in S517), it executes the process of S520.

[0068] In S518, the system control unit 218 determines whether the focus mode is set to the AF mode. If the system control unit 218 determines that the focus mode is set to the AF mode (Yes in S518), it executes the process of S519, and if the system control unit 218 determines that the focus mode is not set to the AF mode (set to the MF mode) (No in S518), it executes the process of S520.

[0069] In S519, the system control unit 218 performs AF processing based on the position of the AF frame, and then executes the processing of S520.

[0070] In S520, the system control unit 218 determines whether the shutter button 101 has been fully pressed and the second shutter signal SW2 has been turned on. If the system control unit 218 determines that the second shutter signal SW2 has been turned on (Yes in S520), it executes the process of S521, and if it determines that the second shutter signal SW2 has not been turned on (No in S520), it executes the process of S522.

[0071] In S521, the system control unit 218 performs a series of image capturing processes from capturing an image in the image capturing unit 211 to storing the captured image data in the storage medium 228, and then executes the process of S523.

[0072] In S522, the system control unit 218 determines whether the on state of the first shutter signal SW1 is maintained. If the system control unit 218 determines that the on state of the first shutter signal SW1 is maintained (Yes in S522), it executes the process of S520, and if it determines that the first shutter signal SW1 is off (No in S522), it executes the process of S523.

[0073] In S523, the system control unit 218 determines whether or not an end event for the LV shooting mode has occurred. Examples of the end event include an operation to turn off the power of the imaging device 100, an instruction to switch to an operation mode other than the LV shooting mode (e.g., playback mode, etc.), etc. If the system control unit 218 determines that no end event has occurred (No in S523), it executes the process of S501, and if it determines that an end event has occurred (Yes in S523), it ends this process.

[0074] FIG. 6 is a flowchart of the LV enlarged shooting mode process executed in S516. FIG. 7 is a diagram showing an example of the display of the focus adjustment area and the enlarged display area when the LV image is displayed at the same size / enlarged size in the AF setting / MF setting. In FIG. 7, (A) is a diagram showing an example of the display of the LV image at the same size and the enlarged size when the focus mode is the AF mode. An AF frame 703 is displayed on the LV image 700 displayed at the same size. Also, an AF frame 704 corresponding to the AF frame 703 is displayed in the center of the LV image 701 displayed at the enlarged size, and an indicator 702 indicating the enlargement range is displayed in the lower right. In FIG. 7, (B) is a diagram showing the display of the LV image at the same size and the enlarged size when the focus mode is the MF mode. An enlarged display frame 705 is displayed on the LV image 700 displayed at the same size. An indicator 702 indicating the enlargement range is displayed in the lower right of the LV image 701 displayed at the enlarged size, but an enlargement frame corresponding to the enlargement frame 705 is not displayed.

[0075] In S601, the system control unit 218 acquires the LV enlargement magnification factor stored in the non-volatile memory 220. In S602, the system control unit 218 performs LV enlarged display at the enlargement magnification factor acquired in S601. In S603, the system control unit 218 determines whether or not an operation to change the enlargement position has been performed. The operation to change the enlargement position can be performed by operating the directional key 110. If the system control unit 218 determines that an operation to change the enlargement position has been performed (Yes in S603), it executes the process of S604, and if it determines that an operation to change the enlargement position has not been performed (No in S603), it executes the process of S607.

[0076] In S604, the system control unit 218 updates the enlargement position stored in the nonvolatile memory 220 to a new enlargement position in response to the operation to change the enlargement position received in S603. In S605, the system control unit 218 determines whether the focus mode is set to AF mode. If the system control unit 218 determines that the focus mode is set to AF mode (Yes in S605), it executes the process of S606, and if it determines that the focus mode is not set to AF mode (set to MF mode) (No in S605), it executes the process of S607.

[0077] In S606, the system control unit 218 performs processing for displaying the focus adjustment area, and then executes processing of S607. Details of the processing of S606 will be described later. In S607, the system control unit 218 determines whether or not an operation for changing the enlargement magnification has been performed. The operation for changing the enlargement magnification can be performed by rotating the main electronic dial 104. If the system control unit 218 determines that an operation for changing the enlargement magnification has been performed (Yes in S607), it executes processing of S608, and if it determines that an operation for changing the enlargement magnification has not been performed (No in S607), it executes processing of S612.

[0078] In S608, the system control unit 218 updates the enlargement magnification stored in the nonvolatile memory 220 to a new enlargement magnification in response to the enlargement magnification change operation received in S607. For example, when a change in the enlargement magnification is instructed by rotating the main electronic dial 104 in the forward direction (clockwise), the enlargement magnification is changed from 1x to 5x, from 5x to 10x, and from 10x to 1x for each command, and the enlargement magnification stored in the nonvolatile memory 220 is updated.

[0079] In S609, the system control unit 218 determines whether the updated magnification is the same or not (whether to return to the same magnification display or not). If the system control unit 218 determines that the magnification is the same (Yes in S609), it executes the process of S610, and if it determines that the magnification is not the same (5x or 10x in this embodiment) (No in S609), it executes the process of S611.

[0080] In S610, the system control unit 218 cancels the enlarged display of the LV image and displays the LV image at the normal magnification, and then executes the process of S614. In S611, the system control unit 218 enlarges and displays the LV image based on the updated enlargement magnification, and then executes the process of S612.

[0081] In S612, the system control unit 218 determines whether or not the AF frame selection / enlargement button 113 has been pressed. This operation is an instruction to cancel the enlarged display. If the system control unit 218 determines that the AF frame selection / enlargement button 113 has been pressed (Yes in S612), it executes the process of S613, and if it determines that the AF frame selection / enlargement button 113 has not been pressed (No in S612), it executes the process of S615.

[0082] In S613, since the system control unit 218 has determined that an instruction to cancel the enlarged display has been received in S612, the system control unit 218 cancels the enlarged display of the LV image and displays the LV image at the original size, and then executes the process of S614.

[0083] In S614, the system control unit 218 changes the LV display mode in the non-volatile memory 220 to the normal magnification mode, saves it, and then ends this process. In S615, the system control unit 218 saves the LV display mode in the non-volatile memory 220 in the enlarged mode, and then ends this process. Note that the LV display mode saved in the non-volatile memory 220 is used to determine whether or not it is the enlarged mode in S501.

[0084] Fig. 8 is a flowchart of the display process of the focus adjustment area executed in S512 of Fig. 5 and S606 of Fig. 6. Here, the description will be given on the assumption that the imaging system is configured by mounting the lens unit 200 to the imaging device 100, but the same process is performed when the twin lens unit 300 is mounted.

[0085] In S801, the system control unit 218 acquires the focus adjustable range from the lens system control circuit 205 via the communication terminal 206 of the lens unit 200 and the communication terminal 124 of the imaging device 100. Note that if identification information of the lens unit 200, information related to the focus adjustable range, and optical information for calculating the focus adjustable range are stored in the non-volatile memory 220, the system control unit 218 may acquire the focus adjustable range from this information.

[0086] In S802, the system control unit 218 acquires the center position and range of the focus adjustment area currently set in the imaging area of ​​the image sensor from the non-volatile memory 220. The focus adjustment area is the area indicated by the AF frame when set to AF mode, and is the area indicated by the FG frame when set to MF mode. In S803, the system control unit 218 determines whether or not the outer periphery position calculated from the center position and range of the focus adjustment area acquired in S802 is outside the focus adjustable range acquired in S801. Here, the processing of S803 will be specifically described with reference to FIG. 9.

[0087] Fig. 9 is a diagram showing the relationship between the center position and range of the focus adjustment area and the focus adjustable range. Fig. 9(A) is a schematic diagram showing an example in which the determination result is true and an example in which the determination result is false when determining whether or not the outer periphery of the focus adjustment area is outside the focus adjustable range.

[0088] 9A, the outer periphery of the focus adjustment area 901, which is centered on the central position 903, is inside the focus adjustable range 900, so the determination in S803 is false (No). On the other hand, at least a portion of the outer periphery of the focus adjustment area 902 is outside the focus adjustable range 900, so the determination in S803 is true (Yes).

[0089] If the system control unit 218 determines that the outer periphery of the focus adjustment area is not outside the focus adjustable range (No in S803), it executes processing of S804, and if it determines that the outer periphery of the focus adjustment area is outside the focus adjustable range (Yes in S803), it executes processing of S805.

[0090] In addition, in S803, it may be determined whether the center position of the focus adjustment area acquired in S802 is outside the focus adjustable range acquired in S801. Fig. 9(B) is a schematic diagram showing an example in which the determination result is true and false when determining whether the center position of the focus adjustment area is outside the focus adjustable range. In Fig. 9(B), since the center position 906 of the focus adjustment area 904 is inside the focus adjustable range 900, the determination in S803 is false (No). On the other hand, since the center position of the focus adjustment area 905 is outside the focus adjustable range 900, the determination in S803 is true (Yes).

[0091] In S804, the system control unit 218 performs display in a display format that allows focus adjustment because the focus adjustment area is in a position where focus adjustment is possible, and ends this process. In S805, the system control unit 218 performs display in a display format that does not allow focus adjustment because the focus adjustment area is in a position where focus adjustment is not possible, and ends this process. Specific examples of the display format that allows focus adjustment in S804 and the display format that does not allow focus adjustment in S805 will be described later with reference to FIG. 12, etc.

[0092] Fig. 10 is a flowchart of the FG process executed in S515 of Fig. 5. In S1001, the system control unit 218 reads out the distance measurement position stored in the system memory 219 (the position where the FG frame 1100 (see Fig. 11) is set).

[0093] In S1002, the system control unit 218 acquires information related to the focus of the subject at the distance measurement position obtained in S1001 (for example, in-focus information and information on success / failure of distance measurement) from the image processing unit 214. Note that the focus information includes information on whether the subject is in focus or in a so-called front focus or so-called back focus state, and further includes distance information between the in-focus point and the subject (information related to the degree of focus) in the case of front focus or back focus.

[0094] In S1003, the system control unit 218 determines the display position, index angle, and display color of the FG frame on the display unit 108 based on the information obtained in S1001 and S1002. In S1004, the system control unit 218 determines whether or not the distance measurement was successful based on the information obtained in S1002. If the system control unit 218 determines that the distance measurement was successful (Yes in S1004), it executes the process of S1005, and if it determines that the distance measurement was not successful (distance measurement failed) (No in S1004), it executes the process of S1010.

[0095] In S1005, the system control unit 218 determines whether or not the subject is in focus based on the information acquired in S1002. If the system control unit 218 determines that the subject is in focus (Yes in S1005), it executes the process of S1006, and if the system control unit 218 determines that the subject is not in focus (out of focus) (No in S1005), it executes the process of S1007.

[0096] In S1006, the system control unit 218 selects data corresponding to the indicator display form when the subject is in focus (hereinafter referred to as the "first indicator display form"), and then executes the process of S1011. Note that a specific example of the first indicator display form (FIG. 11(A)) will be described later.

[0097] In S1007, the system control unit 218 determines whether the subject is in front focus or back focus based on the information acquired in S1002. If the system control unit 218 determines that the subject is in front focus, it executes the process of S1008, and if the system control unit 218 determines that the subject is in back focus, it executes the process of S1009.

[0098] In S1008, the system control unit 218 selects data corresponding to the indicator display form when the subject is in front focus (hereinafter referred to as the "second indicator display form"), and then executes the process of S1011. Note that a specific example of the second indicator display form (FIG. 11(B)) will be described later.

[0099] In S1009, the system control unit 218 selects data corresponding to the indicator display form when the subject is in back focus (hereinafter referred to as the "third indicator display form"), and then executes the process of S1011. Note that a specific example of the third indicator display form (FIG. 11(C)) will be described later.

[0100] In S1010, the system control unit 218 selects data corresponding to the indicator display form when the subject is significantly blurred (hereinafter referred to as the "fourth indicator display form"), and then executes the process of S1011. Note that a specific example of the fourth indicator display form (FIG. 11(D)) will be described later.

[0101] In S1011, the system control unit 218 superimposes an FG frame on the LV image using the data of the index display form selected in any one of S1006, S1008, S1009, and S1010. This ends the present process. That is, the system control unit 218 superimposes the selected index and frame data on the live view image at the display position, index angle, and display color determined in S1003, and displays it on the display unit 108.

[0102] Next, specific examples of the first to fourth indicator display forms will be described. Fig. 11(A) is a diagram showing an example of the first indicator display form, and shows a display example when it is determined that the subject is in focus. In the focus guide, a display based on the defocus amount acquired from the imaging range corresponding to the position (within the frame) where the FG frame 1100 is superimposed and displayed is performed on the LV image.

[0103] Specifically, the focus guide indicates the degree of focus based on the defocus amount described below. That is, the degree of focus is indicated based on the defocus amount calculated based on the output values ​​from a pixel group within a range corresponding to the position of the FG frame 1100 among pixels capable of acquiring the defocus amount of the imaging element of the imaging unit 211 (pixels that perform imaging surface phase difference detection). In this embodiment, the focus guide is displayed in four ways, the first to fourth index display forms described above, and the focus state is expressed by display parts 1101 to 1111 which are display elements. The display parts 1101 to 1111 are arranged on the upper part of the FG frame 1100.

[0104] In the first indicator display form shown in FIG. 11(A) which is determined to be in focus, the positions of the outer display part 1101 and the inner display part 1102 match and are stopped at the top of the FG frame 1100. When it is determined to be in focus, for example, the display parts 1101 and 1102 may be displayed in a color (e.g., green) different from the color (e.g., white) of the other display forms. The display part 1101 is a combination of the display parts 1107 and 1108 shown in FIG. 11(C) which shows the third indicator display form. Similarly, the display part 1102 is a combination of the display parts 1104 and 1105 shown in FIG. 11(B) which shows the second indicator display form.

[0105] Fig. 11(B) is a diagram showing an example of the second indicator display form, and shows a display example in the case of front focus, where the focus is closer than the subject. Note that in the second and third indicator display forms (Figs. 11(B) and (C)), the subject is not in focus, but the reliability of the focus detection result is high, so the direction to the in-focus position and the magnitude of the defocus amount are displayed.

[0106] In the front focus state, the outer display part 1103 is stopped at the top of the FG frame 1100, while the inner display parts 1104, 1105 move symmetrically on the left and right sides along the circumference indicated by the dashed line surrounding the FG frame 1100 as the defocus amount changes. Here, the outer display part 1103 is illustrated as an inward-facing isosceles triangle, and the inner display parts 1104, 1105 are illustrated as outward-facing isosceles triangles.

[0107] The positions of display parts 1104, 1105 represent the magnitude of the defocus amount, and the defocus amount increases as they move away from the position (reference position) of display part 1103. At this time, display parts 1104, 1105 move on the dashed circumference so that the bisector of the apex angle passes through approximately the center of the dashed circle, and so the angle (index angle) changes according to the defocus amount (display position).

[0108] It should be noted that the display part 1103 corresponds to the display part 1101, and the overlapping state of the display parts 1104 and 1105 corresponds to the display part 1102. In other words, when the front focus state is changed to the in-focus state, the display parts 1104 and 1105 are integrated and displayed as the display part 1102.

[0109] FIG. 11C is a diagram showing an example of the third indicator display form, and shows a display example in the case of back focus where the focus is on the infinity side of the subject. In the back focus state, the inner display part 1106 stops at the top of the FG frame 1100, and the outer display parts 1107 and 1108 move symmetrically on the circumference shown by the dashed line surrounding the FG frame 1100 with the change in the defocus amount. Here, the inner display part 1106 is illustrated as an outward-facing isosceles triangle, and the outer display parts 1107 and 1108 are illustrated as inward-facing isosceles triangles. The positions of the display parts 1107 and 1108 indicate the magnitude of the defocus amount, and it is shown that the defocus amount increases as both are farther away from the position of the display part 1106 (reference position). Note that the display part 1106 corresponds to the display part 1102, and the state in which the display parts 1107 and 1108 overlap corresponds to the display part 1101. In other words, when the back focus state is changed to the in-focus state, the display parts 1107 and 1108 are integrated and displayed as the display part 1011.

[0110] Thus, in the second and third indicator display forms, the magnitude of the defocus amount is indicated by the position of the movable display part, and the direction to the in-focus position (defocus direction) is indicated by the orientation of the display part stopped at the upper part of the FG frame 1100. This allows the user to intuitively grasp the in-focus state by checking the state of the display parts.

[0111] 11D is a diagram showing an example of the fourth indicator display form, showing a display example when the reliability of the focus detection result is low. In the fourth indicator display form, in order to allow the user to visually recognize that focus detection is not possible, the display parts 1109-1111 are in a color (e.g., gray) different from that of the other display forms, and are fixedly displayed at predetermined positions, so that the magnitude of the defocus amount and the defocus direction are not shown. Also, in the fourth indicator display form, the shape of the display parts 1109-1111 is made to be short and rectangular, which is different from that of the first to third indicator display forms.

[0112] As is clear from a comparison between FIG. 11(A) and FIG. 11(B)-(D), in this embodiment, the display form of the FG frame is changed between the focused state and the unfocused state, but it is not necessarily required to change it. The display form of the focus guide is not limited to the above-mentioned first to fourth indicator display forms, and may be any display form that indicates that the image is in focus and indicates how far the image is out of focus when the image is not in focus. In this embodiment, the focus guide displays the degree of focus based on the defocus amount calculated from the imaging surface phase difference signal obtained from the imaging element of the imaging unit 211, but is not limited to this. For example, the degree of focus may be displayed based on the output value from a focus detection sensor (such as a phase difference sensor) set at a location different from the imaging surface, or the degree of focus may be displayed based on a contrast value.

[0113] Next, specific examples of the display formats in S804 and S805 (display formats of the focus adjustment area in normal size display and enlarged display when focus adjustment is possible and not possible) will be described. Fig. 12 is a diagram showing display examples of S804 and S805 in Fig. 8 when a single lens (lens unit 200) is attached. In Fig. 12, (A) shows an example of a display format where focus adjustment is possible in S804, and (B) to (E) show examples of display formats where focus adjustment is not possible in S805.

[0114] In the actual size display in (A), focus adjustment area 1204 displayed on the actual size LV image 1200 is within focus adjustable range 1203, so it is determined in S803 that focus adjustment is possible. As a result, focus adjustment area 1204 is displayed in a display format that allows focus adjustment, specifically, focus adjustment area 1204 is displayed in a rectangular frame drawn with a solid line of a predetermined color. In the enlarged display in (A), focus adjustment area 1205 displayed in the center of the enlarged LV image 1201 has the same display format as focus adjustment area 1204. At this time, indicator 1202 indicating enlarged display is displayed.

[0115] In the actual size display in (B), focus adjustment area 1206 displayed on the actual size LV image 1200 is outside the focus adjustable range 1203, so it is determined in S803 that focus adjustment is impossible. As a result, focus adjustment area 1208 is displayed using a different display method than focus adjustment area 1204, and is displayed here as a rectangular frame drawn with a solid line in a different color than focus adjustment area 1204. In the enlarged display in (B), focus adjustment area 1207 displayed in the center of the enlarged LV image 1201 is displayed in the same form as focus adjustment area 1206.

[0116] In the actual size display in (C), the focus adjustment area 1208 displayed on the actual size LV image 1200 is outside the focus adjustable range 1203, so it is determined in S803 that focus adjustment is impossible. As a result, the focus adjustment area 1208 is displayed in a form different from the focus adjustment area 1204. Here, the rectangular frame indicating the focus adjustment area 1204 is displayed with a solid line of a predetermined color, whereas the rectangular frame indicating the focus adjustment area 1208 is displayed with a dashed line. Note that the type of line indicating the frame of the focus adjustment area 1208 is not limited to a dashed line, and may be another type of line (two-dot chain line, wavy line, zigzag line, etc.). In the enlarged display in (C), the focus adjustment area 1209 displayed in the center of the enlarged LV image 1201 is displayed in the same form as the focus adjustment area 1208.

[0117] In the actual size display in (D), focus adjustment area 1210 displayed on LV image 1200 displayed at actual size is outside focus adjustable range 1203, so it is determined in S803 that focus adjustment is impossible. As a result, focus adjustment area 1210 is displayed in a form different from focus adjustment area 1204, and here, while a rectangular frame indicating focus adjustment area 1204 is always displayed, focus adjustment area 1210 is displayed with a blinking solid line frame. In the enlarged display in (D), focus adjustment area 1211 displayed in the center of enlarged LV image 1201 is displayed in the same form as focus adjustment area 1210. Note that the blinking display is shown diagrammatically in (D).

[0118] In the actual size display in (E), focus adjustment area 1212 displayed on the actual size LV image 1200 is outside the focus adjustable range 1203, so it is determined in S803 that focus adjustment is impossible. As a result, focus adjustment area 1212 is displayed in a form different from focus adjustment area 1204, and here focus adjustment area 1212 is displayed in a form in which a pattern (hatching, filling in, etc.) is added inside a rectangular frame indicated by solid lines. In the enlarged display in (E), focus adjustment area 1213 displayed in the center of the enlarged LV image 1201 is displayed in the same form as focus adjustment area 1212.

[0119] Fig. 13 is a diagram showing display examples of S804 and S805 in Fig. 8 when the twin lens unit 300 is attached. In Fig. 12, (A) shows an example of a display format in which focus adjustment in S804 is possible, and (B) shows an example of a display format in which focus adjustment in S805 is not possible.

[0120] In the actual size display in (A), focus adjustment area 1304 displayed on the actual size LV image 1300 is within focus adjustable range 1303, so it is determined in S803 that focus adjustment is possible. As a result, focus adjustment area 1304 is displayed in a display format that allows focus adjustment. In the enlarged display in (A), focus adjustment area 1305 displayed in the center of the enlarged LV image 1301 is displayed in the same format as focus adjustment area 1304. Note that in the case of enlarged display, an indicator 1302 indicating enlarged display is displayed.

[0121] In the actual size display in (B), since the focus adjustment area 1306 displayed on the actual size LV image 1300 is outside the focus adjustable range 1303, it is determined in S803 that focus adjustment is impossible. As a result, the focus adjustment area 1306 is displayed in a form different from the focus adjustment area 1304. Here, the focus adjustment area 1304 is displayed in a solid line frame, whereas the focus adjustment area 1306 is displayed in a dashed line frame. In the enlarged display in (B), the focus adjustment area 1307 displayed in the center of the enlarged LV image 1301 is displayed in the same display form (dashed line frame) as the focus adjustment area 1306. Note that the display form of the focus adjustment areas 1306 and 1307 may be other forms such as colors, patterns, flashing, etc., as in FIG. 12.

[0122] FIG. 14 is a diagram showing a display example in S804 and S805 in the case where the focus adjustment area is moved during subject detection in a state where a single lens (lens unit 200) is attached.

[0123] 14(A), when a subject is detected within focus adjustable range 1401 for LV image 1400, focus adjustment area 1402 in the subject detection state is displayed. Even if the subject moves, focus adjustment area 1402 automatically moves to follow the subject as long as the moved subject remains within focus adjustable range 1401.

[0124] When the user wishes to move the enlarged display position, the user can move the position of the focus adjustment area that is the center of the enlarged display by pressing the AF frame selection / enlargement button 113 (S503). As shown in Fig. 14(B), if the focus adjustment area after the movement is within the focus adjustable range 1401, the display of the focus adjustment area 1402 is switched to the display of the focus adjustment area 1403 (same as the focus adjustment area 1204 in Fig. 12). On the other hand, as shown in Fig. 14(C), if the focus adjustment area after the movement is outside the focus adjustable range 1401, the display of the focus adjustment area 1402 is switched to the display of the focus adjustment area 1404 (same as the focus adjustment area 1208 in Fig. 12).

[0125] It should be noted that the focus adjustment area 1402 in the subject detection state changes depending on the detected subject size. On the other hand, the focus adjustment areas 1403 and 1404 are used to select the position for enlarged display, so it is desirable to display them at a fixed size that is not dependent on the subject size, as in the focus adjustment areas 1204 and 1208 in Fig. 12. The focus adjustment area 1404 is not limited to the focus adjustment area 1208, and may be displayed in the same manner as any of the focus adjustment areas 1206, 1210, and 1212.

[0126] Figure 15 is a diagram showing another display example of S804 and S805 in Figure 8 when a single lens (lens unit 200) is attached. Note that since the display example in Figure 15 is a modified example of the display example in Figure 12, the reference numerals used in Figure 12 are used for the same elements as in the display example in Figure 12. As in Figure 12, (A) in Figure 15 shows an example of a display format in which focus adjustment in S804 is possible, and (B) to (E) show examples of display formats in which focus adjustment in S805 is not possible.

[0127] When the LV image is displayed at actual size, if the AF frame selection / enlargement button 113 is pressed in S503, the focus adjustment area and the enlarged display area 1501 (in the case of (A), the focus adjustment area 1204 and the enlarged display area 1501) are displayed simultaneously in different forms. In other words, until the AF frame selection / enlargement button 113 is pressed in S503, only the focus adjustment area is displayed as in the actual size display shown in FIG.

[0128] The enlarged display area 1501 can be enlarged over the entire range of the LV image, and the display form does not change depending on whether focus adjustment is possible or not, unlike the focus adjustment area. Therefore, only the focus adjustment area (for example, focus adjustment area 1505 in (A)) is displayed in the enlarged display, and there is no difference between the enlarged display in Figures 12 and 15. When the LV enlargement is released (S610, S613), the LV image switches from the enlarged display to the normal size display, and only the focus adjustment area is displayed, which is equivalent to the normal size display in Figure 12.

[0129] As described above, according to this embodiment, when the AF mode is selected and the AF frame is displayed, the user can select an area to be enlarged from the entire LV screen. Then, the user can recognize whether AF distance measurement is possible in the selected area based on the display state of the AF area. Furthermore, not only in AF, but also when performing MF, the user can recognize whether focus adjustment is possible based on the display state of the focus guide.

[0130] Although the present invention has been described in detail above based on the preferred embodiments, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. Furthermore, each of the above-mentioned embodiments merely shows one embodiment of the present invention, and each embodiment can be appropriately combined.

[0131] The disclosure of this embodiment includes the following configurations and methods. [Configuration 1] An imaging device comprising: an imaging element having pixels that generate multiple imaging signals by photoelectrically converting incident light from a subject that has passed through different areas of an exit pupil of an imaging optical system; a setting means for setting a focus adjustment area used for focus adjustment of the imaging optical system for an imaging area captured by the imaging element; a detection means for detecting a defocus amount of the imaging optical system based on the multiple imaging signals obtained from the focus adjustment area; a determination means for determining whether focus adjustment is possible in the focus adjustment area based on the defocus amount; and a control means for switching display of a live view image on a display device between a life-size display that displays an image of the entire imaging area and an enlarged display that displays an enlarged image of the focus adjustment area, wherein the control means changes the display method of the focus adjustment area between the life-size display and the enlarged display depending on the determination result by the determination means. [Configuration 2] The imaging device described in Configuration 1, wherein the control means varies the color, shape or pattern indicating the focus adjustment area, and varying the shape includes varying the type of line that draws a frame indicating the focus adjustment area, or distinguishing between constantly displaying the line and flashing it. [Configuration 3] An imaging device as described in configuration 1 or 2, characterized in that the focus adjustment area is a focus guide frame that indicates the target area for focus adjustment when the focus mode is set to manual focus mode and a focus guide is set. [Configuration 4] The imaging device according to configuration 1 or 2, characterized in that the focus adjustment area is an autofocus frame that indicates the target area for focus adjustment when the focus mode is set to autofocus mode. [Configuration 5] An imaging device according to any one of configurations 1 to 4, characterized in that the focus adjustment area is displayed using the same display method in the normal size display and the enlarged display of the live view image. [Configuration 6] An imaging device as described in configuration 1 or 2, further comprising an operation means for setting an enlarged display area for enlarging and displaying the live view image on the display device when the live view image is displayed on the display device at the normal size, and the control means displays the focus adjustment area and the enlarged display area simultaneously using different display methods. [Configuration 7] An imaging device described in any one of configurations 1 to 6, further comprising an acquisition means for acquiring a range of the imaging area in which focus adjustment is possible, and the determination means determines that focus adjustment is possible in the focus adjustment area when the center of the focus adjustment area is within the range in which focus adjustment is possible. [Configuration 8] An imaging device described in any one of configurations 1 to 6, further comprising an acquisition means for acquiring a range of the imaging area in which focus adjustment is possible, and the determination means determines that focus adjustment is possible in the focus adjustment area when the outer periphery of the focus adjustment area is within the range in which focus adjustment is possible. [Configuration 9] An imaging device as described in Configuration 7 or 8, further comprising a memory means for storing at least one of identification information regarding a lens attached to the imaging device, information on the range in which focus can be adjusted, and optical information for calculating the range in which focus can be adjusted, wherein the acquisition means acquires the range in which focus can be adjusted from the information stored in the memory means. [Configuration 10] An imaging device as described in Configuration 7 or 8, further comprising a communication means for communicating with a control means of a lens attached to the imaging device, and the acquisition means acquires the range in which the focus can be adjusted from the control means of the lens via the communication means. [Configuration 11] An imaging device as described in any one of configurations 1 to 10, further comprising a movement operation means for moving the focus adjustment area, wherein the control means displays a frame representing the moved focus adjustment area when a movement operation is performed on the focus adjustment area, at a fixed size independent of the size of the subject in the moved focus adjustment area. [Configuration 12] A program for causing a computer to function as each of the means of the imaging device described in any one of configurations 1 to 11. [Method 1] A control method for an imaging device equipped with an imaging element having pixels that generate multiple imaging signals by photoelectrically converting incident light from a subject that has passed through different areas of an exit pupil of the imaging optical system, the control method for an imaging device comprising the steps of: setting a focus adjustment area to be used for focus adjustment of the imaging optical system for an imaging area captured by the imaging element; detecting a defocus amount of the imaging optical system based on the multiple imaging signals obtained from the focus adjustment area; determining whether focus adjustment is possible in the focus adjustment area based on the defocus amount; and switching display of a live view image on a display device between a life-size display that displays an entire image of the imaging area and an enlarged display that displays an enlarged image of the focus adjustment area, and at that time varying the display method of the focus adjustment area between the life-size display and the enlarged display depending on the result of the determination.

[0132] In the above embodiment, a mirrorless single-lens digital camera is used as the imaging device according to the present invention, but the present invention is not limited to this. For example, the present invention may be various cameras such as compact digital cameras and digital video cameras, and may further be various electronic devices capable of capturing images using an imaging element. For example, the present invention may be applied to mobile communication terminals with a camera function (mobile phones, smartphones, etc.), mobile computers with a camera function (tablet terminals), mobile game consoles with a camera function, etc.

[0133] The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions. [Explanation of symbols]

[0134] 100 Imaging device 108 Display section 113 AF frame selection / magnification button 200 Lens unit 211 Imaging unit 218 System Control Unit 220 Non-volatile memory 229 Operation section 300 Twin Lens Unit 402,403 PD 703,704 AF frame 705 Enlarged View Frame 1203 Focus Adjustable Range 1204~1213 Focus adjustment area

Claims

1. An image sensor having pixels that photoelectrically convert incident light from a subject that has passed through different regions of an exit pupil of an image pickup optical system to generate a plurality of image pickup signals; a setting means for setting a focus adjustment area used for focus adjustment of the imaging optical system in a live view image displayed on a display device; a determination means for determining whether focus adjustment is possible in the focus adjustment area set by the setting means; and a control means for controlling the display method of the focus adjustment area to be different depending on the result of the determination by the determination means.

2. The control means varies the color, shape or pattern indicating the focus adjustment area, 2. The imaging device according to claim 1, wherein the changing of the form includes changing the type of line used to draw the frame indicating the focus adjustment area, or changing the line between being constantly displayed and being flashing.

3. An imaging device as described in claim 1 or 2, characterized in that the focus adjustment area is a focus guide frame that indicates the target area for focus adjustment when the focus mode is set to manual focus mode and a focus guide is set.

4. An imaging device as described in claim 1 or 2, characterized in that the focus adjustment area is an autofocus frame that indicates the area to be adjusted for focus when the focus mode is set to autofocus mode.

5. An imaging device as described in claim 1 or 2, characterized in that the focus adjustment area is displayed using the same display method when displaying the live view image at normal size and when displaying it at an enlarged size.

6. The present invention further comprises an operating means for setting an enlarged display area for enlarging and displaying the live view image on the display device when the live view image is displayed on the display device at the same magnification; 3. The imaging apparatus according to claim 1, wherein the control means simultaneously displays the focus adjustment area and the enlarged display area using different display methods.

7. The imaging device further includes an acquisition means for acquiring a focus adjustable range of an imaging area captured by the imaging element, 2. The imaging device according to claim 1, wherein the determining means determines that focus adjustment is possible in the focus adjustment area when the center of the focus adjustment area is within the range in which focus adjustment is possible.

8. Further comprising an acquisition means for acquiring a range in which focus adjustment is possible within the imaging area of ​​the imaging element, 2. The imaging device according to claim 1, wherein the determining means determines that focus adjustment is possible in the focus adjustment area when the outer periphery of the focus adjustment area is within the range in which focus adjustment is possible.

9. The imaging device further comprises a storage means for storing at least one of identification information regarding a lens attached to the imaging device, information regarding the range in which the focus can be adjusted, and optical information for calculating the range in which the focus can be adjusted; 9. The imaging apparatus according to claim 7, wherein the acquisition means acquires the focus adjustable range from information stored in the storage means.

10. The imaging device further includes a communication means for communicating with a control means for a lens attached to the imaging device, 9. The imaging device according to claim 7, wherein the acquisition unit acquires the focus adjustable range from the lens control unit via the communication unit.

11. Further comprising a movement operation means for moving the focus adjustment area, The imaging device according to claim 1 or 2, characterized in that the control means displays a frame representing the moved focus adjustment area when the movement operation means moves the focus adjustment area, at a fixed size that is independent of the size of the subject in the moved focus adjustment area.

12. A control method for an imaging device having an imaging element having pixels that photoelectrically convert incident light from a subject that has passed through different regions of an exit pupil of an imaging optical system to generate a plurality of imaging signals, comprising: a setting step of setting a focus adjustment area used for focus adjustment of the imaging optical system in a live view image displayed on a display device; a determination step of determining whether focus adjustment is possible in the focus adjustment area set in the setting step; a control step of controlling the display method of the focus adjustment area so as to vary the display method depending on the determination result in the determination step.

13. A computer-readable recording medium storing a program for causing a computer to function as each means of the imaging device described in claim 1.

Images