Imaging apparatus

Abstract

To provide an imaging apparatus that can resolve the difference between left and right without affecting a photographed image.SOLUTION: An imaging apparatus has: an image pickup device that has a plurality of focus detection pixels receiving light beams passing through different pupil part areas of an imaging optical system; first focus detection means that acquires the amount of defocus of a first optical system on the basis of a pair of signals from the focus detection pixels; second focus detection means that acquires the amount of defocus of a second optical system on the basis of a pair of signals from the focus detection pixels; and notification means that performs notification for urging adjustment of the first optical system or the second optical system. When the difference between the amount of defocus of the first optical system and the amount of defocus of the second optical system is larger than a first predetermined value, the notification means performs the notification.SELECTED DRAWING: Figure 5

Description

[Technical field]

[0001] The present invention relates to an imaging device. [Background technology]

[0002] In recent years, imaging devices capable of capturing stereoscopically viewable images have been proposed (see Patent Document 1). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2011-205558 A Summary of the Invention [Problem to be solved by the invention]

[0004] Conventionally, a configuration having two focus lenses, a focus lens that simultaneously adjusts a right image formed through a right-eye optical system and a left image formed through a left-eye optical system, and a focus lens that adjusts either the right image or the left image, is known. In this configuration, the focus adjustment during shooting is performed by the focus lens that simultaneously adjusts the left image and the right image, and only when a difference occurs between the left image and the right image, the focus lens that adjusts either the right image or the left image adjusts the difference between the left and right images. However, since the user needs to compare and visually confirm whether a difference occurs between the left and right images by enlarging the display, it is difficult to visually confirm the difference between the left and right images during shooting.

[0005] Furthermore, in a configuration having a focus lens that adjusts the right image and a focus lens that adjusts the left image, it is necessary to constantly control two focus lenses, and if a difference occurs in the respective focus detection results, a difference between the left and right sides will occur during shooting, which may affect the captured image.

[0006] An object of the present invention is to provide an imaging device capable of eliminating the difference between left and right without affecting the captured image. [Means for solving the problem]

[0007] An imaging device as one aspect of the present invention comprises an imaging element having a plurality of focus detection pixels that receive light beams that each pass through different pupil partial areas of an imaging optical system, a first focus detection means that acquires a defocus amount of a first optical system based on a pair of signals from the focus detection pixels, a second focus detection means that acquires a defocus amount of a second optical system based on a pair of signals from the focus detection pixels, and a notification means that issues a notification to encourage adjustment of the first optical system or the second optical system, wherein the notification means issues a notification when the difference between the defocus amount of the first optical system and the defocus amount of the second optical system is greater than a first predetermined value. Effect of the Invention

[0008] According to the present invention, it is possible to provide an imaging device capable of eliminating the difference between left and right without affecting a captured image. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a diagram showing an example of the external configuration of a digital camera. [Diagram 2] FIG. 1 illustrates an example of the internal configuration of a digital camera. [Diagram 3] FIG. 2 is a schematic diagram showing an example of the configuration of a lens unit. [Figure 4] 2 is a schematic diagram showing an example of a pixel arrangement of an imaging element in an imaging section. FIG. [Diagram 5] 13 is a flowchart showing a left-right difference adjustment notification process. [Figure 6] FIG. 13 is a diagram showing an example of a display of a notice of left-right difference adjustment. [Figure 7] 13A and 13B are diagrams illustrating another example of the display of the notice of left-right difference adjustment. [Figure 8] 13 is a flowchart showing an automatic left-right difference adjustment process. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the drawings, the same reference numerals are used to refer to the same components, and duplicated descriptions will be omitted.

[0011] In this embodiment, a lens-interchangeable single-lens reflex digital camera having an automatic focus adjustment (autofocus: AF) function based on an image plane phase difference method will be described as an example of an imaging device. Note that the present invention can be applied to other imaging devices such as non-lens-interchangeable digital cameras and digital video cameras, personal computers and tablets, mobile phones and smartphones, surveillance cameras, vehicle-mounted cameras, and medical cameras. [Overall configuration] Fig. 1 is a diagram showing an example of the external configuration of a digital camera (hereinafter, simply referred to as camera) 100. Fig. 1(a) is a perspective view of the camera 100 seen from the front, and Fig. 1(b) is a perspective view of the camera 100 seen from the back.

[0012] The camera 100 has a shutter button 101, a power switch 102, a mode switch 103, a main electronic dial 104, a sub electronic dial 105, a movie button 106, and a viewfinder display 107 on the top surface. The shutter button 101 is an operation unit for preparing for shooting or issuing a shooting instruction. The power switch 102 is an operation unit for switching the power of the camera 100 on and off. The mode switch 103 is an operation unit for switching between various modes. The main electronic dial 104 is a rotary operation unit for changing settings such as shutter speed and aperture. The sub electronic dial 105 is a rotary operation unit for moving a selection frame (cursor), forwarding images, etc. The movie button 106 is an operation unit for issuing an instruction to start or stop movie shooting (recording). The viewfinder display 107 displays various settings such as shutter speed and aperture.

[0013] Camera 100 has, on the rear surface, a display unit 108, a touch panel 109, direction keys 110, a SET button 111, an AE lock button 112, a magnification button 113, a playback button 114, and a menu button 115. Camera 100 also has, on the rear surface, an eyepiece unit 116 and an eyepiece finder (a peer-in type finder) 117. Camera 100 also has, on the rear surface, an eyepiece detection unit 118 and a touch bar 119.

[0014] The display unit 108 displays images and various information. The touch panel 109 is an operation unit that detects touch operations on the display surface (touch operation surface) of the display unit 108. The directional keys 110 are an operation unit consisting of keys (four-way keys) that can be pressed up, down, left, and right, respectively, and operations can be performed according to the positions where the directional keys 110 are pressed. The SET button 111 is an operation unit that is pressed mainly when deciding a selection item. The AE lock button 112 is an operation unit that is pressed when fixing an exposure state in a shooting standby state. The enlargement button 113 is an operation unit for switching the enlargement mode on and off in the live view display (LV display) in the shooting mode. When the enlargement mode is on, the live view image (LV image) is enlarged or reduced by operating the main electronic dial 104. The enlargement button 113 is also used when enlarging a playback image or increasing the magnification ratio in the playback mode. The playback button 114 is an operation unit for switching between the shooting mode and the playback mode. In the shooting mode, pressing the playback button 114 switches to the playback mode, and the most recent image among the images recorded on the recording medium 228 described later can be displayed on the display unit .

[0015] Menu button 115 is an operation unit that is pressed when displaying a menu screen on which various settings can be made on display unit 108. A user can intuitively make various settings using the menu screen displayed on display unit 108, direction key 110, and SET button 111. Eyepiece unit 116 is a part for placing an eye on eyepiece finder (peek-in type finder) 117. A user can view an image displayed on an internal EVF 217 (Electronic View Finder) described later through eyepiece unit 116. Eyepiece detection unit 118 is a sensor that detects whether or not the user places his / her eye on eyepiece unit 116.

[0016] The touch bar 119 is a line-shaped touch operation unit (line touch sensor) capable of receiving a touch operation. The touch bar 119 is disposed at a position where the index finger of the right hand can press the shutter button 101, and where the thumb of the right hand can touch the touch bar (touchable) when the grip unit 120 is held in the right hand (held with the little finger, ring finger, and middle finger of the right hand). That is, the touch bar 119 can be operated in a state where the eyepiece unit 116 is placed close to the eyepiece unit 116, the eyepiece viewfinder 117 is looked into, and the shutter button 101 can be pressed (shooting posture). The touch bar 119 can receive a tap operation (operation of touching and releasing without moving within a predetermined period) on the touch bar 119, a slide operation to the left and right (operation of touching and then moving the touch position while keeping the touch), and the like. The touch bar 119 is an operation unit different from the touch panel 109, and does not have a display function. The touch bar 119 of this embodiment is a multi-function bar, and functions as, for example, an M-Fn bar.

[0017] The camera 100 also has a grip section 120, a thumb rest section 121, a terminal cover 122, a lid 123, and a communication terminal 124. The grip section 120 is a holding section formed in a shape that is easy to hold with the right hand when the user holds the camera 100. The shutter button 101 and the main electronic dial 104 are arranged at positions that can be operated with the index finger of the right hand when the camera 100 is held by gripping the grip section 120 with the little finger, ring finger, and middle finger of the right hand. In the same state, the sub electronic dial 105 and the touch bar 119 are arranged at positions that can be operated with the thumb of the right hand. The thumb rest section 121 is a grip section provided on the rear side of the camera 100 at a position where it is easy to place the thumb of the right hand that holds the grip section 120 when none of the operation sections are being operated, and is made of a rubber member or the like for enhancing holding power (grip feeling). The terminal cover 122 protects connectors such as a connection cable that connects the camera 100 to an external device. The cover 123 protects the recording medium 228 and the slot by closing the slot for storing the recording medium 228 described later. The communication terminal 124 is a terminal for communicating with the detachable lens unit 200 described later from the camera 100. <Internal structure of the camera> Fig. 2 is a diagram showing an example of the internal configuration of the camera 100. Note that the same components as those described in Fig. 1 are given the same reference numerals and descriptions thereof will be omitted as appropriate. A lens unit 200 is attached to the camera 100.

[0018] First, the lens unit 200 will be described. The lens unit 200 is a type of interchangeable lens that is detachable from the camera 100. The lens unit 200 is a single lens, and is an example of a normal lens. The lens unit 200 has an aperture 201, a lens 202, an aperture drive circuit 203, an AF (autofocus) drive circuit 204, a lens system control circuit 205, and a communication terminal 206.

[0019] The aperture 201 is configured so that the aperture diameter can be adjusted. The lens 202 is composed of a plurality of lenses. The aperture drive circuit 203 adjusts the amount of light by controlling the aperture diameter of the aperture 201. The AF drive circuit 204 drives the lens 202 to adjust the focus. The lens system control circuit 205 controls the aperture drive circuit 203 and the AF drive circuit 204 based on an instruction from a system control unit 218 described later. The lens system control circuit 205 controls the aperture 201 via the aperture drive circuit 203, and adjusts the focus by displacing the position of the lens 202 via the AF drive circuit 204. The lens system control circuit 205 can communicate with the camera 100. Specifically, communication is performed via a communication terminal 206 of the lens unit 200 and a communication terminal 124 of the camera 100. The communication terminal 206 is a terminal through which the lens unit 200 communicates with the camera 100 side.

[0020] Next, a description will be given of the camera 100. The camera 100 has a shutter 210, an imaging unit 211, an A / D converter 212, a memory control unit 213, an image processing unit 214, a memory 215, a D / A converter 216, an EVF 217, a display unit 108, and a system control unit 218.

[0021] The shutter 210 is a focal plane shutter that can freely control the exposure time of the imaging unit 211 based on an instruction from the system control unit 218. The imaging unit 211 is an imaging element (image sensor) composed of a CCD or CMOS element that converts an optical image into an electric signal. The imaging unit 211 may include an imaging surface phase difference sensor that outputs defocus amount information to the system control unit 218. The A / D converter 212 converts an analog signal output from the imaging unit 211 into a digital signal. The image processing unit 214 performs predetermined processing (pixel interpolation, resizing such as reduction, color conversion processing, etc.) on data from the A / D converter 212 or data from the memory control unit 213. In addition, the image processing unit 214 performs predetermined arithmetic processing using the captured image data, and the system control unit 218 performs exposure control and focus detection control based on the obtained arithmetic result. Through these processes, TTL (through-the-lens) type AF processing, AE (automatic exposure) processing, EF (flash pre-emission) processing, etc. are performed. Furthermore, the image processing unit 214 performs a predetermined calculation process using the captured image data, and performs TTL type AWB (auto white balance) processing based on the obtained calculation results.

[0022] The image data from the A / D converter 212 is written to the memory 215 via the image processing unit 214 and the memory control unit 213. Alternatively, the image data from the A / D converter 212 is written to the memory 215 via the memory control unit 213 without going through the image processing unit 214. The memory 215 stores image data obtained by the imaging unit 211 and converted into digital data by the A / D converter 212, and image data to be displayed on the display unit 108 and the EVF 217. The memory 215 has a storage capacity sufficient to store a predetermined number of still images and a predetermined period of moving images and audio. The memory 215 also serves as a memory for displaying images (video memory).

[0023] The D / A converter 216 converts the image display data stored in the memory 215 into an analog signal and supplies it to the display unit 108 or the EVF 217. Therefore, the display image data written in the memory 215 is displayed on the display unit 108 or the EVF 217 via the D / A converter 216. The display unit 108 or the EVF 217 performs display according to the analog signal from the D / A converter 216. The display unit 108 or the EVF 217 is, for example, an LCD or an organic EL display. A digital signal that has been A / D converted by the A / D converter 212 and stored in the memory 215 is converted into an analog signal by the D / A converter 216, and the analog signal is sequentially transferred to and displayed on the display unit 108 or the EVF 217, thereby performing live view display.

[0024] The system control unit 218 is a control unit composed of at least one processor and / or at least one circuit. That is, the system control unit 218 may be a processor, a circuit, or a combination of a processor and a circuit. The system control unit 218 controls the entire camera 100. The system control unit 218 executes a program recorded in the non-volatile memory 220 to realize each process of a flowchart described later. The system control unit 218 also performs display control by controlling the memory 215, the D / A converter 216, the display unit 108, the EVF 217, etc.

[0025] The camera 100 also includes a system memory 219 , a non-volatile memory 220 , a system timer 221 , a communication unit 222 , an attitude detection unit 223 , and an eye proximity detection unit 118 .

[0026] The system memory 219 is, for example, a RAM. Constants and variables for the operation of the system control unit 218, and programs read from the nonvolatile memory 220 are deployed in the system memory 219. The nonvolatile memory 220 is an electrically erasable and recordable memory, for example, an EEPROM is used. Constants and programs for the operation of the system control unit 218 are recorded in the nonvolatile memory 220. The programs here are programs for executing a flowchart described later. The system timer 221 is a clock unit that measures the time used for various controls and the time of a built-in clock. The communication unit 222 transmits and receives video signals and audio signals to and from an external device connected wirelessly or by a wired cable. The communication unit 222 can also be connected to a wireless LAN (Local Area Network) or the Internet. The communication unit 222 can also communicate with an external device via Bluetooth (registered trademark) or Bluetooth Low Energy. The communication unit 222 can transmit images (including live images) captured by the imaging unit 211 and images recorded in the recording medium 228, and can receive image data and various other information from external devices. The attitude detection unit 223 detects the attitude of the camera 100 with respect to the direction of gravity. Based on the attitude detected by the attitude detection unit 223, it is possible to determine whether the image captured by the imaging unit 211 is an image captured with the camera 100 held horizontally or vertically. The system control unit 218 can add orientation information corresponding to the attitude detected by the attitude detection unit 223 to the image file of the image captured by the imaging unit 211, or rotate and record the image. The attitude detection unit 223 can use, for example, an acceleration sensor or a gyro sensor. It is also possible to use the attitude detection unit 223 to detect the movement of the camera 100 (panning, tilting, lifting, whether it is stationary, etc.).

[0027] The eyepiece detection unit 118 can detect the approach of an object to the eyepiece unit 116 of the eyepiece finder 117 incorporating the EVF 217. For example, an infrared proximity sensor can be used as the eyepiece detection unit 118. When an object approaches, infrared rays projected from a light projecting unit of the eyepiece detection unit 118 are reflected by the object and received by a light receiving unit of the infrared proximity sensor. The distance from the eyepiece unit 116 to the object can be determined based on the amount of infrared rays received. In this way, the eyepiece detection unit 118 performs eyepiece detection to detect the proximity of the object to the eyepiece unit 116. The eyepiece detection unit 118 is an eyepiece detection sensor that detects the approach (approach) and departure (away) of an eye (object) to the eyepiece unit 116 of the eyepiece finder 117. When an object is detected approaching within a predetermined distance from the non-eyepiece state (non-approach state), it detects that the eye has been placed in contact with the eyepiece unit 116. On the other hand, when an object that has been detected as approaching moves away from the eye-closed state (approaching state) by a distance greater than a predetermined distance, the system detects that the object has been moved away. The threshold for detecting the approach of the eye and the threshold for detecting the movement of the eye may be different, for example, by providing a hysteresis. After the approach of the eye is detected, the system is assumed to be in the eye-closed state until the movement of the eye is detected. After the movement of the eye is detected, the system is assumed to be in the non-eye-closed state until the movement of the eye is detected. The system control unit 218 switches between display (display state) / non-display (non-display state) of the display unit 108 and the EVF 217 according to the state detected by the eye-closed state detection unit 118. Specifically, when at least in the shooting standby state and the display destination switching setting is automatic switching, the display destination is set to the display unit 108 and the display is turned on while the eye is not placed in the eye-closed state, and the EVF 217 is turned off. Moreover, during the eye-closed state, the display destination is set to the EVF 217 and the display is turned on while the display unit 108 is turned off. The eye proximity detector 118 is not limited to an infrared proximity sensor, and other sensors may be used as long as they can detect a state that can be regarded as eye proximity.

[0028] The camera 100 also has an outside-finder display unit 107, an outside-finder display drive circuit 224, a power control unit 225, a power supply unit 226, a recording medium I / F 227, and an operation unit 229. The outside-finder display unit 107 displays various settings of the camera 100, such as the shutter speed and the aperture, via the outside-finder display drive circuit 224. The power control unit 225 is composed of a battery detection circuit, a DC-DC converter, a switch circuit for switching between blocks to be energized, and the like, and detects whether a battery is attached, the type of battery, and the remaining battery level. The power control unit 225 also controls the DC-DC converter based on the detection result and an instruction from the system control unit 218, and supplies the necessary voltage to each unit including the recording medium 228 for the necessary period. The power supply unit 226 is a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, or a Li battery, an AC adapter, or the like. The recording medium I / F 227 is an interface with the recording medium 228, such as a memory card or a hard disk. The recording medium 228 is a memory card or the like for recording captured images, and is composed of a semiconductor memory, a magnetic disk, etc. The recording medium 228 may be removable or may be built-in.

[0029] The operation unit 229 is an input unit that accepts operations from the user (user operations) and is used to input various instructions to the system control unit 218. The operation unit 229 includes the shutter button 101, the power switch 102, the mode switching switch 103, the touch panel 109, and other operation units 230. The other operation units 230 include the main electronic dial 104, the sub electronic dial 105, the video button 106, the direction keys 110, the SET button 111, the AE lock button 112, the enlargement button 113, the playback button 114, the menu button 115, and the touch bar 119.

[0030] The shutter button 101 includes a first shutter switch 231 and a second shutter switch 232. The first shutter switch 231 is turned on when the shutter button 101 is pressed halfway (instruction to prepare for shooting) during operation, and generates a first shutter switch signal SW1. The system control unit 218 starts preparation processes for shooting, such as AF processing, AE processing, AWB processing, and EF processing, in response to the first shutter switch signal SW1. The second shutter switch 232 is turned on when the shutter button 101 is pressed fully (instruction to shoot) and generates a second shutter switch signal SW2. The system control unit 218 starts a series of shooting processes, from reading out a signal from the imaging unit 211 to generating an image file including a shot image and writing it to the recording medium 228, in response to the second shutter switch signal SW2.

[0031] The mode changeover switch 103 changes the operation mode of the system control unit 218 to one of a still image shooting mode, a video shooting mode, a playback mode, etc. The still image shooting modes include an auto shooting mode, an auto scene determination mode, a manual mode, an aperture priority mode (Av mode), a shutter speed priority mode (Tv mode), and a program AE mode (P mode). In addition, various scene modes that are shooting settings according to shooting scenes, custom modes, etc. are included. The user can directly switch to one of the above-mentioned shooting modes by the mode changeover switch 103. Alternatively, the user can selectively switch to one of the displayed modes by using the operation unit 229 after once switching to a list screen of shooting modes by the mode changeover switch 103. Similarly, the video shooting mode may also include a plurality of modes.

[0032] The touch panel 109 is a touch sensor that detects various touch operations on the display surface of the display unit 108 (the operation surface of the touch panel 109). The touch panel 109 and the display unit 108 can be configured as one unit. For example, the touch panel 109 is attached to the upper layer of the display surface of the display unit 108 so that the light transmittance does not interfere with the display of the display unit 108. Then, by associating input coordinates on the touch panel 109 with display coordinates on the display surface of the display unit 108, a GUI (Graphical User Interface) can be configured as if the user could directly operate the screen displayed on the display unit 108. The touch panel 109 can be any of various types such as a resistive film type, a capacitive type, a surface acoustic wave type, an infrared type, an electromagnetic induction type, an image recognition type, and an optical sensor type. There are types that detect a touch by contact with the touch panel 109, and types that detect a touch by approaching a finger or a pen to the touch panel 109, but any type may be used.

[0033] The system control unit 218 can detect the following operations or states on the touch panel 109. A finger or pen that has not been touching the touch panel 109 touches the touch panel 109 again, that is, the start of touching (hereinafter referred to as Touch-Down). A state in which the touch panel 109 is touched with a finger or a pen (hereinafter referred to as Touch-On). The touch panel 109 is moved while being touched by a finger or a pen (hereinafter referred to as Touch-Move). The finger or pen that has been touching the touch panel 109 is removed (released) from the touch panel 109, that is, the touch ends (hereinafter, referred to as "touch-up"). A state in which nothing is being touched on the touch panel 109 (hereinafter referred to as Touch-Off).

[0034] When touch-down is detected, touch-on is also detected at the same time. After touch-down, touch-on will usually continue to be detected unless touch-up is detected. If touch-move is detected, touch-on will also be detected at the same time. Even if touch-on is detected, touch-move will not be detected if the touch position does not move. After it is detected that all fingers or pens that were touching have touched up, touch-off will occur.

[0035] These operations and states, and the position coordinates of the touch panel 109 touched by a finger or pen are notified to the system control unit 218 via the internal bus. The system control unit 218 determines what kind of operation (touch operation) has been performed on the touch panel 109 based on the notified information. For touch-move, the moving direction of the finger or pen moving on the touch panel 109 can also be determined for each vertical component and horizontal component on the touch panel 109 based on the change in the position coordinates. When a touch-move of a predetermined distance or more is detected, it is determined that a slide operation has been performed. An operation in which a finger is touched on the touch panel 109, quickly moved for a certain distance, and then released is called a flick. In other words, a flick is an operation in which a finger is quickly traced on the touch panel 109 as if flicking it. When a touch-move of a predetermined distance or more at a predetermined speed or more is detected and a touch-up is detected as it is, it is determined that a flick has been performed (it can be determined that a flick has occurred following a slide operation). Furthermore, a touch operation in which multiple points (for example, two points) are touched together (multi-touch) and the touch positions are brought closer together is called a pinch in, and a touch operation in which the touch positions are moved farther apart is called a pinch out. Pinch out and pinch in are collectively called a pinch operation (or simply pinch). <Lens unit configuration> Fig. 3 is a schematic diagram showing an example of the configuration of lens unit 300. Fig. 3 shows a state in which lens unit 300 is attached to camera 100. Note that, among the camera 100 shown in Fig. 3, the same configurations as those explained in Fig. 2 are given the same reference numerals and explanations thereof will be omitted as appropriate.

[0036] Lens unit 300 is a type of interchangeable lens that can be attached to and detached from camera 100. Lens unit 300 is a twin lens that can capture images with parallax between left and right images. Lens unit 300 has two optical systems, each with a wide viewing angle of approximately 180 degrees, and can capture the range of the front hemisphere. Specifically, the two optical systems of lens unit 300 can capture an object with a viewing field (angle of view) of 180 degrees in the left-right direction (horizontal angle, azimuth angle, yaw angle) and 180 degrees in the up-down direction (vertical angle, elevation angle, pitch angle).

[0037] The lens unit 300 includes a right-eye optical system 301R having a plurality of lenses and a reflecting mirror, a left-eye optical system 301L having a plurality of lenses and a reflecting mirror, a lens system control circuit 303, a lens mount unit 304, and a communication terminal 306. The right-eye optical system 301R corresponds to one of the first optical system and the second optical system, and the left-eye optical system 301L corresponds to the other of the first optical system and the second optical system. In the right-eye optical system 301R and the left-eye optical system 301L, the lenses 302R and 302L located on the subject side face in the same direction, and their optical axes are approximately parallel. The lens unit 300 of this embodiment is a lens for VR180 for taking images for so-called VR180, which is a VR image format capable of two-eye stereoscopic vision. The lens for VR180 includes fisheye lenses that allow the right-eye optical system 301R and the left-eye optical system 301L to capture a range of approximately 180 degrees. The VR180 lens may be a lens capable of capturing a wide viewing angle range of about 160 degrees narrower than the 180-degree range as long as the right-eye optical system 301R and the left-eye optical system 301L can obtain images capable of two-eye VR display as VR180. The VR180 lens can form a right image (first image) formed via the right-eye optical system 301R and a left image (second image) formed via the left-eye optical system 301L having parallax from the right image, on one or two imaging elements of the attached camera.

[0038] The lens unit 300 also includes motors 307 and 308 for focus adjustment and a changeover switch (mode switching means) 309. The motor 307 simultaneously performs focus adjustment of a right image formed through the right eye optical system 301R and a left image formed through the left eye optical system 301L. The motor 308 performs focus adjustment of one of the right image formed through the right eye optical system 301R and the left image formed through the left eye optical system 301L. The changeover switch 309 can switch which of the motors 307 and 308 is driven. By driving the motor 308, the mode is switched to an adjustment mode for adjusting the difference between the left and right.

[0039] The lens unit 300 is attached to the camera 100 via the lens mount section 304 and the camera mount section 305 of the camera 100. By attaching the lens unit 300 to the camera 100, the system control section 218 and the lens system control circuit 303 are electrically connected via the communication terminals 124 and 306. In this embodiment, a right image formed via the right eye optical system 301R and a left image formed via the left eye optical system 301L having a parallax from the right image are formed side by side in the imaging section 211. That is, two optical images formed by the right eye optical system 301R and the left eye optical system 301L are formed on one imaging element. The imaging section 211 converts the subject image (optical signal) into an analog electrical signal. In this way, by using the lens unit 300, two images with parallax can be simultaneously obtained (as a set) from two locations (optical systems) of the right eye optical system 301R and the left eye optical system 301L. Furthermore, by dividing the acquired image into an image for the left eye and an image for the right eye and displaying them in VR, the user can view a stereoscopic VR image with a range of approximately 180 degrees, so-called VR180.

[0040] Here, the VR image is an image that can be displayed in VR, which will be described later. The VR image includes an omnidirectional image (spherical image) captured by an omnidirectional camera (spherical camera), a panoramic image having a wider image range (effective image range) than the display range that can be displayed at one time on a display unit, and the like. In addition, the VR image is not limited to a still image, but also includes a video and a live image (image acquired from a camera in almost real time). The VR image has an image range (effective image range) of a field of view of 360 degrees in the left and right directions and 360 degrees in the up and down directions at maximum. In addition, the VR image includes an image having a wider angle of view than the angle of view that can be captured by a normal camera, or a wider image range than the display range that can be displayed at one time on a display unit, even if it is less than 360 degrees in the left and right directions or less than 360 degrees in the up and down directions. The image captured by the camera 100 using the lens unit 300 described above is a type of VR image. The VR image can be displayed in VR by, for example, setting the display mode of a display device (a display device that can display a VR image) to "VR view". By displaying a VR image with a 360-degree angle of view in VR and changing the position of the display device left and right (horizontal rotation direction), the user can view seamless omnidirectional images in the left and right directions.

[0041] Here, VR display (VR view) is a display method (display mode) that can change the display range and displays an image of a VR image with a field of view corresponding to the posture of the display device. VR display includes "single-eye VR display (single-eye VR view)" that displays one image by performing a transformation (transformation in which distortion correction is performed) that maps a VR image onto a virtual sphere. VR display also includes "two-eye VR display (two-eye VR view)" that displays a VR image for the left eye and a VR image for the right eye side by side in the left and right regions by performing a transformation that maps the VR image onto a virtual sphere, respectively. Stereoscopic vision is possible by performing "two-eye VR display" using a VR image for the left eye and a VR image for the right eye that have parallax from each other. In any VR display, for example, when a user wears a display device such as an HMD (head-mounted display), an image with a field of view corresponding to the direction of the user's face is displayed. For example, assume that a VR image with a field of view centered on 0 degrees left and right (a specific direction, for example, north) and 90 degrees up and down (90 degrees from the zenith, i.e., horizontal) is displayed at a certain point in time. When the attitude of the display device is inverted from this state (for example, the display surface is changed from facing south to facing north), the display range of the same VR image is changed to an image with a field of view centered on 180 degrees in the left-right direction (the opposite direction, for example, south) and 90 degrees in the up-down direction. That is, when the user faces from north to south (i.e. turns backwards) while wearing the HMD, the image displayed on the HMD is also changed from a north image to a south image. Note that the VR image captured using the lens unit 300 of this embodiment is a VR180 image captured in a range of approximately 180 degrees forward, and no image exists in a range of approximately 180 degrees backward. When such a VR180 image is VR displayed and the attitude of the display device is changed to the side where no image exists, a blank area is displayed.

[0042] By displaying the VR image in this way, the user feels as if he or she is visually inside the VR image (in the VR space). The method of displaying the VR image is not limited to changing the posture of the display device. For example, the display range may be moved (scrolled) in response to user operation via a touch panel or directional buttons, etc. During VR display (when in the "VR view" display mode), in addition to changing the display range due to posture changes, the display range may also be changed in response to touch-move on the touch panel, dragging with a mouse, pressing a directional button, etc. A smartphone attached to VR goggles (head-mounted adapter) is a type of HMD. <Configuration of the imaging element in the imaging unit> Fig. 4 is a schematic diagram showing an example of a pixel array of an image sensor in the imaging unit 211. In Fig. 4, the pixel array of a two-dimensional CMOS sensor used as an image sensor is shown in a range of 4 columns x 4 rows of imaging pixels (a range of 8 columns x 4 rows as an array of focus detection pixels). Note that the focus detection pixels are pixels that receive light beams that pass through different pupil partial regions of the imaging optical system.

[0043] In this embodiment, the pixel group 400 is composed of pixels arranged in 2 columns by 2 rows, and is covered with color filters in a Bayer array. In the pixel group 400, a pixel 400R having a spectral sensitivity of R (red) is arranged at the upper left position, a pixel 400G having a spectral sensitivity of G (green) is arranged at the upper right and lower left positions, and a pixel 400B having a spectral sensitivity of B (blue) is arranged at the lower right position. Furthermore, in order for the image sensor to perform focus detection using an image plane phase difference method, each pixel holds multiple photodiodes (photoelectric conversion units) for one microlens 401. In this embodiment, each pixel is composed of photodiodes 402 and 403 arranged in 2 columns by 1 row.

[0044] The image sensor is capable of acquiring an image signal and a focusing signal by arranging a large number of pixel groups 400, each of which is made up of 2 columns×2 rows of pixels (4 columns×2 rows of photodiodes), on an imaging surface.

[0045] In each pixel having such a configuration, a light beam is separated by a microlens 401 and an image is formed on the photodiodes 402 and 403. A signal (A+B signal) obtained by adding the signals from the photodiodes 402 and 403 is used as an imaging signal, and a pair of focus detection signals (A and B image signals) read out from the photodiodes 402 and 403 are used as a focusing signal. The imaging signal and the focusing signal may be read out separately, but in consideration of the processing load, the following may be used. That is, the imaging signal (A+B signal) and one of the focusing signals (e.g., A signal) of the photodiodes 402 and 403 may be read out, and the other focusing signal (e.g., B signal) may be obtained by taking the difference.

[0046] In this embodiment, each pixel has the photodiodes 402 and 403 for one microlens 401, but the number of photodiodes is not limited to two and may be more than two. Also, a plurality of pixels having different opening positions of the light receiving portion for the microlens 401 may be provided. In other words, any configuration may be used as long as two signals for phase difference detection, such as an A image signal and a B image signal, can be obtained as a result.

[0047] Also, while FIG. 4 shows a configuration in which all pixels have multiple photodiodes, this is not limiting, and focus detection pixels may be provided discretely within normal pixels that make up the image sensor. <Left-right difference adjustment notification> FIG. 5 is a flowchart showing the left-right difference adjustment notification process.

[0048] In step S501, the system control unit (first focus detection means) 218 ​​acquires the defocus amount (def1) of the left eye optical system 301L.

[0049] In step S502, the system control unit (second focus detection means) 218 ​​acquires the defocus amount (def2) of the right eye optical system 301R.

[0050] The processing of steps S501 and S502 may be performed in the reverse order.

[0051] In step S503, the system control unit 218 obtains the difference (Δdef) between the defocus amounts of the left eye optical system 301L and the right eye optical system 301R from the defocus amounts (def1, def2) obtained in steps S501 and S502.

[0052] In step S504, the system control unit (setting means) 218 ​​acquires a predetermined value (first predetermined value) Th1. The predetermined value Th1 is a preset value, and is used to determine whether or not to perform a notification when there is a difference in the defocus amount between the left eye optical system 301L and the right eye optical system 301R. In this embodiment, the predetermined value Th1 is a preset value, but the user may set it from a menu screen. The predetermined value Th1 may be set according to the state of the camera 100. For example, the predetermined value Th1 during standby may be set smaller than during shooting to make it easier to recognize the difference between the left and right before shooting begins, and the predetermined value Th1 may be set larger when there is camera shake or when shooting a moving object, since it is easily affected by focus detection errors. In addition, it is not limited to the above example, and may be changed according to parameters such as shooting distance and aperture value. In addition, in order to avoid frequent changes in the notification state, the predetermined value Th1 may be set smaller if a notification is being performed.

[0053] In step S505, the system control unit 218 determines whether the difference (Δdef) in the defocus amount between the left eye optical system 301L and the right eye optical system 301R calculated in step S503 is greater than the predetermined value Th1 acquired in step S504. If the system control unit 218 determines that the difference (Δdef) in the defocus amount is greater than the predetermined value Th1, it executes the process of step S506, and if it determines that the difference (Δdef) in the defocus amount is smaller than the predetermined value Th1, it executes the process of step S511. Note that if the difference (Δdef) in the defocus amount is equal to the predetermined value Th1, it is possible to arbitrarily set which step to execute.

[0054] In step S506, the system control unit 218 acquires the setting state of the focus detection area. The focus detection area is set based on the subject detection result when the reliability of the subject detection result detected by the system control unit (subject detection means) 218 ​​is high, and is set based on the focus frames (601R, 601L described later) that are set in advance when the reliability is low. The subject detection result is the position, size, etc. of the subject.

[0055] In step S507, the system control unit 218 determines whether the focus detection area is set based on the subject detection result. If the focus detection area is set based on the subject detection result, there is a low possibility that the difference in the defocus amount is large due to different subjects in the focus detection area on the left and right due to the influence of parallax, etc. On the other hand, if the focus detection area is not set based on the subject detection result, there is a possibility that the focus detection area on the left and right are different subjects. If the system control unit 218 determines that the focus detection area is set based on the subject detection result, it executes the process of step S510, and if it determines that the focus detection area is not set based on the subject detection result, it executes the process of step S508.

[0056] In step S508, the system control unit 218 acquires image signals of the focus detection areas of the left eye optical system 301L and the right eye optical system 301R, and calculates the degree of correlation between the focus detection areas of the left eye optical system 301L and the right eye optical system 301R.

[0057] In step S509, the system control unit 218 determines whether the correlation degree calculated in step S508 is greater than a predetermined value (second predetermined value) Th2. If the system control unit 218 determines that the correlation degree is greater than the predetermined value Th2, it executes the process of step S510, and if it determines that the correlation degree is smaller than the predetermined value Th2, it executes the process of step S511. Note that, when the correlation degree is equal to the predetermined value Th2, it is possible to arbitrarily set which step of the process to execute. Also, the predetermined value Th2 is a value that is set in advance in this embodiment, but it may be possible for the user to set it from a menu screen, or it may be set according to the state of the camera 100.

[0058] In step S510, the system control unit 218 judges whether the defocus amount (def1) of the left-eye optical system 301L acquired in step S501 is smaller than a predetermined value (third predetermined value) Th3. When the system control unit 218 judges that the defocus amount (def1) is smaller than the predetermined value Th3, it executes the process of step S512, and when the system control unit 218 judges that the defocus amount (def1) is larger than the predetermined value Th3, it executes the process of step S511. When the defocus amount (def1) is equal to the predetermined value Th3, it is possible to arbitrarily set which step to execute. In addition, the predetermined value Th3 is a value set in advance in this embodiment, but it may be set by the user from a menu screen, or it may be set according to the state of the camera 100. In addition, in this embodiment, the left-eye optical system 301L is used as a reference, but this is not limited thereto, and the defocus amount (def2) of the right-eye optical system 301R may be compared with the predetermined value Th3 by using the right-eye optical system 301R as a reference.

[0059] In step S511, if system control unit 218 has not yet notified, it ends this flow without making any notification, and if notification is in progress, it stops the notification and ends this flow.

[0060] In step S512, the system control unit (notification means) 218 ​​notifies the user of the left-right difference adjustment. The left-right difference adjustment is performed by comparing the left and right images, so it is desirable to perform the adjustment in a focused state. Therefore, when the left eye optical system 301L, which is the reference, is in a focused state, a notification is given to prompt the user to adjust the left-right difference. <Notification display> 6 and 7 are diagrams showing examples of displaying a notice of left-right difference adjustment according to the state of the subject. 6 and 7 show different display examples.

[0061] 6(a) and 7(a) show a case where the difference Δdef in the defocus amount is smaller than a predetermined value Th1, the focus detection area is set based on the focus frames 601L and 601R rather than the subject detection result, and the left-right correlation degree is greater than a predetermined value Th2. In this case, the process of notifying the left-right difference adjustment ends without notification based on the determination in step S505 in FIG. 5, so no notification is displayed.

[0062] 6(b) and 7(b) show a case where the difference Δdef in the defocus amount is larger than a predetermined value Th1, and the focus detection area is set based on the subject detection areas 602L, 602R of the subject detection result. In this case, notification is performed after the determination in steps S505 and S507 in FIG. 5. In FIG. 6(b), notification is performed by displaying a notification icon 603, and in FIG. 7(b), notification is performed by changing the display of the focus frame 601R to a dotted line. Note that the notification method is not limited to this, and notification may be performed by simultaneously displaying the icon and changing the display of the focus frame, changing the color of the focus frame, or blinking it.

[0063] Figures 6(c) and 7(c) show a case where the difference Δdef in the defocus amount is larger than a predetermined value Th1, the focus detection area is set based on the focus frames 601L and 601R rather than the subject detection result, and the left-right correlation degree is larger than a predetermined value Th2. In this case, notification is performed after the determinations in steps S505, S507, and S509 in Figure 5. In Figures 6(c) and 7(c), notification is performed in the same manner as in Figures 6(b) and 7(b), respectively.

[0064] 6(d) and 7(d) show a case where the difference Δdef in the defocus amount is greater than a predetermined value Th1, the focus detection area is set based on the focus frames 601L and 601R rather than the subject detection result, and the left-right correlation degree is less than a predetermined value Th2. In this case, no notification is displayed after the determinations in steps S505, S507, and S509 in FIG. 5. In this way, by determining whether the subjects in the left-right focus detection area are the same using the left-right correlation degree, it is possible to eliminate the defocus amount difference caused by performing focus detection on different left-right subjects, and to suppress notification when left-right adjustment is not necessary.

[0065] As described above, in this embodiment, when the difference between the focus detection results of the left image and the right image is greater than a predetermined value and the focus detection area satisfies various conditions, a notification is given to the user to prompt the user to adjust the left-right difference. By notifying the user to adjust the left-right difference, the user can correctly recognize that there is a left-right difference and that adjustment is necessary, and can adjust the left-right difference, so that the left-right difference can be eliminated without affecting the captured image. <Automatic left-right difference adjustment> FIG. 8 is a flowchart showing the automatic left-right difference adjustment process.

[0066] In step S801, the system control unit 218 executes the left-right difference adjustment notification process of FIG.

[0067] In step S802, the system control unit 218 determines whether or not there is a notification as a result of the left-right difference adjustment notification process executed in step S801. If the system control unit 218 determines that there is a notification, it executes the process of step S803, and if it determines that there is no notification, it ends this flow.

[0068] In step S803, the system control unit 218 determines whether the changeover switch 309 has been operated to switch to the adjustment mode. If the system control unit 218 determines that the mode has been switched to the adjustment mode, it executes the process of step S804, and if it determines that the mode has not been switched to the adjustment mode, it ends this flow.

[0069] In step S804, the system control unit 218 drives the motor 308 based on the difference Δdef in the defocus amount acquired in step S503, and adjusts the difference between the left and right.

[0070] In this way, when the adjustment mode is switched to in the state where there is a left-right difference adjustment notification, the left-right difference adjustment is automatically performed based on the detected left-right difference because the user recognizes the left-right difference by the notification and switches to the adjustment mode. This allows the left-right difference to be adjusted without any additional action by the user.

[0071] The disclosure of this embodiment includes the following configuration. (Configuration 1) an image sensor having a plurality of focus detection pixels that receive light beams passing through different pupil partial regions of an imaging optical system; a first focus detection unit that obtains a defocus amount of the first optical system based on a pair of signals from the focus detection pixels; a second focus detection unit that obtains a defocus amount of the second optical system based on a pair of signals from the focus detection pixels; a notification unit that issues a notification to prompt the user to adjust the first optical system or the second optical system, The imaging device, wherein the notification means performs the notification when a difference between a defocus amount of the first optical system and a defocus amount of the second optical system is greater than a first predetermined value. (Configuration 2) The imaging device described in configuration 1, characterized in that the notification means performs the notification when a degree of correlation between the focus detection area of ​​the first focus detection means and the focus detection area of ​​the second focus detection means is greater than a second predetermined value. (Configuration 3) 3. The imaging device according to configuration 2, wherein at least one of the first predetermined value and the second predetermined value is set according to a state of the imaging device. (Configuration 4) The camera further includes an object detection unit for detecting the position and size of an object, An imaging device described in any one of configurations 1 to 3, characterized in that the notification means performs the notification when the focus detection area of ​​the first focus detection means and the focus detection area of ​​the second focus detection means are set by the detection result of the subject detection means. (Configuration 5) the imaging device is capable of performing a live view display using a captured image; 5. The imaging device according to any one of configurations 1 to 4, wherein the notification means performs the notification on the live view display. (Configuration 6) An imaging device described in any one of configurations 1 to 5, characterized in that when the difference is greater than the first predetermined value, the notification means changes at least one of the display of the focus detection area of ​​the first focus detection means and the display of the focus detection area of ​​the second focus detection means from the display when the difference is smaller than the first predetermined value. (Configuration 7) 7. The imaging device according to any one of configurations 1 to 6, further comprising a setting unit that sets the first predetermined value in response to a user operation. (Configuration 8) an adjustment unit that adjusts the first optical system or the second optical system; a switching unit that switches a mode of the imaging device to an adjustment mode in which the adjustment unit performs the adjustment, The imaging device according to any one of configurations 1 to 7, characterized in that when the mode of the imaging device is switched to the adjustment mode while the notification is being made, the adjustment means performs the adjustment based on the difference. (Configuration 9) The imaging device described in any one of configurations 1 to 8, characterized in that the notification means performs the notification when the defocus amount of the first optical system or the defocus amount of the second optical system is smaller than a third predetermined value. (Configuration 10) 10. The imaging device according to configuration 9, wherein at least one of the first predetermined value and the third predetermined value is set according to a state of the imaging device.

[0072] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. [Explanation of symbols]

[0073] 100 Digital camera (imaging device) 218 System control unit (first focus detection means, second focus detection means, notification means)

Claims

1. an image sensor having a plurality of focus detection pixels that receive light beams passing through different pupil partial regions of an imaging optical system; a first focus detection unit that obtains a defocus amount of a first optical system based on a pair of signals from the focus detection pixels; a second focus detection unit that obtains a defocus amount of the second optical system based on a pair of signals from the focus detection pixels; a notification unit that issues a notification to prompt the user to adjust the first optical system or the second optical system, The imaging apparatus, wherein the notification unit issues the notification when a difference between a defocus amount of the first optical system and a defocus amount of the second optical system is greater than a first predetermined value.

2. 2. The imaging apparatus according to claim 1, wherein the notification means issues the notification when a degree of correlation between the focus detection area of ​​the first focus detection means and the focus detection area of ​​the second focus detection means is greater than a second predetermined value.

3. 3. The imaging device according to claim 2, wherein at least one of the first predetermined value and the second predetermined value is set according to a state of the imaging device.

4. The camera further includes an object detection unit for detecting the position and size of an object, 2. The imaging device according to claim 1, wherein the notification means performs the notification when a focus detection area of ​​the first focus detection means and a focus detection area of ​​the second focus detection means are set by a detection result of the subject detection means.

5. the imaging device is capable of performing a live view display using a captured image; 5. The imaging apparatus according to claim 1, wherein the notification unit performs the notification on the live view display.

6. The imaging device described in any one of claims 1 to 4, characterized in that, when the difference is greater than the first predetermined value, the notification means changes at least one of the display of the focus detection area of ​​the first focus detection means and the display of the focus detection area of ​​the second focus detection means from the display when the difference is smaller than the first predetermined value.

7. 5. The imaging apparatus according to claim 1, further comprising a setting unit that sets the first predetermined value in response to a user operation.

8. an adjustment unit that adjusts the first optical system or the second optical system; a switching unit that switches a mode of the imaging device to an adjustment mode in which the adjustment unit performs the adjustment, 5. The imaging device according to claim 1, wherein the adjustment unit performs the adjustment based on the difference when the mode of the imaging device is switched to the adjustment mode while the notification is being made.

9. 5. The imaging apparatus according to claim 1, wherein the notification unit issues the notification when the defocus amount of the first optical system or the defocus amount of the second optical system is smaller than a third predetermined value.

10. 10. The imaging device according to claim 9, wherein at least one of the first predetermined value and the third predetermined value is set according to a state of the imaging device.

Images