Imaging apparatus, method for controlling imaging apparatus, program, and storage medium

Abstract

To easily and sufficiently reduce unintended positional deviation of a subject in a picked-up image.SOLUTION: An imaging apparatus of the present invention has: first acquisition means that acquires information on inclination of the imaging apparatus; second acquisition means that, when a specific lens is mounted on the imaging apparatus, acquires information on an inclination of the specific lens; and control means that performs control to notify a user of the inclination of the imaging apparatus on the basis of the information acquired by the first acquisition means, and performs control to notify the user of the inclination of the specific lens on the basis of the information acquired by the second acquisition means.SELECTED DRAWING: Figure 6

Description

[Technical field]

[0001] The present invention relates to an imaging apparatus, a control method for an imaging apparatus, a program, and a storage medium. [Background technology]

[0002] A digital camera having two optical systems is known. If the two optical systems are arranged to capture images in the same direction, two images with parallax can be obtained using the two optical systems, and an image with a range of 180 degrees (an image of a hemisphere) or an image that can be viewed stereoscopically can be created from the two images obtained. If the two optical systems are arranged to capture images in opposite directions, an image with a range of 360 degrees (an image of the entire celestial sphere) can be created from the two images obtained using the two optical systems.

[0003] In a digital camera having two optical systems, an unintended positional shift of a subject may occur in two images captured using the two optical systems. For example, when performing stereoscopic vision, such a positional shift can cause eye fatigue and strabismus. The positional shift can be reduced by image processing, but the larger the positional shift, the greater the load on the image processing. Therefore, it is preferable that the positional shift is small. If the digital camera (the two optical systems on the left and right) is held horizontally, an image with less positional shift can be obtained compared to when the digital camera is not held horizontally.

[0004] Patent Document 1 discloses a technique for displaying a horizontal reference line that indicates the horizontal direction of the camera itself, and a horizontal shooting auxiliary line that corresponds to the inclination of the camera. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] JP 2002-271654 A Summary of the Invention [Problem to be solved by the invention]

[0006] However, simply leveling the camera may not be enough to reduce unintended positional deviation of the subject in the captured image. In particular, when obtaining an image that allows stereoscopic viewing, even a slight positional deviation is not tolerated, and simply leveling the camera may not be enough to reduce the positional deviation. With conventional cameras, it is difficult to sufficiently reduce the positional deviation.

[0007] An object of the present invention is to easily and sufficiently reduce unintended positional displacement of a subject in a captured image. [Means for solving the problem]

[0008] The imaging device of the present invention is an imaging device characterized in having a first acquisition means for acquiring information on the tilt of the imaging device, a second acquisition means for acquiring information on the tilt of a specific lens when a specific lens is attached to the imaging device, and a control means for controlling the imaging device to notify the tilt of the imaging device based on the information acquired by the first acquisition means, and for controlling the imaging device to notify the tilt of the specific lens based on the information acquired by the second acquisition means. Effect of the Invention

[0009] According to the present invention, unintended positional displacement of a subject in a captured image can be easily and sufficiently reduced. [Brief description of the drawings]

[0010] [Figure 1] 1 is a schematic diagram showing the overall configuration of a system according to a first embodiment. [Diagram 2] 1 is an external view of a camera according to a first embodiment. [Diagram 3] FIG. 1 is a block diagram showing a configuration of a camera according to a first embodiment. [Figure 4] 1 is a schematic diagram showing a configuration of a lens unit according to a first embodiment. [Diagram 5] FIG. 2 is a schematic diagram showing lens information and camera information according to the first embodiment. [Figure 6] 5 is a flowchart showing the operation of the camera according to the first embodiment. [Figure 7] FIG. 2 is a schematic diagram showing a screen according to the first embodiment. [Figure 8] FIG. 11 is a schematic diagram showing a screen according to the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0012] <Embodiment 1> In the first embodiment, an example will be described in which, when a specific lens unit (specific lens) is attached to a digital camera (imaging device), the digital camera notifies a user of the inclination of the digital camera and the inclination of the lens unit. A case will be described in which the specific lens unit is a twin lens unit (twin lens) for obtaining an image that can be viewed stereoscopically, but the specific lens unit is not particularly limited. For example, the specific lens unit may be a twin lens unit for obtaining a spherical image, a compound lens unit (compound lens) having three or more optical systems, or an anamorphic lens unit (anamorphic lens).

[0013] Fig. 1 is a schematic diagram showing an example of the overall configuration of a system according to embodiment 1. The system according to embodiment 1 includes a digital camera (camera) 100 and a lens unit attached to the camera 100. In Fig. 1, a lens unit 300 is attached (connected) to the camera 100. Details of the lens unit 300 will be described later, but by attaching the lens unit 300, the camera 100 becomes able to capture one image (still image or video) including two image areas having a predetermined parallax.

[0014] 2(A) and 2(B) are external views showing an example of the appearance of camera 100. Fig. 2(A) is a perspective view of camera 100 seen from the front side, and Fig. 2(B) is a perspective view of camera 100 seen from the rear side.

[0015] The camera 100 has a shutter button 101, a power switch 102, a mode switch 103, a main electronic dial 104, a sub electronic dial 105, a movie button 106, and a viewfinder display 107 on the top surface. The shutter button 101 is an operation member for issuing a shooting preparation instruction or a shooting instruction. The power switch 102 is an operation member for switching the power of the camera 100 on and off. The mode switch 103 is an operation member for switching between various modes. The main electronic dial 104 is a rotary operation member for changing settings such as shutter speed and aperture. The sub electronic dial 105 is a rotary operation member for moving a selection frame (cursor) and forwarding images. The movie button 106 is an operation member for issuing an instruction to start or stop movie shooting (recording). The viewfinder display 107 displays various settings such as shutter speed and aperture.

[0016] The camera 100 has, on the rear surface thereof, a display unit 108, a touch panel 109, direction keys 110, a SET button 111, an AE lock button 112, a magnification button 113, a playback button 114, a menu button 115, an eyepiece unit 116, an eyepiece detection unit 118, and a touch bar 119. The display unit 108 displays images and various information. The touch panel 109 is a display surface of the display unit 108. The main electronic dial 104 is an operation member that detects a touch operation on the touch operation surface (touch operation surface). The directional key 110 is an operation unit composed of keys (four-way key) that can be pressed up, down, left, and right. Processing according to the position where the directional key 110 is pressed can be performed. The SET button 111 is an operation member that is pressed mainly when deciding a selection item. The AE lock button 112 is an operation member that is pressed when fixing an exposure state in a shooting standby state. The enlargement button 113 is an operation member for switching the enlargement mode on and off in the live view display (LV display) of the shooting mode. When the enlargement mode is on, the live view image (LV image) is enlarged or reduced by operating the main electronic dial 104. The enlargement button 113 is also used when enlarging a playback image or increasing the magnification ratio in the playback mode. The playback button 114 is an operation member for switching between the shooting mode and the playback mode. In the shooting mode, pressing the playback button 114 switches to the playback mode, and the latest image among the images recorded on the recording medium 227 described later can be displayed on the display unit .

[0017] Menu button 115 is an operation member that is pressed to display a menu screen on display unit 108 that allows various settings to be made. A user can intuitively make various settings using the menu screen displayed on display unit 108, direction key 110, and SET button 111. Eyepiece unit 116 is a portion that is used to put one's eye close to eyepiece finder (peek-in type finder) 117 and peer into it. Through eyepiece unit 116, a user can view an image displayed on an EVF 217 (Electronic View Finder) (described later) inside camera 100. Eyepiece detection unit 118 is a sensor that detects whether or not the user has put his / her eye close to eyepiece unit 116 (eyepiece finder 117).

[0018] The touch bar 119 is a line-shaped touch operation member (line touch sensor) capable of receiving a touch operation. The touch bar 119 is disposed at a position where it can be touched (touched) by the thumb of the right hand when the grip unit 120 is held in the right hand (held with the little finger, ring finger, and middle finger of the right hand) so that the shutter button 101 can be pressed with the index finger of the right hand. That is, the touch bar 119 can be operated in a state (shooting posture) where the eyepiece unit 116 is looked into by putting the eyepiece 117 close to the eyepiece finder 117 and the user is ready to press the shutter button 101 at any time. The touch bar 119 can receive a tap operation (operation of touching and releasing the touch position without moving it within a predetermined period of time) on the touch bar 119, a slide operation to the left and right (operation of touching and then moving the touch position while keeping the touch) and the like. The touch bar 119 is an operation member different from the touch panel 109, and does not have a display function. The touch bar 119 functions as, for example, a multi-function bar (M-Fn bar) to which various functions can be assigned.

[0019] The camera 100 also includes a grip section 120, a thumb rest section 121, a terminal cover 122, a lid 123, a communication terminal 124, and the like. The grip section 120 is a holding section formed in a shape that is easy to hold with the right hand when the user holds the camera 100. The shutter button 101 and the main electronic dial 104 are arranged at positions that can be operated with the index finger of the right hand when the camera 100 is held by gripping the grip section 120 with the little finger, ring finger, and middle finger of the right hand. In a similar state, the sub electronic dial 105 and the touch bar 119 are arranged at positions that can be operated with the thumb of the right hand. The thumb rest section 121 (thumb standby position) is a grip section provided on the rear side of the camera 100 at a position where it is easy to place the thumb of the right hand that is gripping the grip section 120 when none of the operation members are being operated. The thumb rest section 121 is made of a rubber member or the like for increasing the holding force (grip feeling). Terminal cover 122 protects connectors such as a connection cable that connects camera 100 to an external device (external apparatus). Lid 123 protects recording medium 227 and the slot by closing the slot for storing recording medium 227 (described later). Communication terminal 124 is a terminal for communicating with a lens unit (such as lens unit 200 or lens unit 300 (described later)) that is detachable from camera 100.

[0020] Fig. 3 is a block diagram showing an example of the configuration of the camera 100. In Fig. 3, the same components as those in Figs. 2(A) and 2(B) are given the same reference numerals as those in Figs. 2(A) and 2(B), and the description of those components will be omitted as appropriate. In Fig. 3, the lens unit 200 is attached to the camera 100.

[0021] First, the lens unit 200 will be described. The lens unit 200 is a type of interchangeable lens unit (interchangeable lens) that is detachable from the camera 100. The lens unit 200 is a single lens unit (single lens) and is an example of a normal lens unit. The lens unit 200 has an aperture 201, a lens 202, an aperture drive circuit 203, an AF (autofocus) drive circuit 204, a lens system control circuit 205, a communication terminal 206, and the like.

[0022] The aperture 201 is configured so that the aperture diameter can be adjusted. The lens 202 is composed of a plurality of lenses. The aperture drive circuit 203 adjusts the amount of light by controlling the aperture diameter of the aperture 201. The AF drive circuit 204 drives the lens 202 to adjust the focus. The lens system control circuit 205 controls the aperture drive circuit 203, the AF drive circuit 204, and the like, based on an instruction from a system control unit 50, which will be described later. The lens system control circuit 205 controls the aperture 201 via the aperture drive circuit 203, and adjusts the focus by changing the position of the lens 202 via the AF drive circuit 204. The lens system control circuit 205 can communicate with the camera 100. Specifically, communication is performed via a communication terminal 206 of the lens unit 200 and a communication terminal 124 of the camera 100. The communication terminal 206 is a terminal through which the lens unit 200 communicates with the camera 100.

[0023] Next, a description will be given of the camera 100. The camera 100 has a shutter 210, an imaging unit 211, an A / D converter 212, a memory control unit 213, an image processing unit 214, a memory 215, a D / A converter 216, an EVF 217, a display unit 108, and a system control unit 50.

[0024] The shutter 210 is a focal plane shutter that can freely control the exposure time of the imaging unit 211 based on an instruction from the system control unit 50. The imaging unit 211 is an imaging element (image sensor) composed of a CCD or CMOS element that converts an optical image into an electric signal. The imaging unit 211 may have an imaging surface phase difference sensor that outputs defocus amount information to the system control unit 50. The A / D converter 212 converts an analog signal output from the imaging unit 211 into a digital signal. The image processing unit 214 performs predetermined processing (pixel interpolation, resizing such as reduction, color conversion processing, etc.) on data from the A / D converter 212 or data from the memory control unit 213. In addition, the image processing unit 214 performs predetermined calculation processing using the captured image data, and the system control unit 50 performs exposure control and distance measurement control based on the obtained calculation result. This processing performs AF processing of a TTL (through-the-lens) method, AE (automatic exposure) processing, EF (flash pre-emission) processing, etc. Furthermore, the image processing unit 214 performs a predetermined calculation process using the captured image data, and the system control unit 50 performs TTL type AWB (auto white balance) processing based on the obtained calculation results.

[0025] Image data from the A / D converter 212 is written to the memory 215 via the image processing unit 214 and memory control unit 213. Alternatively, image data from the A / D converter 212 is written to the memory 215 via the memory control unit 213 without going through the image processing unit 214. The memory 215 stores image data obtained by the imaging unit 211 and converted into digital data by the A / D converter 212, and image data to be displayed on the display unit 108 and EVF 217. The memory 215 has a storage capacity sufficient to store a predetermined number of still images and a predetermined period of moving images and audio. The memory 215 also includes a memory for displaying images (video It also serves as a video memory.

[0026] The D / A converter 216 converts the image data for display stored in the memory 215 into an analog signal and supplies it to the display unit 108 or the EVF 217. Therefore, the image data for display written in the memory 215 is displayed on the display unit 108 or the EVF 217 via the D / A converter 216. The display unit 108 or the EVF 217 performs display according to the analog signal from the D / A converter 216. The display unit 108 or the EVF 217 is, for example, an LCD or an organic EL display. A digital signal that has been A / D converted by the A / D converter 212 and stored in the memory 215 is converted into an analog signal by the D / A converter 216, and the analog signal is sequentially transferred to and displayed on the display unit 108 or the EVF 217, thereby performing live view display.

[0027] The system control unit 50 is a control unit consisting of at least one processor and / or at least one circuit. That is, the system control unit 50 may be a processor, a circuit, or a combination of a processor and a circuit. The system control unit 50 controls the entire camera 100. The system control unit 50 executes a program recorded in the non-volatile memory 219 to realize each process of the flowchart described later. The system control unit 50 also performs display control by controlling the memory 215, the D / A converter 216, the display unit 108, the EVF 217, and the like.

[0028] The camera 100 also includes a system memory 218 , a non-volatile memory 219 , a system timer 220 , a communication unit 221 , an attitude detection unit 222 , and an eye proximity detection unit 118 .

[0029] For example, a RAM is used as the system memory 218. Constants and variables for the operation of the system control unit 50, programs read from the nonvolatile memory 219, and the like are deployed in the system memory 218. The nonvolatile memory 219 is an electrically erasable and recordable memory, and for example, an EEPROM is used as the nonvolatile memory 219. Constants and programs for the operation of the system control unit 50 are recorded in the nonvolatile memory 219. The programs here are programs for executing a flowchart described later. The system timer 220 is a clock unit that measures the time used for various controls and the time of a built-in clock. The communication unit 221 transmits and receives video signals and audio signals to and from an external device connected wirelessly or by a wired cable. The communication unit 221 can also be connected to a wireless LAN (Local Area Network) or the Internet. The communication unit 221 can also communicate with an external device via Bluetooth (registered trademark) or Bluetooth Low Energy. The communication unit 221 can transmit images (including live images) captured by the imaging unit 211 and images recorded in the recording medium 227, and can receive images and various other information from external devices. The attitude detection unit 222 is an attitude detection sensor that detects the attitude of the camera 100 with respect to the direction of gravity. Based on the attitude detected by the attitude detection unit 222, it is possible to determine whether the image captured by the imaging unit 211 is an image captured with the camera 100 held horizontally or vertically. The system control unit 50 can add orientation information corresponding to the attitude detected by the attitude detection unit 222 to the image file of the image captured by the imaging unit 211, and rotate the image according to the detected attitude. For example, an acceleration sensor or a gyro sensor can be used as the attitude detection unit 222. It is also possible to detect the movement of the camera 100 (panning, tilting, lifting, whether it is stationary, etc.) using the attitude detection unit 222.

[0030] Eyepiece detection unit 118 can detect the approach of some object to eyepiece unit 116 (eyepiece finder 117). For example, an infrared proximity sensor can be used as eyepiece detection unit 118. When an object approaches, infrared light projected from a light projecting unit of eyepiece detection unit 118 is reflected by the object and received by a light receiving unit of the infrared proximity sensor. The distance from eyepiece unit 116 to the object can be determined based on the amount of infrared light received. In this way, eyepiece detection unit 118 can detect the approach of some object to detect the approach of the object. 8 performs eye-approach detection to detect the proximity of an object to the eyepiece unit 116. The eye-approach detection unit 118 is an eye-approach detection sensor that detects the approach (eye-approach) and separation (eye-away) of an eye (object) to the eyepiece unit 116. When an object is detected approaching within a predetermined distance from the non-eye-approach state (non-approach state) to the eyepiece unit 116, the eye-approach is detected. On the other hand, when an object that was detected as approaching from the eye-approach state (approach state) moves away from the eyepiece unit 116 by a predetermined distance or more, the eye-away is detected. The threshold value for detecting the eye-approach and the threshold value for detecting the eye-away may be different, for example, by providing a hysteresis. In addition, after detecting the eye-approach, the eye-approach state is assumed to remain until the eye-away is detected. After detecting the eye-away, the eye-approach state is assumed to remain until the eye-approach is detected. The system control unit 50 switches the display unit 108 and the EVF 217 between display (display state) / non-display (non-display state) according to the state detected by the eye-approach detection unit 118. Specifically, when at least in a shooting standby state and the display destination switching setting is automatic switching, the display destination is set to display unit 108 and the display is turned on when the eye is not placed near the camera, and the EVF 217 is hidden. Also, when the eye is placed near the camera, the display destination is set to EVF 217 and the display is turned on, and the display unit 108 is hidden. Note that eye proximity detection unit 118 is not limited to an infrared proximity sensor, and other sensors may be used for eye proximity detection unit 118 as long as they can detect a state that can be regarded as eye proximity.

[0031] The camera 100 also has an outside-finder display unit 107, an outside-finder display drive circuit 223, a power supply control unit 224, a power supply unit 225, a recording medium I / F 226, an operation unit 228, and the like.

[0032] The outside viewfinder display unit 107 is driven by an outside viewfinder display drive circuit 223, and displays various settings of the camera 100 such as the shutter speed and aperture. The power supply control unit 224 is composed of a battery detection circuit, a DC-DC converter, a switch circuit for switching between blocks to be energized, and detects whether a battery is attached, the type of battery, and the remaining battery level. The power supply control unit 224 also controls the DC-DC converter based on the detection result and an instruction from the system control unit 50, and supplies the required voltage to each unit including the recording medium 227 for the required period. The power supply unit 225 is a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery, or a Li battery, an AC adapter, or the like. The recording medium I / F 226 is an interface with the recording medium 227 such as a memory card or a hard disk. The recording medium 227 is a memory card for recording captured images, and is composed of a semiconductor memory, a magnetic disk, or the like. The recording medium 227 may be detachable from the camera 100, or may be built into the camera 100.

[0033] The operation unit 228 is an input unit that accepts operations from the user (user operations) and is used to input various instructions to the system control unit 50. The operation unit 228 includes the shutter button 101, the power switch 102, the mode changeover switch 103, the touch panel 109, and other operation units 229. The other operation units 229 include the main electronic dial 104, the sub electronic dial 105, the video button 106, the direction keys 110, the SET button 111, the AE lock button 112, the enlargement button 113, the playback button 114, the menu button 115, the touch bar 119, and the like.

[0034] The shutter button 101 has a first shutter switch 230 and a second shutter switch 231. The first shutter switch 230 is turned on when the shutter button 101 is pressed halfway (instruction to prepare for shooting) during operation, and outputs a first shutter switch signal SW1. In response to the first shutter switch signal SW1, the system control unit 50 starts preparation processes for shooting, such as AF processing, AE processing, AWB processing, and EF processing. The second shutter switch 231 is turned on when the operation of the shutter button 101 is completed, that is, when the shutter button is pressed all the way (instruction to shoot), and outputs a second shutter switch signal SW2. In response to the second shutter switch signal SW2, the system control unit 50 controls a series of shooting processes, from reading out a signal from the imaging unit 211 to generating an image file including a shot image and writing it to the recording medium 227. Start.

[0035] The mode changeover switch 103 changes the operation mode of the system control unit 50 to one of a still image shooting mode, a video shooting mode, a playback mode, etc. Modes included in the still image shooting mode include an auto shooting mode, an auto scene determination mode, a manual mode, an aperture priority mode (Av mode), a shutter speed priority mode (Tv mode), and a program AE mode (P mode). There are also various scene modes and custom modes that are shooting settings according to shooting scenes. The user can directly switch to one of the above-mentioned shooting modes using the mode changeover switch 103. Alternatively, the user can selectively switch to one of the displayed modes using the operation unit 228 after once switching to a list screen of shooting modes using the mode changeover switch 103. Similarly, the video shooting mode may also include a plurality of modes.

[0036] The touch panel 109 is a touch sensor that detects various touch operations on the display surface of the display unit 108 (the operation surface of the touch panel 109). The touch panel 109 and the display unit 108 can be configured as one unit. For example, the touch panel 109 is attached to the upper layer of the display surface of the display unit 108 so that the light transmittance does not interfere with the display of the display unit 108. Then, by associating input coordinates on the touch panel 109 with display coordinates on the display surface of the display unit 108, a GUI (Graphical User Interface) can be configured as if the user could directly operate the screen displayed on the display unit 108. The touch panel 109 can be any of various types such as a resistive film type, a capacitive type, a surface acoustic wave type, an infrared type, an electromagnetic induction type, an image recognition type, and an optical sensor type. Depending on the type, there is a type that detects a touch by contact with the touch panel 109, and a type that detects a touch by approaching a finger or a pen to the touch panel 109, but any type may be used.

[0037] The system control unit 50 can detect the following operations or states on the touch panel 109. A finger or pen that has not been touching the touch panel 109 touches the touch panel 109 again, that is, the start of touching (hereinafter referred to as Touch-Down). A state in which the touch panel 109 is touched with a finger or a pen (hereinafter referred to as Touch-On). The touch panel 109 is moved while being touched by a finger or a pen (hereinafter referred to as Touch-Move). The finger or pen that has been touching the touch panel 109 is released from the touch panel 109, that is, the touch ends (hereinafter, referred to as "touch-up"). A state in which nothing is being touched on the touch panel 109 (hereinafter referred to as Touch-Off).

[0038] When touch-down is detected, touch-on is also detected at the same time. After touch-down, touch-on will usually continue to be detected unless touch-up is detected. Even if touch-move is detected, touch-on will continue to be detected. Even if touch-on is detected, touch-move will not be detected if the touch position does not move. After it is detected that all fingers or pens that were touching have touched up, touch-off will occur.

[0039] These operation states and the position coordinates of the touch panel 109 touched by a finger or pen are notified to the system control unit 50 via the internal bus. The system control unit 50 determines what kind of operation (touch operation) has been performed on the touch panel 109 based on the notified information. As for the touch move, the moving direction of the finger or pen moving on the touch panel 109 can be determined for each vertical component and horizontal component on the touch panel 109 based on the change in the position coordinate. When a touch move of a predetermined distance or more is detected, it is determined that a slide operation has been performed. An operation in which a finger is touched on the touch panel 109, quickly moved for a certain distance, and then released is called a flick. In other words, a flick is an operation in which a finger is quickly traced on the touch panel 109 as if flicking. When a touch move of a predetermined distance or more at a predetermined speed or more is detected and a touch up is detected as it is, it is determined that a flick has been performed (it can be determined that a flick has been performed following a slide operation). Furthermore, a touch operation in which multiple points (for example, two points) are touched together (multi-touched) and the touch positions are brought closer to each other is called a pinch in, and a touch operation in which the touch positions are moved away from each other is called a pinch out. Pinch out and pinch in are collectively called a pinch operation (or simply pinch).

[0040] Fig. 4 is a schematic diagram showing an example of the configuration of lens unit 300. Fig. 4 shows a state in which lens unit 300 is attached to camera 100. Note that in Fig. 4, the same components as those explained in Fig. 3 are given the same reference numerals as in Fig. 3, and explanations of those components will be omitted as appropriate.

[0041] The lens unit 300 is a type of interchangeable lens unit that can be attached to and detached from the camera 100. The lens unit 300 is a twin lens unit that can capture right and left images with parallax. The lens unit 300 has two optical systems, and each of the two optical systems can capture an image over a wide viewing angle range of approximately 180 degrees. Specifically, each of the two optical systems of the lens unit 300 can capture an image of a subject over a viewing field (angle of view) of 180 degrees in the left-right direction (horizontal angle, azimuth angle, yaw angle) and 180 degrees in the up-down direction (vertical angle, elevation angle, pitch angle). In other words, each of the two optical systems can capture an image over the range of the front hemisphere.

[0042] The lens unit 300 has a right-eye optical system 301R having a plurality of lenses and a reflecting mirror, a left-eye optical system 301L having a plurality of lenses and a reflecting mirror, and a lens system control circuit 303. The right-eye optical system 301R has a lens 302R arranged on the subject side, and the left-eye optical system 301L has a lens 302L arranged on the subject side. The lenses 302R and 302L face in the same direction, and their optical axes are approximately parallel.

[0043] The lens unit 300 is a twin lens unit (VR180 lens unit) for obtaining a VR180 image, which is one of the formats of VR (Virtual Reality) images that allow two-eye stereoscopic vision. The lens unit 300 has fisheye lenses capable of capturing a range of approximately 180 degrees in each of the right-eye optical system 301R and the left-eye optical system 301L. The range that can be captured by the lenses of each of the right-eye optical system 301R and the left-eye optical system 301L may be about 160 degrees, which is narrower than the range of 180 degrees. The lens unit 300 can form a right image formed via the right-eye optical system 301R and a left image formed via the left-eye optical system 301L on one or two image pickup elements of a camera to which the lens unit 300 is attached. In camera 100, the right image and the left image are formed on a single imaging element (image sensor), and a single image (two-eye image) is generated in which the right image area (area of ​​the right image) and the left image area (area of ​​the left image) are arranged side by side.

[0044] The lens unit 300 is attached to the camera 100 via the lens mount portion 304 and the camera mount portion 305 of the camera 100. In this manner, the system control unit 50 of the camera 100 and the lens system control circuit 303 of the lens unit 300 are electrically connected via the communication terminal 124 of the camera 100 and the communication terminal 306 of the lens unit 300.

[0045] The attitude detection unit 307 is an attitude detection sensor that detects the attitude of the lens unit 300 with respect to the direction of gravity. For example, an acceleration sensor or a gyro sensor can be used as the attitude detection unit 307. The attitude detection unit 307 can also be used to detect the movement of the lens unit 300 (panning, tilting, lifting, whether or not it is stationary, etc.).

[0046] In FIG. 4, a right image formed through the right eye optical system 301R and a left image formed through the left eye optical system 301L are formed side by side on the imaging unit 211 of the camera 100. That is, two optical images (subject images) are formed in two areas of one imaging element (imaging sensor) by the right eye optical system 301R and the left eye optical system 301L. The imaging unit 211 converts the formed optical image (optical signal) into an analog electrical signal. By using the lens unit 300 in this way, one image including two image areas with parallax can be acquired from two locations (optical systems) of the right eye optical system 301R and the left eye optical system 301L. By dividing the acquired image into an image for the left eye and an image for the right eye and displaying them in VR, the user can view a stereoscopic VR image in a range of approximately 180 degrees. That is, the user can stereoscopically view an image of VR180.

[0047] Here, the VR image is an image that can be displayed in VR, which will be described later. The VR image includes an omnidirectional image (spherical image) captured by an omnidirectional camera (spherical camera) and a panoramic image having a wider image range (effective image range) than the display range that can be displayed at one time on a display unit. In addition, the VR image is not limited to a still image, but also includes a video and a live image (image acquired from a camera in almost real time). The VR image has an image range (effective image range) of a field of view of 360 degrees in the left and right directions and 360 degrees in the up and down directions at maximum. In addition, the VR image includes an image having a wider angle of view than the angle of view that can be captured by a normal camera, or a wider image range than the display range that can be displayed at one time on a display unit, even if the field of view is less than 360 degrees in the left and right directions or less than 360 degrees in the up and down directions. The image captured by the camera 100 using the lens unit 300 described above is a type of VR image. The VR image can be displayed in VR by, for example, setting the display mode of a display device (a display device that can display a VR image) to "VR view". A portion of a VR image with a 360-degree angle of view is displayed, and the user can change the attitude of the display device left and right (horizontal rotation direction) to move the displayed area and view seamless omnidirectional images in the left and right directions.

[0048] VR display (VR view) is a display method (display mode) that can change the display range and displays an image of a VR image with a field of view according to the posture of the display device. VR display includes "single-eye VR display (single-eye VR view)" that displays one image by performing a transformation (distortion correction) to map a VR image onto a virtual sphere. VR display also includes "two-eye VR display (two-eye VR view)" that displays a VR image for the left eye and a VR image for the right eye side by side in the left and right regions by performing a transformation to map the VR image for the left eye and the VR image for the right eye, which have a parallax from each other, in a "two-eye VR display" that allows the VR images to be viewed in stereoscopic view. In any VR display, for example, when a user wears a display device such as an HMD (head-mounted display), an image with a field of view according to the direction of the user's face is displayed. For example, assume that a VR image with a field of view centered on 0 degrees left and right (a specific direction, for example, north) and 90 degrees up and down (90 degrees from the zenith, i.e. horizontal) is displayed at a certain point in time. If the orientation of the display device is flipped from this state (for example, the display surface is changed from facing south to facing north), the display range of the same VR image is changed to an image with a field of view centered at 180 degrees left and right (the opposite direction, for example south) and 90 degrees up and down. In other words, when the user is wearing the HMD and turns his face from north to south (i.e. turns backwards), the image displayed on the HMD is also changed from a north image to a south image. Note that the VR image captured using the lens unit 300 is an image (180° image) capturing a range of approximately 180 degrees in front, and no image exists in a range of approximately 180 degrees behind. If such an image is VR displayed and the orientation of the display device is changed to the side where no image exists, the blank will be displayed. The area is displayed.

[0049] By displaying the VR image in this way, the user can obtain a sense (a sense of immersion) as if they were visually inside the VR image (in the VR space). The method of displaying the VR image is not limited to changing the posture of the display device. For example, the display range may be moved (scrolled) in response to user operation via a touch panel or directional buttons. Furthermore, during VR display (when in the "VR view" display mode), in addition to changing the display range due to a change in posture, the display range may also be changed in response to touch-move on the touch panel, dragging with a mouse, pressing a directional button, etc. A smartphone attached to VR goggles (head-mounted adapter) is a type of HMD.

[0050] FIG. 5A is a schematic diagram showing an example of lens information acquired from a twin lens unit. 1. Lens design values 2. Lens individual value 3. Lens Flag 4. Lens focal length 5. Lens temperature 6. Maximum lens mount play 7.In-lens accelerometer information etc.

[0051] The lens design values ​​are design values ​​for performing aberration correction. During the manufacturing process of the twin lens unit, errors such as lens decentering and tilt occur in each of the two optical systems (left eye optical system 301L and right eye optical system 301R). If left-right swapping (swapping the right image area and left image area) or equirectangular conversion is performed without taking the errors into account, the quality of the twin eye VR display will decrease, making good stereoscopic viewing difficult. The lens individual values ​​are the measurement results of errors (manufacturing errors) detected during the manufacturing process of the twin lens unit.

[0052] The lens flag is a flag indicating that it is a twin lens unit, and can be used to determine whether or not a twin lens unit is used. The lens focal length is the distance from the "principal point" that is the center of the lens to the image sensor (imaging position). The lens focal length may be a parameter common to the two optical systems (left eye optical system 301L and right eye optical system 301R) of the twin lens unit, or it may not be. A detailed (high-precision) lens focal length is required to perform left-right swapping, equirectangular conversion, and other operations with high precision to perform high-quality twin-eye VR display. The lens temperature is the temperature of the twin lens unit, and is used to grasp the environmental temperature at the time of shooting, etc.

[0053] The maximum lens mount play is the design value of the play that occurs in the mount (connection) between the twin lens unit and the camera. The maximum inclination of the twin lens unit with respect to the image sensor is determined by the play that occurs in the mount between the twin lens unit and the camera. The maximum lens mount play may be included in the camera information described below. The maximum lens mount play may be included in only one of the lens information or the camera information, or may be included in both the lens information and the camera information.

[0054] The in-lens accelerometer information is attitude information obtained using an acceleration sensor (level) in the twin lens unit, and indicates the attitude of the lens in the roll direction, pitch direction, etc.

[0055] FIG. 5B is a schematic diagram showing an example of camera information generated within a camera. For example, the camera information is used to perform high-quality VR display. The camera information is 1. Camera recording area information 2.In-camera accelerometer information 3. Right exposure compensation information etc.

[0056] Camera recording area information is information on the effective image area. The displayable effective image area varies depending on the camera's sensor and recording mode. Camera accelerometer information is attitude information obtained using the camera's acceleration sensor (level), and indicates the camera's attitude in the roll and pitch directions. Right exposure compensation information is an exposure setting value that brings the exposure of the right image area closer to the exposure of the left image area.

[0057] Fig. 6 is a flowchart showing an example of the operation of the camera 100. This operation is realized by the system control unit 50 expanding a program recorded in the non-volatile memory 219 into the system memory 218 and executing it. For example, when the camera 100 is started up, the operation of Fig. 6 starts. The operation of Fig. 6 is an operation for displaying a live view image (an image showing a subject in almost real time) captured by the imaging unit 211 on the EVF 217 or the display unit 108. The operation of Fig. 6 is executed when the camera 100 is in a shooting standby state (shooting mode).

[0058] In step S601, the system control unit 50 determines whether the camera 100 is compatible with a twin lens unit (for example, the lens unit 300). For example, the system control unit 50 determines whether the version of the firmware of the system control unit 50 is compatible with a twin lens unit. If it is determined that the firmware is compatible with a twin lens unit, the process proceeds to step S602, and if not, the process proceeds to step S611. In the first embodiment, unlike the case of a normal single lens unit, in the case of a twin lens unit, it is necessary to obtain and record information about the twin lens unit (lens information; information about the two optical systems of the twin lens unit) for post-processing. Therefore, the process of step S601 is necessary.

[0059] In step S602, the system control unit 50 determines whether or not a twin lens unit is attached to the camera 100. If it is determined that a twin lens unit is attached, the process proceeds to step S603; otherwise, the process proceeds to step S611. Note that if a twin lens unit is attached when a twin lens unit was not attached, the process also proceeds to step S603. If a twin lens unit is attached but then removed and a single lens unit is attached, the process proceeds to step S611.

[0060] In step S603, the system control unit 50 acquires design values ​​of the attached (connected) twin lens unit from the twin lens unit. The design values ​​are design parameters and are used for left-right swapping and equirectangular conversion.

[0061] In step S604, the system control unit 50 acquires an individual value of the attached (connected) twin lens unit from the twin lens unit. The individual value is a parameter unique to the lens unit, such as an error during manufacturing (manufacturing error). By using the individual value, image processing can be performed with higher accuracy than when only the design value is used.

[0062] In step S605, the system control unit 50 acquires from the imaging unit 211 a live view image including the right image region and the left image region.

[0063] In step S606, the system control unit 50 acquires information on the inclination of the camera 100 (camera inclination information) from the attitude detection unit 222 of the camera 100. For example, the system control unit 5 0 acquires the angle of inclination (tilt angle) of camera 100 with respect to the ground (a horizontal plane, a plane perpendicular to the vertical direction (direction of gravity)) as camera tilt information. Note that the method of acquiring camera tilt information is not particularly limited. For example, the horizon may be detected from a live view image, and the angle of inclination of the horizontal direction (left and right direction) of the live view image with respect to a direction parallel to the detected horizon may be acquired as camera tilt information. The reference plane for the tilt of camera 100 is not limited to the ground.

[0064] In step S607, the system control unit 50 acquires information on the inclination of the twin lens unit (lens inclination information) from the attached (connected) twin lens unit (for example, the attitude detection unit 307 of the lens unit 300). For example, the system control unit 50 acquires the angle of inclination (tilt angle) of the twin lens unit with respect to the ground as the lens inclination information. Note that the method of acquiring the lens inclination information is not particularly limited. For example, the horizon, the right image area, and the left image area may be detected from the live view image, and a straight line passing through the center of the right image area (image circle) and the center of the left image area (image circle) may be detected. Then, the angle of inclination of the direction parallel to the detected straight line with respect to the direction parallel to the detected horizon may be acquired as the lens inclination information. The reference plane for the inclination of the twin lens unit is not limited to the ground.

[0065] In step S608, the system control unit 50 notifies the user of the tilt of the camera 100 based on the camera tilt information acquired in step S606, and notifies the user of the tilt of the twin lens unit based on the lens tilt information acquired in step S607. In the first embodiment, the system control unit 50 notifies the user of these tilts by displaying them on the EVF 217 or the display unit 108. Note that the method of notifying the user of the tilt is not particularly limited, and the notification may be performed by audio output, for example.

[0066] In step S609, the system control unit 50 displays the live view image acquired in step S605 on the EVF 217 or the display unit .

[0067] In step S610, the system control unit 50 determines whether or not to end the live view display. For example, if the user instructs the camera 100 to end the live view display or to change the mode to a mode other than the shooting mode, the system control unit 50 determines that the live view display is to be ended. If it is determined that the live view display is to be ended, the operation of FIG. 6 is ended, and if not, the system control unit 50 proceeds to step S605.

[0068] If a single lens unit is attached to camera 100, the process of step S611 is performed. In step S611, system control unit 50 displays a live view image captured by the single lens unit on EVF 217 or display unit 108. The process of step S611 is similar to conventional processing for displaying a live view image captured by a single lens unit, and therefore a detailed description thereof will be omitted. When the process of step S611 ends, the operation of FIG. 6 ends.

[0069] 7(A) to 7(D) show an example of a screen displayed on the EVF 217 or the display unit 108 after the process of step S618 in FIG. 6. Straight lines 701 to 703 are displayed on a screen 700 in FIGS. 7(A) to 7(D). The straight line 701 is an item (reference line) parallel to the horizontal direction of the live view image (the horizontal direction of the image sensor, the left-right direction of the camera 100). The straight line 702 is an item indicating the tilt (the direction and magnitude of the tilt) of the camera 100 with respect to the ground. The straight line 703 is an item indicating the tilt (the direction and magnitude of the tilt) of the twin lens unit with respect to the ground. The system control unit 50 controls the tilt of the straight line 702 based on the camera tilt information, and controls the tilt of the straight line 703 based on the lens tilt information. For example, the system control unit 50 controls the tilt of the straight line 702 so that the angle between the straight lines 701 and 702 matches the angle of the tilt of the camera 100 with respect to the ground. Then, the system control unit 50 controls the inclination of line 703 so that the angle between lines 701 and 703 matches the angle of inclination of the twin lens unit with respect to the ground.

[0070] 7(A) shows an ideal state in which neither camera 100 nor the twin lens unit is tilted with respect to the ground. Lines 702 and 703 are parallel to line 701. By looking at lines 702 and 703, the user can easily understand that neither camera 100 nor the twin lens unit is tilted with respect to the ground.

[0071] 7(B) shows a state in which the twin lens unit is not tilted relative to the ground, but camera 100 is tilted. Line 703 is parallel to line 701, but line 702 is tilted. By looking at lines 702 and 703, the user can easily understand that the twin lens unit is not tilted relative to the ground, but camera 100 is tilted.

[0072] 7(C) shows a state in which camera 100 is not tilted relative to the ground, but the twin lens unit is tilted. Line 702 is parallel to line 701, but line 703 is tilted. By looking at lines 702 and 703, the user can easily understand that camera 100 is not tilted relative to the ground, but the twin lens unit is tilted.

[0073] 7(D) shows a state in which both camera 100 and the twin lens unit are tilted with respect to the ground. Lines 702 and 703 are also tilted with respect to line 701. By looking at lines 702 and 703, the user can easily understand that both camera 100 and the twin lens unit are tilted with respect to the ground.

[0074] Note that the straight line 701 does not have to be displayed. Even if the straight line 701 is not displayed, the user can grasp the horizontal direction of the live view image (the horizontal direction of the image sensor, the left-right direction of the camera 100) and grasp the inclination of the straight lines 702 and 703. Furthermore, the items indicating the inclination (the direction and magnitude of the inclination) are not limited to the straight lines 702 and 703. For example, as an item indicating the inclination, a bar indicating the inclination (the direction and magnitude of the inclination), an arrow indicating the direction to eliminate the inclination, or an arrow indicating the direction of the inclination may be displayed. The size or length of the arrow may change depending on the magnitude of the inclination.

[0075] Not only the tilt of the camera but also the tilt of the lens unit can cause an unintended positional shift of a subject in a captured image. According to the first embodiment, the user is notified of not only the tilt of the camera but also the tilt of the lens unit. This allows the user to easily understand and adjust the tilt of the camera and the tilt of the lens unit. As a result, the user can easily and sufficiently reduce unintended positional shift of a subject in a captured image.

[0076] <Embodiment 2> In the first embodiment, an example of notifying the user of the tilt of the camera and lens unit has been described. However, when the tilt of the object (camera or lens unit) is very small, the user cannot easily grasp whether the object is tilted or not even if the tilt is notified as it is. Therefore, in the second embodiment, an example of notifying the user of the tilt by exaggerating (emphasizing) it will be described. Note that, in the following, the description of the same points as in the first embodiment (for example, the same configuration and processing as in the first embodiment) will be omitted as appropriate.

[0077] Figures 8(A) to 8(D) show examples of screens displayed on the EVF 217 or the display unit 108. Straight lines 801 to 803 are displayed on a screen 800 in Figures 8(A) to 8(D). Line 801 is an item (reference line) parallel to the horizontal direction of the live view image (the horizontal direction of the image sensor, the left-right direction of the camera 100). Line 802 is a line indicating the inclination (direction and magnitude of the inclination) of the camera 100 with respect to the ground. Line 803 is a line indicating the inclination (direction and magnitude of the inclination) of the twin lens unit with respect to the ground.

[0078] 8(A) shows an ideal state in which neither camera 100 nor the twin lens unit is tilted with respect to the ground. Lines 802 and 803 are parallel to line 801. By looking at lines 802 and 803, the user can easily understand that neither camera 100 nor the twin lens unit is tilted with respect to the ground.

[0079] 8(B) shows a state in which the twin lens unit is not tilted relative to the ground, but the camera 100 is tilted. Dashed line 804 shows the actual tilt of the camera 100. Because the tilt of dashed line 804 is very slight, even if an item such as dashed line 804 is displayed, the user cannot easily tell whether or not the camera 100 is tilted.

[0080] Therefore, in FIG. 8(B), the straight line 802 is inclined more than the actual inclination of the camera 100. For example, the straight line 802 is displayed so that the inclination of the straight line 802 (the angle between the straight lines 801 and 802) is N (N>1) times the inclination of the dashed line 804 (the angle between the straight lines 801 and 804). The magnification N may be a predetermined fixed value or a value designated by the user. The straight line 803 is parallel to the straight line 801, but the straight line 802 is inclined. By looking at such straight lines 802 and 803, the user can easily understand that the twin lens unit is not inclined with respect to the ground, but the camera 100 is inclined.

[0081] 8(B), the user is also notified that the tilt of the camera 100 (and the twin lens unit) is being exaggerated (highlighted) by the display of message 806. Message 806 indicates that the tilt is being displayed in an exaggerated manner.

[0082] 8(C) shows a state in which the camera 100 is not tilted relative to the ground, but the twin lens unit is tilted. The dashed line 807 shows the actual tilt of the twin lens unit. Because the tilt of the dashed line 807 is very small, even if an item such as the dashed line 807 is displayed, the user cannot easily understand whether the camera 100 is tilted or not.

[0083] Therefore, in FIG. 8C, the straight line 803 is inclined more than the actual inclination of the twin lens unit. For example, the straight line 803 is displayed so that the inclination of the straight line 803 (the angle between the straight line 801 and the straight line 803) is M (M>1) times the inclination of the broken line 807 (the angle between the straight line 801 and the broken line 807). The magnification M may be a fixed value determined in advance, or may be a value designated by the user. The magnification M may be the same as the magnification N, or may be different. The straight line 802 is parallel to the straight line 801, but the straight line 803 is inclined. By looking at such straight lines 802 and 803, the user can easily understand that the camera 100 is not inclined with respect to the ground, but the twin lens unit is inclined.

[0084] 8(C), the user is also notified that the tilt of the twin lens unit (and camera 100) is exaggerated (highlighted) by displaying message 806. As described above, message 806 indicates that the tilt is being displayed in an exaggerated manner.

[0085] FIG. 8(D) shows a state in which both the camera 100 and the twin lens unit are tilted with respect to the ground. As in FIG. 8(B), a straight line 802 with an exaggerated tilt is displayed, and as in FIG. 8(C), a straight line 803 with an exaggerated tilt is displayed. Both straight lines 802 and 803 are tilted with respect to straight line 801. By looking at such straight lines 802 and 803, the user can easily see the difference between the two. It can be easily understood that both camera 100 and twin lens unit are tilted relative to the camera 100. Furthermore, message 806 is displayed, as in Figures 8(B) and 8(C). The display of message 806 notifies the user that the tilt of camera 100 and twin lens unit is exaggerated (highlighted). As described above, message 806 indicates that the tilt is being displayed in an exaggerated manner.

[0086] As described above, according to the second embodiment, the tilt of the camera and the tilt of the lens unit are exaggerated and notified. This allows the user to easily know whether the camera is tilted or not even if the tilt of the camera is very small. The user can easily know whether the lens unit is tilted or not even if the tilt of the lens unit is very small.

[0087] The system control unit 50 may display screens such as those shown in FIGS. 8(E) to 8(I).

[0088] A straight line 810 is displayed on the screen 800 in Figs. 8(E) and 8(F). The straight line 810 is an item indicating the allowable range of the tilt of the camera 100. The tilt of the straight line 810 is the limit value of the allowable range of the tilt of the camera 100. The tilt of the straight line 810 is also an exaggerated tilt. By looking at the straight lines 802 and 810, the user can easily understand whether the tilt of the camera 100 is within the allowable range. In Fig. 8(E), the tilt of the straight line 802 is larger than the tilt of the straight line 810, so the user can easily understand that the tilt of the camera 100 is outside the allowable range. In Fig. 8(F), the tilt of the straight line 802 is smaller than the tilt of the straight line 810, so the user can easily understand that the tilt of the camera 100 is within the allowable range.

[0089] A straight line 811 is displayed on the screen 800 in Figs. 8(G) and 8(H). The straight line 811 is an item indicating the allowable range of the inclination of the twin lens unit. The inclination of the straight line 811 is the limit value of the allowable range of the inclination of the twin lens unit. The inclination of the straight line 811 is also an exaggerated inclination. By looking at the straight lines 803 and 811, the user can easily understand whether the inclination of the twin lens unit is within the allowable range. In Fig. 8(G), the inclination of the straight line 803 is greater than the inclination of the straight line 811, so the user can easily understand that the inclination of the twin lens unit is outside the allowable range. In Fig. 8(H), the inclination of the straight line 803 is smaller than the inclination of the straight line 811, so the user can easily understand that the inclination of the twin lens unit is within the allowable range.

[0090] Both straight lines 810 and 811 are displayed on the screen 800 in FIG. 8(I). By displaying both straight lines 810 and 811, the user can easily grasp both whether the tilt of the camera 100 is within the allowable range and whether the tilt of the twin lens unit is within the allowable range. The straight line 810 is not displayed when the tilt of the camera 100 is within the allowable range, and may be displayed when the tilt of the camera 100 is not within the allowable range. The straight line 810 is not displayed when the camera 100 is not tilted, and may be displayed when the camera 100 is tilted. Similarly, the straight line 811 is not displayed when the tilt of the twin lens unit is within the allowable range, and may be displayed when the tilt of the twin lens unit is not within the allowable range. The straight line 811 is not displayed when the twin lens unit is not tilted, and may be displayed when the twin lens unit is tilted. The allowable range of tilt of camera 100 and the allowable range of tilt of the twin lens unit may be the same or different.

[0091] There are two limit values ​​for the allowable range of tilt: the limit value (maximum value) for the allowable left tilt, and the limit value (maximum value) for the allowable right tilt. Two straight lines corresponding to the two limit values ​​may be displayed as items, but to simplify the screen, only a straight line corresponding to the limit value corresponding to the current tilt direction may be displayed as an item indicating the limit value. In Figures 8(E), 8(F), and 8(I), camera 100 is tilted to the left, so only straight line 810 corresponding to the limit value of the allowable leftward tilt is displayed as an item indicating the allowable range of tilt of camera 100. Similarly, in Figures 8(E) and 8(F), the twin lens unit is tilted to the left, so only straight line 811 corresponding to the limit value of the allowable leftward tilt is displayed.

[0092] The system control unit 50 may also determine whether the tilt of the camera 100 is within the allowable range based on the camera tilt information. The system control unit 50 may notify whether the tilt of the camera 100 is within the allowable range by, for example, differentiating the state (e.g., color, brightness, or line type) of the straight line 802 between when the tilt of the camera 100 is within the allowable range and when it is not within the allowable range. Similarly, the system control unit 50 may determine whether the tilt of the twin lens unit is within the allowable range based on the lens tilt information. The system control unit 50 may notify whether the tilt of the twin lens unit is within the allowable range by, for example, differentiating the state of the straight line 803 between when the tilt of the twin lens unit is within the allowable range and when it is not within the allowable range. As with the method of notifying the tilt, the method of notifying the allowable range and the method of notifying whether the tilt is within the allowable range are not particularly limited. When notifying whether the tilt is within the allowable range or not, the allowable range itself does not need to be notified. The determination as to whether the tilt of the twin lens unit is within the allowable range may be performed by the twin lens unit, and the system control unit 50 may obtain the determination result from the twin lens unit.

[0093] Furthermore, the system control unit 50 may cause the straight lines 802, 803 to take different forms depending on whether the condition that the tilt of the camera 100 is within the allowable range and the tilt of the twin lens unit is within the allowable range is satisfied or not. The system control unit 50 may cause the straight lines 802, 803 to take different forms depending on whether the condition that neither the camera 100 nor the twin lens unit is tilted is satisfied or not. This allows the user to easily understand that both the tilt of the camera 100 and the tilt of the twin lens unit are within the allowable range and that neither the camera 100 nor the twin lens unit is tilted.

[0094] The various controls described above as being performed by the system control unit 50 may be performed by a single piece of hardware, or the entire device may be controlled by multiple pieces of hardware (e.g., multiple processors or circuits) sharing the processing.

[0095] In addition, although the embodiments of the present invention have been described in detail, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. Furthermore, each of the above-mentioned embodiments merely shows one embodiment of the present invention, and each embodiment can be appropriately combined.

[0096] In the above-mentioned embodiment, the present invention is applied to a digital camera, but the present invention is not limited to this example and can be applied to any imaging device with a detachable lens. For example, the present invention can be applied to personal computers, PDAs, mobile phone terminals, portable image viewers, printers, digital photo frames, music players, game consoles, electronic book readers, etc. In addition, the present invention can be applied to video players, display devices (including projection devices), tablet terminals, smartphones, AI speakers, home appliances, in-vehicle devices, etc.

[0097] <Other embodiments> The present invention relates to a program for implementing one or more functions of the above-described embodiments, which is transmitted via a network or The program may be provided to a system or device via a storage medium, and one or more processors in the computer of the system or device may read and execute the program. The program may also be implemented by a circuit (e.g., ASIC) that implements one or more functions.

[0098] The disclosure of the present embodiment includes the following configuration, method, program, and medium. (Configuration 1) 1. An imaging device, comprising: A first acquisition means for acquiring information on the inclination of the imaging device; a second acquisition means for acquiring information on the inclination of a specific lens when the specific lens is attached to the imaging device; a control means for controlling so as to notify the tilt of the imaging device based on the information acquired by the first acquisition means, and for controlling so as to notify the tilt of the specific lens based on the information acquired by the second acquisition means; An imaging device comprising: (Configuration 2) the inclination of the imaging device is an inclination of the imaging device with respect to a horizontal plane, The tilt of the particular lens is the tilt of the particular lens with respect to the horizontal plane. 2. The imaging device according to configuration 1, (Configuration 3) The specific lens is a twin lens. 3. The imaging device according to configuration 1 or 2. (Configuration 4) The imaging device further includes an attitude detection sensor, 4. The imaging device according to any one of configurations 1 to 3, wherein the first acquisition means acquires information about the inclination of the imaging device from the attitude detection sensor. (Configuration 5) The second acquisition means acquires information on the inclination of the specific lens from the specific lens. 5. The imaging device according to any one of configurations 1 to 4. (Configuration 6) The control means controls so as to exaggerate and notify the tilt of the imaging device and the tilt of the specific lens. 6. The imaging device according to any one of configurations 1 to 5, (Configuration 7) The control means controls to display a first item tilted at a larger angle than the tilt of the imaging device and a second item tilted at a larger angle than the tilt of the specific lens. 7. The imaging device according to configuration 6, (Configuration 8) The control means further controls to notify that the tilt of the imaging device and the tilt of the specific lens are exaggerated. 8. The imaging device according to configuration 6 or 7, (Configuration 9) The control means further controls to notify whether the tilt of the imaging device is within a first allowable range and whether the tilt of the specific lens is within a second allowable range. 9. The imaging device according to any one of configurations 1 to 8, (Configuration 10) a determining step of determining whether or not a tilt of the imaging device is within the first allowable range based on the information acquired by the first acquiring step, and determining whether or not a tilt of the specific lens is within the second allowable range based on the information acquired by the second acquiring step. Further stages 10. The imaging device according to configuration 9. (Configuration 11) a determination means for determining whether or not the tilt of the imaging device is within the first allowable range based on the information acquired by the first acquisition means; a third acquisition means for acquiring information on whether or not the tilt of the specific lens is within the second allowable range from the specific lens; Further having 10. The imaging device according to configuration 9. (Configuration 12) The control means Controlling to display a first item as a notification of a tilt of the imaging device, and controlling to display a second item as a notification of a tilt of the specific lens; a state of the first item is changed depending on whether the tilt of the imaging device is within the first allowable range or not; and The state of the second item is made different between a case where the tilt of the specific lens is within the second tolerance range and a case where the tilt of the specific lens is not within the second tolerance range. 12. The imaging device according to any one of configurations 9 to 11, (Configuration 13) The control means Controlling to display a first item as a notification of a tilt of the imaging device, and controlling to display a second item as a notification of a tilt of the specific lens; The state of the first item and the second item is made different between a case where a condition that the tilt of the imaging device is within the first allowable range and a condition where the tilt of the specific lens is within the second allowable range is satisfied and a case where the condition is not satisfied. 13. The imaging device according to any one of configurations 9 to 12. (Configuration 14) The control means further controls to notify a first allowable range which is an allowable range of tilt of the imaging device and a second allowable range which is an allowable range of tilt of the specific lens unit. 14. The imaging device according to any one of configurations 1 to 13. (Configuration 15) The control means Controlling to display a first item as a notification of a tilt of the imaging device, and controlling to display a second item as a notification of a tilt of the specific lens; The state of the first item and the second item is made different between a case where a condition that neither the imaging device nor the specific lens is tilted is satisfied and a case where the condition is not satisfied. 15. The imaging device according to any one of configurations 1 to 14. (Configuration 16) A control method for an imaging device, comprising: a first acquisition step of acquiring information on the inclination of the imaging device; a second acquisition step of acquiring information on the inclination of a specific lens when the specific lens is attached to the imaging device; a control step of controlling the imaging device so as to notify the tilt of the imaging device based on the information acquired in the first acquisition step, and controlling the imaging device so as to notify the tilt of the specific lens based on the information acquired in the second acquisition step; A control method comprising the steps of: (Configuration 17) A computer is configured to function as each of the means of the imaging device according to any one of configurations 1 to 15. Program for. (Configuration 18) A computer-readable storage medium storing a program for causing a computer to function as each of the means of the imaging device according to any one of configurations 1 to 15. [Explanation of symbols]

[0099] 100: Digital camera (camera) 50: System control unit

Claims

1. An imaging device, A first acquisition means for acquiring information on the tilt of the imaging device, When a specific lens is attached to the imaging device, a second acquisition means for acquiring information on the tilt of the specific lens, A determination means for determining whether the tilt of the imaging device is within a first permissible range based on the information acquired by the first acquisition means, A control means that controls whether the tilt of the imaging device is within a first permissible range based on the information acquired by the first acquisition means, and controls whether the tilt of the specific lens is within a second permissible range based on the information acquired by the second acquisition means. An imaging device characterized by having the following features.

2. The tilt of the imaging device is the tilt of the imaging device with respect to the horizontal plane. The inclination of the particular lens is the inclination of the particular lens with respect to the horizontal plane. The imaging apparatus according to feature 1.

3. The aforementioned specific lens is a binocular lens. The imaging apparatus according to feature 1.

4. The imaging device further includes an attitude detection sensor, The imaging device according to claim 1, characterized in that the first acquisition means acquires information on the tilt of the imaging device from the attitude detection sensor.

5. The second acquisition means acquires information about the tilt of the specific lens from the specific lens. The imaging apparatus according to feature 1.

6. The control means controls the system to exaggerate and notify the tilt of the imaging device and the tilt of the specific lens. The imaging apparatus according to feature 1.

7. The control means controls the display of a first item tilted at an angle greater than the tilt of the imaging device, and a second item tilted at an angle greater than the tilt of the specific lens. The imaging device according to feature 6.

8. The control means further controls to notify that the tilt of the imaging device and the tilt of the particular lens are being exaggerated. The imaging device according to feature 6.

9. The determination means further determines whether the tilt of the specific lens is within the second allowable range based on the information obtained by the second acquisition means. The imaging apparatus according to feature 1.

10. The second acquisition means acquires from the specific lens whether or not the tilt of the specific lens is within the second allowable range. The imaging apparatus according to feature 1.

11. The control means is The system is controlled to display a first item as notification of the tilt of the imaging device, and to display a second item as notification of the tilt of the specific lens. The configuration of the first item is made different depending on whether the tilt of the imaging device is within the first allowable range or not. The configuration of the second item differs depending on whether the tilt of the particular lens is within the second tolerance range or not. The imaging apparatus according to feature 1.

12. The control means is The system is controlled to display a first item as notification of the tilt of the imaging device, and to display a second item as notification of the tilt of the specific lens. The configuration of the first item and the second item differs depending on whether the conditions are met, namely, when the tilt of the imaging device is within the first permissible range and the tilt of the specific lens is within the second permissible range, or when the conditions are not met. The imaging apparatus according to feature 1.

13. The control means further controls to notify the first tolerance range, which is the tolerance range for the tilt of the imaging device, and the second tolerance range, which is the tolerance range for the tilt of the specific lens unit. The imaging apparatus according to feature 1.

14. The control means is The system is controlled to display a first item as notification of the tilt of the imaging device, and to display a second item as notification of the tilt of the specific lens. The configuration of the first item and the second item will differ depending on whether the condition that neither the imaging device nor the specific lens is tilted is met or not. The imaging apparatus according to feature 1.

15. A method for controlling an imaging device, A first acquisition step of acquiring information on the tilt of the imaging device, A second acquisition step, in which information on the tilt of a specific lens is acquired when a specific lens is attached to the imaging device, A determination step in which, based on the information acquired in the first acquisition step, a determination step is made to determine whether or not the tilt of the imaging device is within a first permissible range, A control step which controls the system to notify whether the tilt of the imaging device is within a first permissible range based on the information acquired in the first acquisition step, and controls the system to notify whether the tilt of the specific lens is within a second permissible range based on the information acquired in the second acquisition step. A control method characterized by having the following features.

16. A program for causing a computer to function as one of the means of an imaging apparatus according to any one of claims 1 to 14.

17. A computer-readable storage medium storing a program for causing a computer to function as one of the means of an imaging apparatus according to any one of claims 1 to 14.

Images