Electronic device, control method thereof, and storage medium

Abstract

The present invention discloses an electronic device, a control method thereof, and a storage medium. The electronic device includes: a control unit configured to: display an image in a display unit based on a third image including a first image photographed by a first optical system and a second image photographed by a second optical system and having a parallax with respect to the first image; and a receiving unit configured to receive an enlargement instruction for enlarging a portion of the image displayed in the display unit, wherein when the enlargement instruction is received during display of the third image, the control unit displays an enlarged image including an enlarged portion of any one of the first image and the second image in the display unit.

Description

Technical Field

[0001] The invention relates to an electronic device, a control method thereof and a storage medium. Background Art

[0002] A technology is known for acquiring a wide-angle image with parallax through two different optical systems and then mapping the image onto a virtual sphere to display a virtual reality (VR) image with a stereoscopic effect. A dual-lens VR camera for capturing images with parallax includes two different optical systems facing the same direction to capture two different images with parallax in a single image capture. In a specific dual-lens VR camera, each optical system captures images within a range of 180 degrees or more in the vertical and horizontal directions (i.e., a hemisphere, 90 degrees or more in all directions from the center of the image). Known VR image display methods include "monocular VR display" for displaying an image through deformation by mapping a VR image on a virtual sphere, and "dual side-by-side VR display" for displaying a right-eye VR image and a left-eye VR image side by side in the right and left areas, respectively.

[0003] WO 11 / 121840 discloses a stereoscopic camera apparatus that uses two different camera units arranged side by side with parallax to photograph the same subject from right and left viewpoints to acquire right-eye and left-eye images, respectively. Summary of the invention

[0004] The present invention is directed to providing an image display suitable for magnifying an image (including a right-eye image and a left-eye image arranged side by side) and checking the details of the image.

[0005] According to one aspect of the present invention, an electronic device includes: a control unit configured to: display an image in a display unit based on a third image including a first image captured by a first optical system and a second image captured by a second optical system and having parallax with respect to the first image; and a receiving unit configured to receive a zoom-in instruction for zooming in a portion of the image displayed in the display unit, wherein, when the zoom-in instruction is received during display of the third image, the control unit displays an zoomed-in image including an enlarged portion of any one of the first image and the second image in the display unit.

[0006] Further features of the present invention will become apparent from the following detailed description of exemplary embodiments with reference to the attached drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] Figure 1A and 1B The appearance of a camera is schematically shown.

[0008] Figure 2 is a schematic diagram showing the internal configuration of a camera.

[0009] Figure 3 is a schematic diagram showing the configuration of a lens unit.

[0010] Figure 4A and 4B is a flowchart showing the live view display processing of the camera.

[0011] Figures 5A to 5D is a schematic diagram showing a live view image of dual side-by-side images.

[0012] Fig. 6A and 6B is a schematic diagram showing a live view image of a monocular image. DETAILED DESCRIPTION

[0013] Some exemplary embodiments of the present invention will be described below with reference to the accompanying drawings. The present exemplary embodiments will be described below around an example where a digital camera (camera) is an electronic device.

[0014] Figure 1A and 1B 1 is an example of the appearance of a digital camera 100 (hereinafter referred to as a camera). Figure 1A is a perspective view showing the camera 100 as seen from the front, Figure 1B 1 is a perspective view showing the camera 100 as seen from behind. The camera 100 includes a shutter button 101, a power switch 102, a mode selection switch 103, a main electronic dial 104, a sub-electronic dial 105, a moving image button 106, and an external viewfinder display unit 107 on the top surface. The shutter button 101 is an operation component that performs image capture preparation or issues an image capture instruction. The power switch 102 is an operation component that turns on or off the power of the camera 100. The mode selection switch 103 is an operation component that selects various modes. The main electronic dial 104 is a rotation operation component that changes the setting values ​​of the shutter speed, aperture, and other attributes. The sub-electronic dial 105 is a rotation operation component that moves a selection frame (cursor) and feeds an image. The moving image button 106 is an operation component that issues an instruction for starting and stopping moving image capture (recording). The external viewfinder display unit 107 displays various setting values ​​of the shutter speed, aperture, and other attributes.

[0015] The camera 100 includes a display unit 108, a touch panel 109, a direction key 110, a setting button 111, an automatic exposure (AE) lock button 112, a magnification button 113, a reproduction button 114, a menu button 115, an eyepiece portion 116, an eye contact detection unit 118, and a touch bar 119 on the back. The display unit 108 displays images and various information. The touch panel 109 is an operation member for detecting a touch operation on a display surface (touch operation surface) of the display unit 108. The direction key 110 is an operation member including up, down, right, and left keys (four-way key). The direction key 110 allows operation at its pressed position. The setting button 111 is an operation member pressed mainly to determine a selection item. The AE lock button 112 is an operation member pressed to fix an exposure state in a shooting standby state. The magnification button 113 is an operation member that turns on or off a magnification mode in a live view display (LV display) in a shooting mode. In the case where the zoom mode is turned on, the live view image (LV image) can be zoomed in or out by operating the main electronic dial 104. The zoom button 113 is used to zoom in on the reproduced image or increase the magnification in the reproduction mode. The reproduction button 114 is an operating member for switching between the imaging mode and the reproduction mode. Pressing the reproduction button 114 in the imaging mode switches the camera 100 to the reproduction mode, so that the latest image among the images recorded in the recording medium 227 (described below) can be displayed in the display unit 108.

[0016] The menu button 115 is an operation member that is pressed to display a menu screen for making various settings in the display unit 108. The user can intuitively make various settings on the menu screen displayed in the display unit 108 through the direction key 110 and the setting button 111. The eyepiece portion 116 is equipped with an eye contact viewfinder (look-in finder) 117 brought to the user's eye. The eyepiece portion 116 allows the user to visually recognize an image displayed in an internal electronic viewfinder (EVF) 217 ​​(described below). The eye contact detection unit 118 is a sensor for detecting whether the user's eye is close to the eyepiece portion 116.

[0017] The touch bar 119 is a linear touch operation member (line touch sensor) for receiving a touch operation. The touch bar 119 is set at a (touchable) position where a touch operation can be performed with the thumb of the right hand while holding the grip portion 120 with the right hand (little finger, ring finger and middle finger of the right hand) so that the shutter button 101 can be pressed with the index finger of the right hand.

[0018] More specifically, the touch bar 119 can be operated in a state (photographing posture) where the user's eye is close to the eyepiece portion 116 to view the eye-contact viewfinder 117, and the user is ready to press the shutter button 101 at any time. The touch bar 119 accepts a tap operation (touching the touch bar 119 and then releasing the finger without moving it within a predetermined period of time) and a right / left slide operation (touching the touch bar 119 and then moving the touch position during contact with the touch bar 119). The touch bar 119 is an operating member different from the touch panel 109 and does not have a display function. The touch bar 119 according to the present exemplary embodiment is a multi-function bar, and is used as an M-Fn bar, for example.

[0019] The camera 100 further includes a grip portion 120, a thumb support portion 121, a terminal cover 122, a cover 123, and a communication terminal 124. The grip portion 120 has a shape that is easy to hold with the right hand when the user holds the camera 100. The shutter button 101 and the main electronic dial 104 are arranged at positions where these operating components can be operated by the index finger of the right hand in a state where the camera 100 is held by holding the grip portion 120 by the little finger, ring finger, and middle finger of the right hand. The sub-electronic dial 105 and the touch bar 119 are arranged at positions where these operating components can be operated by the thumb of the right hand in a similar state. The thumb support portion 121 (thumb standby position) is a grip portion provided at a position on the back of the camera 100, where the thumb of the right hand holding the grip portion 120 is easy to support in a state where no operating component is operated. The thumb support portion 121 is made of a rubber material to improve the holding force (gripping feeling). The terminal cover 122 protects a connector such as a connection cable for connecting the camera 100 to an external device. The cover 123 closes a slot for storing a recording medium 227 (described below) to protect the recording medium 227 and the slot. The communication terminal 124 enables the camera 100 to communicate with the lens unit 200 (described below), which can be attached to and detached from the camera 100.

[0020] Figure 2 1 shows an example of the internal configuration of the camera 100. Figure 1A and 1B , similar numbers refer to Figure 2 , and redundant description thereof will be omitted as appropriate. The lens unit 200 or the lens unit 300 (described below) is attached to the camera 100. First, a camera system including the camera 100 and the lens unit 200 as a conventional single lens unit will be described as an example.

[0021] The lens unit 200 is an interchangeable lens that can be attached to and detached from the camera 100. The lens unit 200, which is a single lens unit, is an example of a conventional lens. Unlike the lens unit 300 (described below), the lens unit 200 includes a single optical system.

[0022] The lens unit 200 includes an aperture 201, a lens 202, an aperture drive circuit 203, an auto focus (AF) drive circuit 204, a lens system control circuit 205, and a communication terminal 206. The aperture 201 has an adjustable aperture. The lens 202 includes a plurality of lenses. The aperture drive circuit 203 controls the aperture of the aperture 201 to adjust the amount of light. The AF drive circuit 204 drives the lens 202 to adjust the focus. The lens system control circuit 205 controls the aperture drive circuit 203 and the AF drive circuit 204 based on an instruction from a system control unit 50 (described below). The lens system control circuit 205 controls the aperture 201 via the aperture drive circuit 203 to move the position of the lens 202 via the AF drive circuit 204 to adjust the focus. The lens system control circuit 205 communicates with the camera 100. More specifically, the lens system control circuit 205 communicates with the camera 100 via the communication terminal 206 of the lens unit 200 and the communication terminal 124 of the camera 100. The communication terminal 206 is used by the lens unit 200 to communicate with the camera 100 .

[0023] The camera 100 includes a shutter 210, an imaging unit 211, an analog-to-digital (A / D) converter 212, a memory controller 213, an image processing unit 214, a memory 215, a digital-to-analog (D / A) converter 216, an EVF 217, a display unit 108, and a system control unit 50.

[0024] The shutter 210 is a focal plane shutter for controlling the exposure time of the imaging unit 211 based on an instruction from the system control unit 50. The imaging unit 211 is an image sensor, which is a charge coupled device (CCD) sensor or a complementary metal oxide semiconductor (CMOS) sensor, for converting an optical image into an electrical signal. The imaging unit 211 may include an imaging plane phase difference sensor for outputting defocus amount information to the system control unit 50. The A / D converter 212 converts an analog signal output from the imaging unit 211 into a digital signal.

[0025] The image processing unit 214 performs predetermined processing (pixel interpolation, resizing processing including reduction, and color conversion processing) on ​​the data from the A / D converter 212 or from the memory controller 213 .

[0026] The image processing unit 214 also performs predetermined calculation processing on the captured image data. The system control unit 50 performs exposure control and distance measurement control based on the obtained calculation results. This processing realizes AF processing based on the Through-The-Lens (TTL) method, automatic exposure (AE) processing, and electronic flash preliminary emission (EF) processing. The image processing unit 214 also performs predetermined calculation processing on the captured image data, and performs automatic white balance (AWB) processing based on TTL based on the obtained calculation results.

[0027] The image data from the A / D converter 212 is stored in the memory 215 via the image processing unit 214 and the memory controller 213. In addition, the image data from the A / D converter 212 is stored in the memory 215 via the memory controller 213 without being processed by the image processing unit 214. The memory 215 stores the image data captured by the camera unit 211 and then converted into digital data by the A / D converter 212, and stores the image data to be displayed in the display unit 108 and the EVF 217. The memory 215 has a sufficient storage capacity to store a predetermined number of still images, moving images, and sounds within a predetermined period of time. The memory 215 is also used as an image display memory (video memory).

[0028] The D / A converter 216 converts the image display data stored in the memory 215 into an analog signal, and then supplies the signal to the display unit 108 and the EVF 217. Therefore, the image display data stored in the memory 215 is displayed in the display unit 108 and the EVF 217 via the D / A converter 216. The display unit 108 and the EVF 217 display data corresponding to the analog signal from the D / A converter 216. The display unit 108 and the EVF 217 are, for example, a liquid crystal display (LCD) and an organic electroluminescent (EL) display. Then, the digital signal generated in the A / D conversion by the A / D converter 212 and stored in the memory 215 is converted into an analog signal by the D / A converter 216. The analog signal is continuously transmitted to the display unit 108 or the EVF 217 and displayed thereon, thereby starting the LV display.

[0029] The system control unit 50 includes at least one processor and / or at least one circuit. More specifically, the system control unit 50 may be a processor, a circuit, or a combination of the two. The system control unit 50 generally controls the camera 100. The system control unit 50 runs a program recorded in the nonvolatile memory 219 to perform each process of the flowchart (described below). The system control unit 50 also controls the memory 215, the D / A converter 216, the display unit 108, and the EVF 217 to perform display control. The system control unit 50 also functions as a receiving unit to receive instructions input by operating the above-mentioned various operating components. The system control unit 50 performs control corresponding to the received instructions.

[0030] The camera 100 includes a system memory 218, a nonvolatile memory 219, a system timer 220, a communication unit 221, a posture detection unit 222, and an eye contact detection unit 118. The system memory 218 is, for example, a random access memory (RAM). Constants and variables for the operation of the system control unit 50 and a program read from the nonvolatile memory 219 are loaded into the system memory 218. The nonvolatile memory 219 is an electrically erasable and recordable memory, such as an electrically erasable programmable read-only memory (EEPROM). Constants and programs for the operation of the system control unit 50 are recorded in the nonvolatile memory 219. The above-mentioned program refers to a program for executing the processing in the flowchart (described below). The system timer 220 is a time measurement unit for measuring time used in various controls and the time of a built-in clock.

[0031] The communication unit 221 transmits video and audio signals to an external device connected wirelessly or via a wired cable, and receives video and audio signals from the external device. The communication unit 221 can be connected to a wireless local area network (LAN) and the Internet. The communication unit 221 can also be connected to a wireless local area network (LAN) and the Internet. The communication unit 221 can transmit images captured by the camera unit 211 (including real-time images) and images recorded in the recording medium 227, and receive image data and other various information from external devices.

[0032] The posture detection unit 222 detects the posture of the camera 100 with respect to the gravity direction. Based on the posture detected by the posture detection unit 222, the system control unit 50 determines whether the image captured by the camera unit 211 is an image captured by holding the camera 100 horizontally or an image captured by holding the camera 100 vertically. The system control unit 50 can add direction information corresponding to the posture detected by the posture detection unit 222 to the image file of the image captured by the camera unit 211, or rotate the image before recording. An acceleration sensor or a gyro sensor can be used as the posture detection unit 222. It is also possible to detect the motion (panning, tilting, raising, and stillness) of the camera 100 by using the posture detection unit 222.

[0033] The eye contact detection unit 118 can detect that some object approaches the eyepiece portion 116 of the eye contact viewfinder 117 including the EVF 217. An infrared proximity sensor can be used as the eye contact detection unit 118. When an object approaches, infrared light projected from a light projection portion of the eye contact detection unit 118 is reflected by the object and then received by a light receiving portion of the infrared light proximity sensor. The distance between the eyepiece portion 116 and the object can be determined based on the amount of infrared light received. In this way, the eye contact detection unit 118 performs eye contact detection to detect the proximity distance of the object to the eyepiece portion 116.

[0034] The eye contact detection unit 118 is an eye contact detection sensor for detecting the approach (eye contact state) and separation (eye away state) between the eye (object) and the eyepiece portion 116 of the eye contact viewfinder 117. When an object approaching the eyepiece portion 116 is detected at a predetermined distance or less in the eye away state (non-contact state), the eye contact detection unit 118 detects the eye contact state. When the object in the eye contact state (approach state) separates from the eyepiece portion 116 and moves away by a predetermined distance or more, the eye contact detection unit 57 detects the eye away state. When there is, for example, hysteresis, the threshold value for detecting the eye contact state and the threshold value for detecting the eye away state may be different. Once the eye contact state is detected, the eye contact state will continue until the eye away state is detected. Once the eye away state is detected, the eye away state will continue until the eye contact state is detected. The system control unit 50 turns the display of the display unit 108 and the EVF 217 on (display state) or off (non-display state) according to the state detected by the eye contact detection unit 118. More specifically, at least when the camera 100 is in the image capture standby state and when automatic switching is set for the display destination of the live view image, the following display control is performed. In the eye-away state, the display unit 108 is set as the display destination, that is, the display of the display unit 108 is turned on, and the display of the EVF 217 is turned off. On the other hand, in the eye-contact state, the EVF 217 is set as the display destination, that is, the display of the EVF 217 is turned on, and the display of the display unit 108 is turned off. The eye-contact detection unit 118 is not limited to the infrared proximity sensor, and may be another sensor as long as the sensor can detect the eye-contact state.

[0035] The camera 100 also includes an external viewfinder display unit 107 , an external viewfinder display drive circuit 223 , a power control unit 224 , a power supply unit 225 , a recording medium interface (I / F) 226 , and an operation unit 228 .

[0036] The external viewfinder display unit 107 displays various setting values, such as shutter speed and aperture, to the camera 100 through the external viewfinder display driving circuit 223 .

[0037] The power control unit 224 includes a battery detection circuit, a direct current-to-direct current (DC-DC) converter, and a switch circuit for selecting a module to be powered. The power control unit 224 detects the connection or separation of the battery, the battery type, and the remaining battery capacity. The power control unit 224 also controls the DC-DC converter based on the detection result and the instruction from the system control unit 50 so as to supply an appropriate voltage to the recording medium 227 and other components within an appropriate period of time.

[0038] The power supply unit 225 includes a primary battery (e.g., an alkaline battery and a lithium battery), a secondary battery (e.g., a nickel-cadmium battery, a nickel-metal hydride battery, and a lithium battery), and an alternating current (AC) adapter. The recording medium I / F 226 is an interface with a recording medium 227 such as a memory card and a hard disk. The recording medium 227 is, for example, a memory card for recording captured images, and includes a semiconductor memory and a magnetic disk. The recording medium 227 can be connected to and detached from the camera 100, or built into the camera 100.

[0039] The operation unit 228 is an input unit that accepts an operation from a user (user operation) and is used to input various instructions to the system control unit 50. The operation unit 228 includes the shutter button 101, the power switch 102, the mode selection switch 103, the touch panel 109, and other operation parts 229. The other operation parts 229 include the main electronic dial 104, the sub-electronic dial 105, the moving image button 106, the direction key 110, the setting button 111, the AE lock button 112, the enlargement button 113, the reproduction button 114, the menu button 115, and the touch bar 119.

[0040] The shutter button 101 includes a first shutter switch 230 and a second shutter switch 231. In the middle of the operation of the shutter button 101, the first shutter switch 230 is turned on, which is called half-pressing (imaging preparation instruction), to generate a first shutter switch signal SW1. In response to the first shutter switch signal SW1, the system control unit 50 starts image capture preparation processing such as AF processing, AE processing, AWB processing, and EF processing. After the operation on the shutter button 101 is completed, the second shutter switch 231 is turned on, which is called full pressing (imaging instruction), to generate a second shutter switch signal SW2. In response to the second shutter switch signal SW2, the system control unit 50 starts a series of imaging processing, including reading a signal from the imaging unit 211, generating an image file containing a captured image, and storing the image file in the recording medium 227.

[0041] The mode selection switch 103 changes the operation mode of the system control unit 50 to a still image shooting mode, a moving image shooting mode, or a reproduction mode. The still image shooting mode includes an automatic image shooting mode, an automatic scene determination mode, a manual mode, an aperture priority mode (Av mode), a shutter speed priority mode (Tv mode), and a program AE mode (P mode). The still image shooting mode also includes various scene modes that provide camera settings for various shooting scenes, and includes a custom mode. The mode selection switch 103 enables the user to directly select any one of these camera modes. Alternatively, the mode selection switch 103 enables the user to once select the camera mode list screen, and then use the operation unit 228 to select any one of a plurality of display modes. Similarly, the moving image shooting mode may also include a plurality of modes.

[0042] The touch panel 109 is a touch sensor for detecting various touch operations on the display surface of the display unit 108 (the operation surface of the touch panel 109). The touch panel 109 and the display unit 108 may be formed integrally. For example, the touch panel 109 is attached to the upper layer of the display surface of the display unit 108 so that the transmittance of light does not interfere with the display of the display unit 108. Then, the input coordinates on the touch panel 109 are associated with the display coordinates on the display surface of the display unit 108. This provides a graphical user interface (GUI) that virtually allows the user to directly operate the screen displayed in the display unit 108. The touch panel 109 may be one of various types including a resistive film type, a capacitive type, a surface elastic wave type, an infrared type, an electromagnetic induction type, an image recognition type, and an optical sensor type.

[0043] Depending on the type, a touch is detected when a finger or a pen contacts the touch panel 109 or when a finger or a pen comes close to the touch panel 109, but either type is applicable.

[0044] The system control unit 50 can detect the following operations and states on the touch panel 109: * An operation of starting to touch the touch panel 109 with a finger or a pen that has lost contact with the touch panel 109 (hereinafter referred to as "touch start touch-down"). * A state in which a finger or a pen is in contact with the touch panel 109 (hereinafter referred to as "touch continuation touch-on"). * An operation of moving a finger or a pen while in contact with the touch panel 109 (hereinafter referred to as "touch move touch-move"). * An operation of separating (releasing) a finger or a pen that has been in contact with the touch panel 109 from the touch panel 109 to end the touch (hereinafter referred to as "touch end touch-up"). * A state in which a finger or a pen is not in contact with the touch panel 109 (hereinafter referred to as "touch-off").

[0045] When "touch start" is detected, "touch continuation" is also detected at the same time. After "touch start" is detected, "touch continuation" is usually detected until "touch end" is detected. In the state where "touch move" is detected, "touch continuation" is also detected. Even if "touch continuation" is detected, "touch move" is not detected if the touch position does not move. After "touch end" of all fingers or pens in contact with the touch panel 109 is detected, "no touch" is detected.

[0046] The above-mentioned operation and state and the position coordinates of the position where the finger or pen contacts the touch panel 109 are notified to the system control unit 50 through the internal bus. Based on the notified information, the system control unit 50 determines what kind of operation (touch operation) is performed on the touch panel 109. For "touch movement", the moving direction of the finger or pen moving on the touch panel 109 can be determined for each vertical and horizontal component on the touch panel 109 based on the change in the position coordinates. If the touch movement is detected to exceed a predetermined distance or longer, the system control unit 50 determines that a sliding operation has been performed. An operation of quickly moving a finger a certain distance during contact with the touch panel 109 and then releasing the finger therefrom is called a flick. In other words, a flick is an operation of flicking the surface of the touch panel 109 with a finger. If a touch movement is detected at a predetermined speed or higher over a predetermined distance or longer, and then "touch end" is detected subsequently, it is determined that a flick has been performed (it is determined that a flick has been performed after sliding). A touch operation of touching multiple positions (for example, two positions) at the same time (multi-touch) and bringing these positions close to each other is called a "pinch-in". The touch operation of moving these locations away from each other is called a "pinch-out." Pinch-in and pinch-out are collectively referred to as a pinch operation (or simply "pinch").

[0047] Figure 3 is a schematic diagram illustrating an example configuration of the lens unit 300 . Figure 3 The camera 100 is shown with a lens unit 300 attached thereto. Figure 3 The camera 100 shown in FIG. 1 is shown in FIG. 1 , and like numerals refer to Figure 2 Similar components shown in FIG. 1 are shown in FIG. 5 and their redundant description will be omitted.

[0048] The lens unit 300 is an interchangeable lens that can be attached to and detached from the camera 100. The lens unit 300 is a dual-lens unit for acquiring an optical image in which a right image and a left image have parallax. The lens unit 300 includes two different optical systems. Each optical system having a wide viewing angle of about 180 degrees acquires an optical image within the front hemisphere. More specifically, each of the two optical systems of the lens unit 300 acquires an image of a subject with a viewing angle (field angle) of 180 degrees in the horizontal direction (horizontal angle, azimuth angle, and deflection angle) and 180 degrees in the vertical direction (vertical angle, elevation angle, and pitch angle). The lens unit 300 includes a right-eye optical system 301R including a plurality of lenses and a reflector, a left-eye optical system 301L including a plurality of lenses and a reflector, and a lens system control circuit 303. The right-eye optical system 301R corresponds to an example of a first optical system, and the left-eye optical system 301L corresponds to an example of a second optical system. The right-eye optical system 301R and the left-eye optical system 301L include lenses 302R and 302L, respectively, which are arranged at a position closer to the subject than the camera 100 and face the same direction. The optical axes of the lenses 302R and 302L are approximately parallel. Each optical system includes a so-called fisheye lens, and forms a circular optical image on the imaging unit 211 (sensor).

[0049] The lens unit 300 according to the present exemplary embodiment is a virtual reality (VR) 180 lens unit for capturing images for so-called VR180, which is a VR image format capable of achieving stereoscopic vision. The VR180 lens unit includes a fisheye lens, in which both the right eye optical system 301R and the left eye optical system 301L capture images within a range of approximately 180 degrees. Although the right eye optical system 301R and the left eye optical system 301L in the VR180 lens unit according to the present exemplary embodiment obtain VR images that can be displayed in a double side-by-side manner in VR180, the VR180 lens unit can also capture a wide viewing angle range of approximately 160 degrees that is smaller than the 180-degree range. The VR180 lens unit is capable of forming a right image (first image) formed by the right eye optical system 301R and a left image (second image) having parallax with the right image formed by the left eye optical system 301L on one or two different image sensors of the camera to which the VR180 lens unit is connected.

[0050] The lens unit 300 is attached to the camera 100 by connecting the lens mount unit 304 of the lens unit 300 to the camera mount unit 305 of the camera 100. As the lens unit 300 is attached to the camera 100, the system control unit 50 of the camera 100 and the lens system control circuit 303 of the lens unit 300 are electrically connected to each other via the communication terminals 124 and 306.

[0051] According to the present exemplary embodiment, a right image formed by the right eye optical system 301R and a left image having parallax with the right image formed by the left eye optical system 301L are formed side by side on the imaging unit 211 of the camera 100. More specifically, two optical images formed by the right eye optical system 301R and the left eye optical system 301L are formed on one image sensor. The imaging unit 211 converts the formed subject image (optical signal) into an analog electrical signal. The use of the lens unit 300 enables acquisition of a piece of image data in which two different images (right image and left image) having parallax acquired by two different optical systems (right eye optical system 301R and left eye optical system 301L) are arranged side by side. The image acquired in this manner is referred to as a dual side-by-side image (dual side-by-side image data). The dual side-by-side image is a pair in which a right side image corresponding to the right image and a left side image corresponding to the left image are arranged side by side. The right side image is also referred to as a right eye image, and the left side image is also referred to as a left eye image.

[0052] Figure 5A is a schematic diagram showing a display example of dual side-by-side image data of a live view display captured by the lens unit 300. The live view image (dual side-by-side image) 500 includes a live view image (right image) 501R corresponding to the right image captured by the right eye optical system 301R, and a live view image (left image) 501L corresponding to the left image captured by the left eye optical system 301L. Both the live view images 501R and 501L are circular in shape, and the distortion (compression) increases as it approaches the outer edge of the circle. According to this exemplary embodiment, the right image corresponding to the right image is arranged in the right area of ​​the dual side-by-side image, and the left image corresponding to the left image is arranged in the left area of ​​the dual side-by-side image. In the dual side-by-side image, the right image corresponding to the right image can be arranged on the left, and the left image corresponding to the left image can be arranged on the right.

[0053] VR display using a right-eye image (right image) and a left-eye image (left image) among acquired images allows a user to view a stereoscopic VR image within a range of approximately 180 degrees, so-called VR180.

[0054] VR images refer to images in VR display (described below). VR images include omnidirectional images (full spherical images) captured by an omnidirectional camera (full spherical camera) and panoramic images whose video range (effective video range) is larger than the display range that can be displayed at one time in the display unit 108. VR images also include still images, moving images, and real-time images (images acquired from the camera in almost real time). The video range (effective video range) of the VR image has a viewing angle of up to 360 degrees in the horizontal direction and a viewing angle of up to 360 degrees in the vertical direction. VR images also include images having a wider field of view than the field of view that can be captured by a general camera, or a wider video range than the display range that can be displayed on the display unit 108 at one time, even if the viewing angle is less than 360 degrees in the horizontal direction and less than 360 degrees in the vertical direction. An image captured by the camera 100 using the lens unit 300 (described above) is a VR image. For example, a VR image can be displayed by setting the display mode of a display device (a display device capable of displaying a VR image) to "VR view". When a user displays a VR image having a 360-degree field of view in a VR display and changes the posture of the display device in the horizontal direction (horizontal rotation direction), the user can view a horizontally seamless omnidirectional image.

[0055] VR display (VR view) refers to a display method (display mode) that can change the display range. This display method displays an image in the field of view corresponding to the posture of the display device in the VR image. VR display includes "monocular VR display" (monocular VR view), which performs deformation to display one image by mapping the VR image to a virtual sphere (distortion corrected). VR display also includes "dual side-by-side VR display" (dual side-by-side VR view), which performs deformation by mapping two images, a right-eye VR image and a left-eye VR image, to a virtual sphere to display two images in the right and left areas, respectively. Performing "dual side-by-side VR display" with a right-eye VR image and a left-eye VR image with parallax can achieve stereoscopic vision. In any VR display, for example, when a user wears a display device such as a head-mounted display (HMD), an image in the field of view corresponding to the direction of the user's face is displayed. For example, it is assumed that at a certain timing, the VR image displays an image in the field of view centered at 0 degrees in the horizontal direction (a specific direction, such as north) and 90 degrees in the vertical direction (90 degrees from the zenith, that is, the horizontal direction). If the posture of the display device is reversed in this state (for example, the direction of the display surface is changed from south to north), in the same VR image, the display range is changed to an image within the field of view centered at 180 degrees in the horizontal direction (the opposite direction, such as south) and 90 degrees in the vertical direction. More specifically, when the user wearing the HMD moves the face from north to south (that is, the user turns to the back), the image displayed on the HMD also changes from a north image to a south image. According to this exemplary embodiment, the VR image captured using the lens unit 300 is a VR180 image as a result of capturing an image within a range of approximately 180 degrees in the front direction, and does not include an image within a range of approximately 180 degrees in the rear direction. When such a VR180 image is displayed and the posture of the display device is changed to the side where the image does not exist, a blank area is displayed.

[0056] Displaying a VR image in a VR display in this way enables the user to feel as if they are visually in the VR image (in a VR space). The method of displaying a VR image is not limited to a method of changing the posture of the display device. For example, the display range can be moved (scrolled) according to the user's operation through the touch panel 109 or the direction buttons. In the VR display (in the "VR view" display mode), the display range can change according to posture changes and in response to touch movement on the touch panel 109, mouse drag operation, or pressing of the direction button. A smartphone connected to VR goggles (head-mounted adapter) is a type of HMD.

[0057] In the camera 100 having the above configuration, the image captured by the lens unit 300 includes images captured by the right eye and left eye optical systems and arranged side by side. The user can enlarge a portion of the image to check the details of the live view image or the recorded image on the camera 100. When the image is enlarged to check the dual side-by-side image portion, it is appropriate to display a portion of the right image or the left image. If the right image and the left image are included in the enlarged image at the same time, it is difficult for the user to intuitively recognize which portion of the original image corresponds to the enlarged image.

[0058] However, when the image is enlarged, the center position of the image enlargement target range is uniquely set to the center position of the entire image, and the boundary portion including the image from the right eye optical system (right image) and the image from the left eye optical system (left image) is enlarged. In this case, the left end portion of the image from the right eye optical system is arranged on the right side of the enlarged image, and the right end portion of the image from the left eye optical system is arranged on the left side of the enlarged image. This makes it difficult for the user to check the enlarged image.

[0059] The following will refer to Figure 4A and 4B , the present exemplary embodiment is described around the processing of the camera 100. The processing includes live view magnification processing suitable for image capturing using a dual lens unit such as the lens unit 300.

[0060] Figure 4A and 4B 1 is a flowchart showing an example of processing of the camera 100. When the system control unit 50 loads a program recorded in the nonvolatile memory 219 into the system memory 218 and then runs the program, the execution Figure 4A and 4B When the camera 100 is set to a still image shooting mode or a moving image shooting mode, Figure 4A and 4B Start with the flowchart in .

[0061] In step S401, the system control unit 50 acquires information about the type of the attached lens unit, and then determines whether the lens unit is a dual lens unit. In this case, the system control unit 50 determines whether the attached lens unit is a VR180 lens unit. The system control unit 50 communicates with the attached lens unit via the communication terminal 124 to acquire information about the type of the lens unit from the lens unit. If the attached lens unit is a dual lens unit (VR180 lens unit) ("Yes" in step S401), the process proceeds to step S402. On the other hand, if no lens unit is attached, or the attached lens unit is a conventional lens unit (e.g., a single lens unit) ("No" in step S401), the process proceeds to step S421. More specifically, if the lens unit attached to the camera 100 is the lens unit 200 as a conventional single lens unit, the process proceeds to step S421. On the other hand, if the lens unit attached to the camera 100 is the lens unit 300 as a dual lens unit, the process proceeds to step S402.

[0062] In step S402, the system control unit 50 determines whether the display mode setting during live view display is a dual side-by-side image display mode. During live view display of dual side-by-side images, the dual side-by-side image display mode, the left image enlarged display mode, or the right image enlarged display mode can be preset as the display mode. The display mode can be set by the user operating the menu screen. Information about the set display mode is pre-stored in the non-volatile memory 219. In step S402, the system control unit 50 determines whether information about the dual side-by-side image display mode is stored in the control variable stored in the non-volatile memory 219. If the dual side-by-side image display mode is set ("Yes" in step S402), the process proceeds to step S403. Otherwise ("No" in step S402), the process proceeds to step S406.

[0063] Figure 5A An example of a live view image 500 during live view display in dual side-by-side image display mode is shown. Live view image 500 includes an image (right image) 501R captured by the right eye optical system 301R and an image (left image) 501L captured by the left eye optical system 301L. Images 501R and 501L are both circular in shape, and the degree of distortion increases as they approach the outer edge of the circle. The dual side-by-side image display mode makes it easier for the user to recognize that two different wide field of view images are captured by the two optical systems, and that the camera 100 is in a VR image capturing state when the VR180 lens unit is attached. On the other hand, the dual side-by-side image display mode displays two images separately on one screen, which is not suitable for the user to check the focus and the expression of the subject in detail. Therefore, for example, when the user does not check the focus and the expression of the subject in detail, the dual side-by-side image display mode is used.

[0064] Figure 5B An example of a live view image 502 when live view display is performed in the left image magnification display mode is shown. Compared with the live view image 500 when live view display is performed in the dual side-by-side image display mode, a portion of the live image (left image) captured by the left eye optical system is magnified, making it easier for the user to check the details of the image.

[0065] The display optical system guide 503 indicates which of the right-eye and left-eye optical systems the captured real-time image is currently displayed through. The display optical system guide 503 includes an area 504 for a dual side-by-side image corresponding to the left-eye optical system, and an area 505 for a dual side-by-side image corresponding to the right-eye optical system. The background of the side corresponding to the currently displayed optical system is shaded. In this example, the background of the area 504 of the currently displayed dual side-by-side image corresponding to the left-eye optical system is shaded. This enables the user to recognize which of the right-eye and left-eye optical systems the currently displayed real-time image comes from. The frame 506 in the display optical system guide 503 indicates the enlargement target range of the dual side-by-side image. In this example, the circle on the area 504 indicating the left-eye optical system indicates the image area of ​​the real-time image from the left-eye optical system before enlargement, and a rectangle is displayed in the area corresponding to the position of the currently displayed enlarged real-time image.

[0066] Button 507 is a graphical user interface (GUI) that accepts an operation for changing the enlarged target. When the user performs "touch start" on the touch panel 109, button 507 is displayed in the display unit 108 as an operation button for performing a process of switching the enlarged target image between the left image and the right image. If the user presses the enlarged target right / left switching button, the display mode can be changed from the left image enlarged display mode to the right image enlarged display mode. If the current display mode is the right image enlarged display mode, the display mode can be changed to the left image enlarged display mode. According to this exemplary embodiment, when the enlarged target image is selected, the enlarged position is determined to be the position of another image corresponding to the enlarged position of the image before switching. For example, the enlarged position can be determined by measuring the distance from the current enlarged position to the subject, calculating the parallax amount together with the positions of the left and right optical systems, and then moving the enlarged position by the parallax amount.

[0067] Figure 5C An example of a live view image 508 when live view display is performed in the right image enlarged display mode is shown. The right image enlarged display mode is similar to the left image enlarged display mode except that the enlargement target image is the image (right image) 501R, so redundant description will be omitted.

[0068] In step S403, the system control unit 50 causes the real-time image captured by the camera unit 211 through the VR180 lens unit to be displayed in a dual side-by-side image display mode, that is, the system control unit 50 displays the real-time image in the display unit 108 in a dual side-by-side image display mode. In the dual side-by-side image display mode, the real-time image captured by the camera unit 211 is displayed in a live view in the display unit 108 so that the real-time image captured by the right eye optical system of the VR180 lens unit and the real-time image captured by the left eye optical system thereof are arranged side by side. Figure 5A As shown, an image 500 in which a right image 501R and a left image 501L are arranged side by side is displayed in the display unit 108 .

[0069] In step S404, the system control unit 50 determines whether the user performs an operation of enlarging the live view image. More specifically, the system control unit 50 determines whether a zoom-in instruction input by a zoom-in operation is received. For example, the zoom-in instruction is input by pressing the zoom-in button 113 or a pinch-out operation on the touch panel 109. If a zoom-in instruction is received, that is, if the system control unit 50 determines that the user has performed an operation of enlarging the live view image ("Yes" in step S404), the process proceeds to step S405. If no operation is detected ("No" in step S404), the process proceeds to step S430.

[0070] In step S405, the system control unit 50 sets the display mode in live view display to the left image enlarged display mode. More specifically, the system control unit 50 stores information about the left image enlarged display mode in the control variable stored in the nonvolatile memory 219. Then, the process proceeds to step S430.

[0071] In step S430, the system control unit 50 determines whether to end the live view image display. For example, if an instruction to enter the menu mode is input, the system control unit 50 determines to end the live view image display. The menu mode is a mode in which the user displays a menu screen from a still image or a moving image mode and then makes settings. When the user operates the power button to turn off the power, the system control unit 50 determines to end the live view image display. If the system control unit 50 determines to end the live view image display ("Yes" in step S430), the process exits the flowchart of the live view display process. Otherwise ("No" in step S430), the process returns to step S401.

[0072] In step S406, the system control unit 50 determines whether the current display mode setting is the left image enlarged display mode. More specifically, the system control unit 50 determines whether information about the left image enlarged display mode is stored in the control variable stored in the nonvolatile memory 219. If the left image enlarged display mode is set ("Yes" in step S406), the process proceeds to step S407. Otherwise ("No" in step S406), the process proceeds to step S414.

[0073] In step S407, the system control unit 50 enlarges the left image portion of the dual side-by-side image captured by the imaging unit 211 via the lens unit 300. The left image enlarged display mode is a mode for enlarging the image (left image) captured by the left eye optical system of the lens unit 300 in the real-time image captured by the imaging unit 211, and displaying the enlarged image in the display unit 108 as a live view. The system control unit 50 reads information about the enlargement position from the control variables stored in the system memory 218, and enlarges the area corresponding to the enlargement position of the image captured via the left eye optical system. In this case, if no information is stored in the control variables, or the enlargement position is not set in advance, the system control unit 50 enlarges the center portion of the image captured via the left eye optical system, and then displays the enlarged image. Figure 5B is a schematic diagram showing a live view image displayed in the left image enlarged display mode. As described above, Figure 5A A portion of the left image 501L in the image is enlarged and displayed as a live view image 502. A display optical system guide 503 and a button 507 are also displayed. Then, when the user performs a zoom-in operation in a state where the dual side-by-side images are displayed, the user can immediately check the details of a portion of either the right and left images (the left image).

[0074] In step S408, the system control unit 50 determines whether to end the enlarged display. More specifically, the system control unit 50 determines whether an instruction (enlargement end instruction) input in response to an operation to end the enlarged display is received. If the instruction is received, the system control unit 50 determines to end the enlarged display. For example, the system control unit 50 determines whether the user has performed an operation (enlargement end operation) that issues an instruction to end the display of the enlarged live view image. More specifically, the enlargement end operation is the user pressing the enlargement button 113. A pinch-out operation (zoom-out operation) on the touch panel 109 can also be detected as the enlargement end operation. If the enlargement end operation is detected, that is, if the system control unit 50 determines to end the enlarged display ("YES" in step S408), the process proceeds to step S409. On the other hand, if the enlargement end operation is not performed, that is, if the system control unit 50 determines not to end the enlarged display ("NO" in step S408), the process proceeds to step S410. If no operation is performed within a predetermined period of time since the start of the enlarged display (timeout), the system control unit 50 may determine to end the enlarged display.

[0075] In step S409, the system control unit 50 sets the display mode in live view display to the dual side-by-side image display mode. More specifically, the system control unit 50 stores information about the dual side-by-side image display mode in the control variable stored in the nonvolatile memory 219. Then, the process proceeds to step S430.

[0076] In step S410, the system control unit 50 determines whether an instruction for changing the enlarged position (enlarged range) that has been subjected to the enlargement process in the enlarged display is input. More specifically, the system control unit 50 determines whether the user has performed an operation for changing the enlarged position. Examples of the operation for changing the enlarged position include a "touch move" operation on the touch panel 109 and a cursor key operation. If the operation for changing the enlarged position is detected, that is, if the system control unit 50 determines that an instruction for changing the enlarged position is input ("Yes" in step S410), the process proceeds to step S411. On the other hand, if the system control unit 50 determines that no instruction is input ("No" in step S410), the process proceeds to step S412. In the operation for changing the enlarged position, the enlarged range can be set in the left image.

[0077] In step S411, the system control unit 50 performs processing for changing the zoom position. More specifically, the system control unit 50 changes the zoom position of the live image captured through the left-eye optical system based on the information about the direction and distance of the zoom position change operation detected in step S410. The system control unit 50 also stores the information about the zoom position in the control variables stored in the system memory 218. Then, the process proceeds to step S430.

[0078] In step S412, the system control unit 50 determines whether the user has performed an enlargement target right / left switching operation. More specifically, the system control unit 50 detects whether an operation is performed on the button 507 displayed in the display unit 108. If an operation is detected ("Yes" in step S412), the process proceeds to step S413. Otherwise ("No" in step S412), the process proceeds to step S430.

[0079] In step S413, the system control unit 50 sets the display mode in live view display to the right image enlarged display mode. More specifically, the system control unit 50 stores information about the right image enlarged display mode in the control variable stored in the nonvolatile memory 219. Then, the process proceeds to step S430.

[0080] The processing in the above steps S407 to S413 is processing in the left image enlarged display mode. In the left image enlarged display mode, the left image in the dual side-by-side image is subjected to enlargement processing alone and is enlarged. This enables the user to avoid identifying the displayed enlarged image as the right image part or the left image part in a confusing manner.

[0081] The operation in the right image enlarged display mode will be described.

[0082] In step S414, the system control unit 50 enlarges the right image portion of the dual side-by-side image captured by the imaging unit 211 through the lens unit 300. The right image enlarged display mode is a mode for enlarging the image (right image) captured by the right eye optical system of the lens unit 300 in the real-time image captured by the imaging unit 211, and displaying the enlarged image as a live view in the display unit 108. The system control unit 50 reads information about the enlargement position from the control variable stored in the system memory 218, and enlarges the area corresponding to the enlargement position of the image captured by the right eye optical system. In this case, if no information is stored in the control variable, or the enlargement position is not set in advance, the system control unit 50 subjects the central portion of the image captured by the right eye optical system to enlargement processing, and then displays the enlarged image. Figure 5C is a schematic diagram showing a live view image displayed in the right image enlargement display mode. As described above, Figure 5A A portion of the right image 501R in FIG. 5 is enlarged and displayed as a live view image 508. A display optical system guide 503 and a button 507 are displayed. Then, the process proceeds to step S415.

[0083] In step S415, the system control unit 50 determines whether to end the enlarged display. More specifically, the system control unit 50 determines whether an instruction (enlargement end instruction) input in response to an operation to end the enlarged display is received. If the instruction is received, the system control unit 50 determines to end the enlarged display. For example, the system control unit 50 determines whether the user has performed an operation (enlargement end operation) that issues an instruction to end the display of the enlarged live view image. More specifically, the enlargement end operation is the user pressing the enlargement button 113. A pinch-out operation on the touch panel 109 can also be detected as the enlargement end operation. If the enlargement end operation is detected, that is, if the system control unit 50 determines to end the enlarged display ("Yes" in step S415), the process proceeds to step S416. On the other hand, if the enlargement end operation is not performed, that is, if the system control unit 50 determines not to end the enlarged display ("No" in step S415), the process proceeds to step S417. If no operation is performed within a predetermined period of time since the enlarged display (timeout), the system control unit 50 may determine to end the enlarged display.

[0084] In step S416, the system control unit 50 sets the display mode in live view display to the dual side-by-side image display mode. More specifically, the system control unit 50 stores information about the dual side-by-side image display mode in the control variable stored in the nonvolatile memory 219. Then, the process proceeds to step S430.

[0085] In step S417, the system control unit 50 determines whether an instruction for changing the enlarged position (enlarged range) that has been subjected to the enlargement process in the enlarged display is input. More specifically, the system control unit 50 determines whether the user has performed an operation for changing the enlarged position. Examples of the operation for changing the enlarged position include a "touch move" operation on the touch panel 109 and a cursor key operation. If the operation for changing the enlarged position is detected, that is, if the system control unit 50 determines that an instruction for changing the enlarged position is input ("Yes" in step S417), the processing proceeds to step S418. On the other hand, if the system control unit 50 determines that no instruction is input ("No" in step S417), the processing proceeds to step S419. In the operation for changing the enlarged position, the enlarged range can be set in the left image.

[0086] In step S418, the system control unit 50 performs processing for changing the zoom-in position. More specifically, the system control unit 50 changes the zoom-in position of the live image captured through the right-eye optical system based on the information about the direction and distance of the zoom-in position changing operation detected in step S417. The system control unit 50 also stores the information about the zoom-in position in the control variables stored in the system memory 218. Then, the process proceeds to step S430.

[0087] In step S419, the system control unit 50 determines whether the user has performed an enlargement target right / left switching operation. More specifically, the system control unit 50 detects whether an operation is performed on the button 507 displayed in the display unit 108. If an operation is detected ("Yes" in step S419), the process proceeds to step S420. Otherwise ("No" in step S419), the process proceeds to step S430.

[0088] In step S420, the system control unit 50 sets the display mode in live view display to the left image enlarged display mode. More specifically, the system control unit 50 stores information about the left image enlarged display mode in the control variable stored in the nonvolatile memory 219. Then, the process proceeds to step S430.

[0089] The processing in the above steps S414 to S420 is processing in the right image enlarged display mode. In the right image enlarged display mode, the right image in the dual side-by-side image is individually enlarged and enlarged. This enables the user to avoid identifying the displayed enlarged image as the right image portion or the left image portion in a confusing manner.

[0090] As described above, in the case where the lens unit 300 for acquiring the dual side-by-side images is attached to the camera 100 and the image is displayed based on the dual side-by-side images, the system control unit 50 of the camera 100 enlarges the right or left image according to the enlargement instruction. With the enlarged display mode, the above control can prevent the right and left image parts from being mixed in the displayed image, thereby improving the visibility of the user.

[0091] The system control unit 50 of the camera 100 according to the present exemplary embodiment changes the setting of the enlargement target range according to the type of lens unit attached to the camera 100 in response to issuance of the enlargement processing instruction. The operation of the lens unit 200 as a conventional single lens unit attached to the camera 100 will be described.

[0092] In step S421, the system control unit 50 determines whether the display mode setting at the time of live view display is the enlarged display mode. More specifically, the system control unit 50 determines whether information about the enlarged display mode is stored in the control variable stored in the nonvolatile memory 219. If the enlarged display mode is set ("Yes" in step S421), the process proceeds to step S425. Otherwise ("No" in step S421), the process proceeds to step S422.

[0093] In step S422, the system control unit 50 displays the real-time image captured by the imaging unit 211 through the lens unit 200 in the live view of the display unit 108 in the normal display mode. The normal display mode is a mode for displaying the real-time image captured by the imaging unit 211 through the optical system of the lens unit 200 in the live view of the display unit 108 without magnification. Fig. 6A An example of a live view image 509 when live view display is performed in the normal display mode is shown. The process proceeds to step S423.

[0094] In step S423, the system control unit 50 determines whether the user has performed an operation of enlarging the live view image. More specifically, the system control unit 50 determines whether a zoom-in instruction input by a zoom-in operation is received. For example, the zoom-in instruction is input by pressing the zoom-in button 113 or performing a pinch-out operation on the touch panel 109. If a zoom-in instruction is received, that is, if the system control unit 50 determines that the user has performed an operation of enlarging the live view image ("Yes" in step S423), the process proceeds to step S424. If no operation is detected ("No" in step S423), the process proceeds to step S430.

[0095] In step S424, the system control unit 50 sets the display mode at the time of live view display to the enlarged display mode. More specifically, the system control unit 50 stores information about the enlarged display mode in the control variable stored in the nonvolatile memory 219. Then, the process proceeds to step S430.

[0096] In step S425, the system control unit 50 displays the real-time image captured by the imaging unit 211 through the lens unit 200 in the live view of the display unit 108 in the enlarged display mode. The enlarged display mode is a mode for enlarging the real-time image captured by the imaging unit 211 via the optical system of the lens unit 200 and then displaying the enlarged image in the live view of the display unit 108. The system control unit 50 reads information about the enlarged position from the control variables stored in the system memory 218, and enlarges the position corresponding to the real-time image captured via the normal lens unit. If no information is stored in the control variables, the center position of the image is predetermined as the initial position of the enlarged position. Figure 6B An example of a live view image 509 when live view display is performed in the enlarged display mode is shown. Enlarged position guides 510 and 511 indicate which position of the live image before enlargement is enlarged as the live image currently displayed. Enlarged position guide 510 corresponds to the entire live image before enlargement, and enlarged position guide 511 indicates the enlarged area currently being displayed. Then, the process proceeds to step S426.

[0097] In step S426, the system control unit 50 determines whether to end the enlarged display. More specifically, the system control unit 50 determines whether an instruction (enlargement end instruction) input in response to an operation to end the enlarged display is received. If the instruction is received, the system control unit 50 determines to end the enlarged display. For example, the system control unit 50 determines whether the user has performed an operation (enlargement end operation) that issues an instruction to end the display of the enlarged live view image. More specifically, the enlargement end operation is the user pressing the enlargement button 113. A pinch-out operation on the touch panel 109 can also be detected as the enlargement end operation. If the enlargement end operation is detected, that is, if the system control unit 50 determines to end the enlarged display ("Yes" in step S426), the process proceeds to step S427. On the other hand, if the enlargement end operation is not performed, that is, if the system control unit 50 determines not to end the enlarged display ("No" in step S427), the process proceeds to step S428. If no operation is performed within a predetermined period of time since the enlarged display (timeout), the system control unit 50 may determine to end the enlarged display.

[0098] In step S427, the system control unit 50 sets the display mode at the time of live view display to the normal display mode. More specifically, the system control unit 50 stores information about the normal display mode in the control variable stored in the nonvolatile memory 219. Then, the process proceeds to step S430.

[0099] In step S428, the system control unit 50 determines whether an instruction for changing the enlarged position (enlarged range) that has been subjected to the enlargement process in the enlarged display is input. More specifically, the system control unit 50 determines whether the user has performed an operation for changing the enlarged position. Examples of the operation for changing the enlarged position include a "touch move" operation on the touch panel 109 and a cursor key operation. If the operation for changing the enlarged position is detected, that is, if the system control unit 50 determines that an instruction for changing the enlarged position is input ("Yes" in step S428), the process proceeds to step S429. On the other hand, if the system control unit 50 determines that no instruction is input ("No" in step S428), the process proceeds to step S430.

[0100] In step S429, the system control unit 50 changes the zoom-in position of the live view image. More specifically, the system control unit 50 changes the zoom-in position of the live image captured through the optical system of the lens unit 200 based on the information about the direction and distance of the zoom-in position change operation detected in step S428. The system control unit 50 also stores the information about the zoom-in position in the control variables stored in the system memory 218. Then, the process proceeds to step S430.

[0101] As described above, in the case where the lens unit 200 is attached to the camera 100 as a conventional single lens unit, the system control unit 50 of the camera 100 according to the present exemplary embodiment enlarges the central portion of the image according to the zoom instruction. The lens unit 300 is attachable to the camera 100 as a dual lens unit capable of acquiring dual side-by-side images. The dual side-by-side images include a right image and a left image having parallax arranged side by side. When the dual lens unit is attached to the camera 100, the system control unit 50 of the camera 100 enlarges the central portion of one of the left and right images according to the zoom instruction. More specifically, the system control unit 50 changes the position of the zoom range subjected to the zoom processing according to the type of the lens unit attached to the camera 100. This eliminates the need for the user to change the setting of the zoom target position each time according to the type of the lens unit, thereby easily providing an enlarged display with an appropriate zoom range.

[0102] As described above, in image capture using a dual lens unit according to the present exemplary embodiment, even if images from the right optical system and the left optical system are displayed side by side, one of the right and left images is enlarged when displayed in an enlarged manner. This makes it possible to reduce the difficulty for the user to recognize the enlarged boundary portion between the right and left images. In the present exemplary embodiment, an electronic device is provided that enlarges one of the right and left images to make it easier for the user to check the details of the image.

[0103] Although the present exemplary embodiment is described on the premise that a live view image displayed through a dual lens unit is displayed after being enlarged, the present exemplary embodiment is also applicable to a case where an image photographed through a dual lens unit and reproduced from a secure digital (SD) card is displayed after being enlarged.

[0104] The present exemplary embodiment has been described above around the case where the enlarged position is moved within the left image area during the enlarged display of the left image or within the right image area during the enlarged display of the right image. However, when an instruction for moving the enlarged position beyond the end of the right or left image (i.e., an instruction for changing the enlarged position to the outside of either image) is received, the enlarged position can be moved to the end area of ​​the other image. For example, when the right end area of ​​the left image is displayed in the left image enlarged display mode, when an instruction to further move the enlarged position to the right is received, the right image enlarged display mode is entered, and then the enlarged position is moved to the left end area of ​​the right image. In this case, the movement instruction can be issued in such a way that the enlarged position is gradually moved from the state where the end of the image is not enlarged, and then the enlarged position eventually exceeds the end of the image. In this case, the enlarged position can be moved to the position of the end of the image to be enlarged without causing the other image to move through the enlarged position. Then, when an instruction to move the enlarged position beyond the end of the image is issued again, the enlarged position can be moved to the end area of ​​the other image.

[0105] After an instruction is issued to move the enlarged position beyond an end of an enlarged image, another image can be enlarged and arranged next to the current enlarged image, and an image including an enlarged right end area of ​​the left image and an enlarged left end area of ​​the right image can be displayed.

[0106] Although in this example, an enlarged version of an image captured by one optical system is displayed alone in the live view, a live image captured by another optical system may be displayed together with the enlarged image without being enlarged. Figure 5D An example display in this case is shown in . Figure 5D An enlarged version of a real-time image 512 captured by the left-eye optical system and a real-time image 513 captured by the right-eye optical system are shown. In this case, since the user wants to check the details of the enlarged version of the real-time image captured by the left-eye optical system, the real-time image 513 captured by the right-eye optical system is partially hidden. According to the present invention, any other image may be displayed simultaneously as long as the real-time image captured by the left-eye optical system or the real-time image captured by the right-eye optical system is enlarged.

[0107] Although the present invention has been specifically described based on exemplary embodiments, the present invention is not limited to these specific exemplary embodiments. Various embodiments that do not depart from the spirit and scope of the present invention are also included in the present invention. Parts of the above exemplary embodiments may be appropriately combined.

[0108] Other embodiments

[0109] The embodiments of the present invention may also be implemented by providing software (program) for performing the functions of the above-described embodiments to a system or device via a network or various storage media, and a computer or a central processing unit (CPU) or a microprocessing unit (MPU) of the system or device reads and executes the program.

[0110] The present invention enables image display suitable for checking details of an image including a right-eye image and a left-eye image arranged side by side.

[0111] While the present invention has been described with reference to exemplary embodiments, the scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.

Claims

1. An electronic device, include: a connecting unit configured to be connected to the lens unit; an imaging unit configured to generate image data based on an optical image input through the lens unit; a control unit configured to display an image in a display unit based on the image data; and a receiving unit configured to receive a zoom-in instruction for zooming in a portion of an image displayed in the display unit, The control unit performs: In a case where a first type of lens unit is connected to the connecting unit, when the receiving unit receives a zoom-in instruction, an enlarged image of a first area of ​​the image generated by the camera unit is displayed in the display unit, wherein the lens unit includes a first optical system that inputs a first optical image, and a second optical system that inputs a second optical image having a predetermined parallax with respect to the first optical image; and When a second type of lens unit is connected to the connecting unit, when the receiving unit receives a zoom instruction, an enlarged image of a second area different in position from the first area of ​​the image generated by the camera unit is displayed in the display unit, wherein the lens unit includes a single optical system.

2. The electronic device according to claim 1, in, The enlarged image includes a portion of either the first optical image or the second optical image, but does not include a portion of the other of the first optical image and the second optical image.

3. The electronic device according to claim 1, in, The receiving unit is configured to receive an amplification end instruction for ending amplification, and When a zoom-in end instruction is detected during display of the zoomed-in image, the control unit performs control to display a third image that is not zoomed in, wherein the third image includes the first optical image and the second optical image.

4. The electronic device according to claim 1, in, When a zoom-in instruction is received during display of a third image including the first optical image and the second optical image, a portion of the first optical image corresponding to a zoom-in range including the center of the first optical image is zoomed in and then displayed in the display unit.

5. The electronic device according to claim 1, in, When the receiving unit receives an operation for changing a zoom-in position of a third image including the first optical image and the second optical image, the control unit changes a zoom-in target range outside the third image, wherein, in a case where the enlarged image is obtained by enlarging a portion of the first optical image, the enlargement range is changed within the first optical image, and Wherein, in a case where the enlarged image is obtained by enlarging a portion of the second optical image, the enlargement range is changed within the second optical image.

6. The electronic device according to claim 1, in, When the receiving unit receives an operation for changing a zoom-in position of a third image including the first optical image and the second optical image, the control unit changes the zoom-in target range outside the third image, wherein, in a case where the enlarged image is obtained by enlarging a portion of the first optical image, upon receiving an operation for changing the enlargement range to outside the first optical image, the control unit enlarges a portion of the second optical image, and Wherein, in a case where the enlarged image is obtained by enlarging a portion of the second optical image, upon receiving an operation for changing the enlargement range to outside the second optical image, the control unit enlarges a portion of the first optical image.

7. The electronic device according to claim 1, in, The receiving unit is configured to: receive a switching instruction for switching between a first display mode for displaying an enlarged image including an enlarged portion of the first optical image and a second display mode for displaying an enlarged image including an enlarged portion of the second optical image, and The control unit changes the magnification target range of the third image including the first optical image and the second optical image according to the switching instruction received by the receiving unit.

8. The electronic device according to claim 7, in, When switching from the first display mode to the second display mode, the control unit sets a position of the second optical image corresponding to the enlarged position of the first optical image as the enlarged position in the third image and then generates the enlarged image.

9. The electronic device according to claim 7, in, When switching from the first display mode to the second display mode, the control unit performs control so that an enlarged position of the enlarged image after conversion and an enlarged position of the image before conversion are shifted by a parallax between the first optical image and the second optical image.

10. The electronic device according to claim 1, in, When the enlarged image is displayed, the control unit issues a notification indicating which of the first optical image and the second optical image is currently being enlarged.

11. The electronic device according to claim 1, in, When the enlarged image is displayed, the control unit issues a notification indicating an enlarged position in a third image including the first optical image and the second optical image.

12. The electronic device according to claim 1, in, The first region includes any one of an image region corresponding to a first optical image input through the first type of lens unit and an image region corresponding to a second optical image input through the first type of lens unit.

13. The electronic device according to claim 12, in, The first region is any one of a region including the center of the first optical image in the image and a region including the center of the second optical image in the image. The electronic device according to claim 1 , wherein the second area is an area including a center of the image.

15. The electronic device according to claim 1, in, Information about the location of a portion of the image data is stored in a memory, and Wherein, if the information is stored in the memory, upon receiving a zoom-in instruction, an enlarged image of a portion of the image data based on the information stored in the memory is displayed in the display unit regardless of the type of the lens unit connected to the connection unit.

16. The electronic device according to claim 1, further comprising: include: a changing unit configured to change a portion of the image data into an enlarged image, Wherein, in case that the lens unit of the first type is connected to the connecting unit, a part of the image data can be changed only in the first optical image area or the second optical image area.

17. The electronic device according to claim 16, in, When an instruction for changing the outside of the first optical image area or the second optical image area is received, a part of the image data as the image to be enlarged is changed to an end portion of the other image area.

18. The electronic device according to claim 16, in, The control unit is configured to perform control to store information related to that a position of a part of the image data as the image to be enlarged is changed in the memory.

19. The electronic device according to claim 1, in, The control unit is configured to control to switch a portion of the image data to be enlarged between the first optical image area and the second optical image area in a case where the first type lens unit is connected to the connecting unit.

20. The electronic device according to claim 1, in, The control unit is configured to control to display a guide in the display unit when the first type of lens unit is connected to the connecting unit, the guide indicating which of the enlarged images of the first optical image area and the second optical image area of ​​the image data generated by the camera unit is currently displayed.

21. The electronic device according to claim 1, in, The first optical image area and the second optical image area include circular optical images.

22. The electronic device according to claim 1, in, Image data is generated by forming a first optical image corresponding to a first optical image area and a second optical image corresponding to a second optical image area side by side on an image pickup unit.

23. The electronic device according to claim 1, in, The image data is a live view image.

24. A method for controlling an electronic device, the electronic device include: a connecting unit configured to be connected to the lens unit; and An imaging unit configured to generate image data based on an optical image input through a lens unit, the method comprising: performing control based on the image data to display the image in the display unit; and receiving a zoom-in instruction for zooming in a portion of an image displayed in a display unit; Wherein, the control includes: In a case where a lens unit of a first type is connected to the connection unit, upon receiving a zoom-in instruction, displaying an enlarged image of a first area of ​​an image generated by the imaging unit in the display unit, wherein the lens unit includes a first optical system that inputs a first optical image, and a second optical system that inputs a second optical image having a predetermined parallax with respect to the first optical image; and When a second type of lens unit is connected to the connection unit, upon receiving a zoom instruction, an enlarged image of a second area different in position from the first area of ​​the image generated by the camera unit is displayed in the display unit, wherein the lens unit includes a single optical system.

25. A non-transitory computer-readable storage medium storing a program, which, when executed by a processor, causes the processor to execute a method of controlling an electronic device, the method include: displaying an image in a display unit based on image data generated by an optical image input via a lens unit connectable to the connection unit; receiving a zoom-in instruction for zooming in a portion of an image displayed in a display unit; In a case where a lens unit of a first type is connected to the connecting unit, upon receiving a zoom-in instruction, displaying an enlarged image of a first area of ​​the generated image in the display unit, wherein the lens unit includes a first optical system that inputs a first optical image, and a second optical system that inputs a second optical image having a predetermined parallax with respect to the first optical image; and In the case where a second type lens unit is connected to the connection unit, upon receiving a zoom-in instruction, an enlarged image of a second area different in position from the first area where the image is generated is displayed in the display unit, wherein the lens unit includes a single optical system.

Images