Electronic device, control method thereof, program, and storage medium

Abstract

To provide image display suitable for checking details of an image in which an image for the left eye and an image for the right eye are arranged side by side.SOLUTION: A camera 100 of the present invention has a system control unit 50 that displays an image on a display 108 on the basis of a twin-lens image including a left image picked up through a left eye optical system 301L and a right image picked up through a right eye optical system 301R and having parallax with respect to the left image, and receives an enlargement instruction for enlarging and displaying a part of the image displayed on the display 108. When receiving the enlargement instruction during the display of the twin-lens image, the system control unit 50 displays, on the display 108, an enlarged image obtained by enlarging a part of any one of the left image and the right image.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The present invention relates to an electronic device, a control method thereof, a program, and a recording medium. [Background technology]

[0002] There is a known technology that uses two optical systems to obtain a wide-angle image with parallax, and maps and displays it on a virtual sphere to display a three-dimensional virtual reality (VR) image. A two-lens VR camera for capturing images with parallax has two optical systems facing the same direction, and can obtain two images with parallax with one capture. Some two-lens VR cameras can capture a wide range of more than 180 degrees up, down, left, and right (hemisphere, 90 degrees in all directions from the center of the image) with each optical system. In addition, known methods for displaying VR images include "single-lens VR display," which displays one image by transforming the VR image to map it on a virtual sphere, and "two-lens VR display," which displays VR images for the left and right eyes side by side in the left and right areas.

[0003] Patent Document 1 discloses a stereoscopic imaging device that uses two imaging units arranged laterally with parallax to capture images of the same subject from left and right viewpoints, thereby obtaining an image for the left eye and an image for the right eye, respectively. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] WO 11 / 121840 Summary of the Invention [Problem to be solved by the invention]

[0005] Until now, there has been little consideration given to the control of enlargement processing for an image in which a left-eye image and a right-eye image are arranged side by side. For example, when enlargement processing is performed on an area that spans a left-eye image and a right-eye image, the non-corresponding areas on the left and right are enlarged, which is not appropriate for a user to check the details of one of the images.

[0006] The present invention has been made in consideration of the problems described above, and aims to provide an image display suitable for checking image details in an image in which an image for the left eye and an image for the right eye are arranged side by side. [Means for solving the problem]

[0007] The electronic device of the present invention has a control means for displaying an image on a display unit based on a third image in which a first image captured through a first optical system and a second image having parallax with respect to the first image captured through a second optical system are arranged in a side-by-side manner, or a fourth image captured through a single optical system, and a receiving means for receiving an enlargement instruction to enlarge and display a portion of the image displayed on the display unit, wherein when the control means receives the enlargement instruction while the third image is being displayed, the control means displays on the display unit an enlarged image in which a first region, which is a portion of either the first image or the second image, is enlarged, and when the control means receives the enlargement instruction while the fourth image is being displayed, the control means displays on the display unit an enlarged image in which a second region of the fourth image is enlarged, and wherein the position of the first region relative to the third image and the position of the second region relative to the fourth image are different. Effect of the Invention

[0008] According to the present invention, it is possible to realize image display suitable for checking image details in an image in which a left eye image and a right eye image are arranged side by side. [Brief description of the drawings]

[0009] [Figure 1] FIG. 2 is a schematic diagram showing the external configuration of the camera. [Diagram 2] FIG. 2 is a schematic diagram showing the internal configuration of the camera. [Diagram 3] FIG. 2 is a schematic diagram showing a configuration of a lens unit. [Figure 4] 10 is a flowchart showing a live view display process of the camera. [Diagram 5] FIG. 2 is a schematic diagram showing a live view image of a twin-lens image. [Figure 6] FIG. 2 is a schematic diagram showing a live view image of a single-lens image. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, preferred embodiments of the present invention will be described with reference to the drawings. In this embodiment, the electronic device will be described as a digital camera (imaging device).

[0011] FIG. 1 is a diagram showing an example of the external configuration of a digital camera 100 (hereinafter, simply referred to as a camera). FIG. 1(a) is a perspective view of the camera 100 seen from the front, and FIG. 1(b) is a perspective view of the camera 100 seen from the back. The camera 100 has a shutter button 101, a power switch 102, a mode switch 103, a main electronic dial 104, a sub electronic dial 105, a video button 106, and an outside viewfinder display unit 107 on the top surface. The shutter button 101 is an operation unit for preparing for shooting or issuing an instruction to shoot. The power switch 102 is an operation unit for switching the power of the camera 100 on and off. The mode switch 103 is an operation unit for switching between various modes. The main electronic dial 104 is a rotary operation unit for changing settings such as the shutter speed and aperture. The sub electronic dial 105 is a rotary operation unit for moving a selection frame (cursor), forwarding images, and the like. The video button 106 is an operation unit for issuing instructions to start and stop video shooting (recording). An outside viewfinder display unit 107 displays various setting values ​​such as shutter speed and aperture.

[0012] The camera 100 has a display unit 108, a touch panel 109, a direction key 110, a SET button 111, an AE lock button 112, a magnification button 113, a playback button 114, a menu button 115, an eyepiece unit 116, an eyepiece detection unit 118, and a touch bar 119 on the rear side. The display unit 108 displays images and various information. The touch panel 109 is an operation unit that detects a touch operation on the display surface (touch operation surface) of the display unit 108. The direction key 110 is an operation unit composed of keys (four-way keys) that can be pressed up, down, left, and right. An operation can be performed according to the position where the direction key 110 is pressed. The SET button 111 is an operation unit that is pressed mainly when deciding a selection item. The AE lock button 112 is an operation unit that is pressed when fixing an exposure state in a shooting standby state. The magnification button 113 is an operation unit for switching the magnification mode on and off in the live view display (LV display) of the shooting mode. When the enlargement mode is on, the live view image (LV image) is enlarged or reduced by operating the main electronic dial 104. The enlargement button 113 is used to enlarge the playback image or increase the magnification in the playback mode. The playback button 114 is an operation unit for switching between the shooting mode and the playback mode. In the shooting mode, pressing the playback button 114 switches to the playback mode, and the latest image among the images recorded in the recording medium 227 described later can be displayed on the display unit 108.

[0013] Menu button 115 is an operation unit that is pressed when displaying a menu screen on display unit 108 that allows various settings to be made. The user can intuitively make various settings using the menu screen displayed on display unit 108, direction key 110, and SET button 111. Eyepiece unit 116 is a portion for placing an eye on eyepiece finder (peek-in type finder) 117. The user can view an image displayed on an internal EVF 217 (Electronic View Finder) described later through eyepiece unit 116. Eyepiece detection unit 118 is a sensor that detects whether the user places his / her eye on eyepiece unit 116.

[0014] The touch bar 119 is a line-shaped touch operation unit (line touch sensor) capable of receiving a touch operation. The touch bar 119 is disposed at a position where it can be touched (touched) by the thumb of the right hand when the grip unit 120 is held by the right hand (holding it with the little finger, ring finger, and middle finger of the right hand) so that the shutter button 101 can be pressed by the index finger of the right hand. That is, the touch bar 119 can be operated by placing the eyepiece unit 116 close to the eyepiece 116, looking into the eyepiece finder 117, and holding it in a position (shooting posture) so that the shutter button 101 can be pressed at any time. The touch bar 119 can receive a tap operation (operation of touching and releasing without moving within a predetermined period of time) on the touch bar 119, a slide operation to the left and right (operation of touching and then moving the touch position while keeping the touch), and the like. The touch bar 119 is an operation unit different from the touch panel 109, and does not have a display function. The touch bar 119 of this embodiment is a multi-function bar, and functions as, for example, an M-Fn bar.

[0015] The camera 100 also includes a grip section 120, a thumb rest section 121, a terminal cover 122, a cover 123, a communication terminal 124, and the like. The grip section 120 is a holding section formed in a shape that is easy to hold with the right hand when the user holds the camera 100. The shutter button 101 and the main electronic dial 104 are arranged at positions that can be operated with the index finger of the right hand when the camera 100 is held by gripping the grip section 120 with the little finger, ring finger, and middle finger of the right hand. In a similar state, the sub electronic dial 105 and the touch bar 119 are arranged at positions that can be operated with the thumb of the right hand. The thumb rest section 121 (thumb standby position) is a grip section provided on the rear side of the camera 100 at a position where it is easy to place the thumb of the right hand that holds the grip section 120 when none of the operation sections are being operated. The thumb rest section 121 is made of a rubber member or the like for increasing the holding force (grip feeling). The terminal cover 122 protects connectors such as a connection cable that connects the camera 100 to an external device. The cover 123 protects the recording medium 227 and the slot by closing the slot for storing the recording medium 227 described later. The communication terminal 124 is a terminal for communicating with the detachable lens unit 200 described later of the camera 100.

[0016] Fig. 2 is a diagram showing an example of the internal configuration of camera 100. Note that the same components as those in Fig. 1 are given the same reference numerals and their description will be omitted as appropriate. Lens unit 200 or lens unit 300 described below is attached to camera 100. First, a camera system composed of camera 100 and lens unit 200 will be described using lens unit 200, which is a conventional single lens, as an example.

[0017] Lens unit 200 is a type of interchangeable lens that can be attached to and detached from camera 100. Lens unit 200 is a single lens and is an example of a normal lens. Unlike lens unit 300, which will be described later, lens unit 200 has a single optical system.

[0018] The lens unit 200 includes an aperture 201, a lens 202, an aperture drive circuit 203, an AF (autofocus) drive circuit 204, a lens system control circuit 205, a communication terminal 206, and the like. The aperture 201 is configured so that the aperture diameter can be adjusted. The lens 202 is composed of a plurality of lenses. The aperture drive circuit 203 adjusts the amount of light by controlling the aperture diameter of the aperture 201. The AF drive circuit 204 drives the lens 202 to adjust the focus. The lens system control circuit 205 controls the aperture drive circuit 203, the AF drive circuit 204, and the like based on an instruction from a system control unit 50, which will be described later. The lens system control circuit 205 controls the aperture 201 via the aperture drive circuit 203, and adjusts the focus by displacing the position of the lens 202 via the AF drive circuit 204. The lens system control circuit 205 is capable of communicating with the camera 100. Specifically, communication is performed via a communication terminal 206 of the lens unit 200 and a communication terminal 124 of the camera 100. The communication terminal 206 is a terminal through which the lens unit 200 communicates with the camera 100 side.

[0019] Next, a description will be given of the camera 100. The camera 100 has a shutter 210, an imaging unit 211, an A / D converter 212, a memory control unit 213, an image processing unit 214, a memory 215, a D / A converter 216, an EVF 217, a display unit 108, and a system control unit 50.

[0020] The shutter 210 is a focal plane shutter that can freely control the exposure time of the imaging unit 211 based on an instruction from the system control unit 50. The imaging unit 211 is an imaging element (image sensor) composed of a CCD, CMOS element, or the like that converts an optical image into an electrical signal. The imaging unit 211 may have an imaging surface phase difference sensor that outputs defocus amount information to the system control unit 50. The A / D converter 212 converts an analog signal output from the imaging unit 211 into a digital signal.

[0021] The image processing unit 214 performs predetermined processing (pixel interpolation, resizing such as reduction, color conversion, etc.) on the data from the A / D converter 212 or the data from the memory control unit 213. The image processing unit 214 also performs predetermined arithmetic processing using the captured image data, and the system control unit 50 performs exposure control and distance measurement control based on the obtained arithmetic results. This processing allows TTL (through-the-lens) AF processing, AE (automatic exposure) processing, EF (flash pre-flash) processing, etc. to be performed. Furthermore, the image processing unit 214 performs predetermined arithmetic processing using the captured image data, and performs TTL AWB (auto white balance) processing based on the obtained arithmetic results.

[0022] The image data from the A / D converter 212 is written to the memory 215 via the image processing unit 214 and the memory control unit 213. Alternatively, the image data from the A / D converter 212 is written to the memory 215 via the memory control unit 213 without going through the image processing unit 214. The memory 215 stores image data obtained by the imaging unit 211 and converted into digital data by the A / D converter 212, and image data to be displayed on the display unit 108 and the EVF 217. The memory 215 has a storage capacity sufficient to store a predetermined number of still images and a predetermined period of moving images and audio. The memory 215 also serves as a memory for displaying images (video memory).

[0023] The D / A converter 216 converts the image display data stored in the memory 215 into an analog signal and supplies it to the display unit 108 or the EVF 217. Therefore, the display image data written in the memory 215 is displayed on the display unit 108 or the EVF 217 via the D / A converter 216. The display unit 108 or the EVF 217 performs display according to the analog signal from the D / A converter 216. The display unit 108 or the EVF 217 is, for example, an LCD or an organic EL display. A digital signal that has been A / D converted by the A / D converter 212 and stored in the memory 215 is converted into an analog signal by the D / A converter 216, and the analog signal is sequentially transferred to and displayed on the display unit 108 or the EVF 217, thereby performing live view display.

[0024] The system control unit 50 is a control unit consisting of at least one processor and / or at least one circuit. That is, the system control unit 50 may be a processor, a circuit, or a combination of a processor and a circuit. The system control unit 50 controls the entire camera 100. The system control unit 50 executes a program recorded in the non-volatile memory 219 to realize each process of the flowchart described later. The system control unit 50 also performs display control by controlling the memory 215, the D / A converter 216, the display unit 108, the EVF 217, and the like. The system control unit 50 also functions as a receiving unit that receives instructions input in response to operations on the various operation units described above. The system control unit 50 executes control in response to the received instructions.

[0025] The camera 100 also has a system memory 218, a non-volatile memory 219, a system timer 220, a communication unit 221, an attitude detection unit 222, and an eyepiece detection unit 118. The system memory 218 is, for example, a RAM. Constants and variables for the operation of the system control unit 50, programs read from the non-volatile memory 219, and the like are deployed in the system memory 218. The non-volatile memory 219 is an electrically erasable and recordable memory, for example, an EEPROM is used. Constants and programs for the operation of the system control unit 50 are recorded in the non-volatile memory 219. The program here is a program for executing a flowchart described later. The system timer 220 is a timekeeping unit that measures the time used for various controls and the time of a built-in clock.

[0026] The communication unit 221 transmits and receives video signals and audio signals to and from an external device connected wirelessly or via a wired cable. The communication unit 221 can also connect to a wireless LAN (Local Area Network) or the Internet. The communication unit 221 can also communicate with an external device via Bluetooth (registered trademark) or Bluetooth Low Energy. The communication unit 221 can transmit images (including live images) captured by the imaging unit 211 and images recorded in a recording medium 227, and can receive image data and various other information from an external device.

[0027] The attitude detection unit 222 detects the attitude of the camera 100 with respect to the direction of gravity. Based on the attitude detected by the attitude detection unit 222, it is possible to determine whether the image captured by the imaging unit 211 is an image captured with the camera 100 held horizontally or vertically. The system control unit 50 can add orientation information corresponding to the attitude detected by the attitude detection unit 222 to the image file of the image captured by the imaging unit 211, or rotate and record the image. The attitude detection unit 222 can use, for example, an acceleration sensor or a gyro sensor. It is also possible to use the attitude detection unit 222 to detect the movement of the camera 100 (panning, tilting, lifting, whether or not it is stationary, etc.).

[0028] Eyepiece detection unit 118 can detect the approach of some object to eyepiece unit 116 of eyepiece finder 117 incorporating EVF 217. Eyepiece detection unit 118 can use, for example, an infrared proximity sensor. When an object approaches, infrared rays projected from a light-projecting unit of eyepiece detection unit 118 are reflected by the object and received by a light-receiving unit of the infrared proximity sensor. The distance from eyepiece unit 116 to the object can be determined based on the amount of infrared rays received. In this way, eyepiece detection unit 118 performs eyepiece detection to detect the approaching distance of the object to eyepiece unit 116.

[0029] The eye-contact detection unit 118 is an eye-contact detection sensor that detects the approach (eye-contact) and separation (eye-separation) of an eye (object) to the eyepiece unit 116 of the eyepiece finder 117. When an object approaching within a predetermined distance from the eyepiece unit 116 is detected from a non-eye-contact state (non-approaching state), the eye-contact is detected. On the other hand, when an object that was detected as approaching from the eye-contact state (approaching state) moves away from the eyepiece unit 116 by a predetermined distance or more, the eye-separation is detected. The threshold value for detecting the approach and the threshold value for detecting the separation may be different, for example, by providing a hysteresis. After detecting the approach of the eye, the eye-contact state is maintained until the separation is detected. After detecting the separation of the eye, the non-eye-contact state is maintained until the eye-separation is detected. The system control unit 50 switches the display unit 108 and the EVF 217 between display (display state) / non-display (non-display state) according to the state detected by the eye-contact detection unit 118. Specifically, when at least in a shooting standby state and the display destination switching setting is automatic switching, the display destination is set to the display unit 108 and the display is turned on when the eye is not placed near the camera, and the EVF 217 is hidden. Also, when the eye is placed near the camera, the display destination is set to the EVF 217 and the display is turned on, and the display unit 108 is hidden. Note that the eye-placement detection unit 118 is not limited to an infrared proximity sensor, and other sensors may be used as long as they can detect a state that can be regarded as an eye-placement state.

[0030] Furthermore, camera 100 has an outside-finder display unit 107, an outside-finder display drive circuit 223, a power supply control unit 224, a power supply unit 225, a recording medium I / F 226, an operation unit 228, etc. Outside-finder display unit 107 displays various settings of camera 100, such as shutter speed and aperture, via outside-finder display drive circuit 223.

[0031] The power supply control unit 224 is composed of a battery detection circuit, a DC-DC converter, a switch circuit for switching between blocks to which electricity is applied, etc., and detects whether a battery is attached, the type of battery, the remaining battery level, etc. The power supply control unit 224 also controls the DC-DC converter based on the detection results and instructions from the system control unit 50, and supplies the required voltage to each unit including the recording medium 227 for the required period of time.

[0032] The power supply unit 225 is a primary battery such as an alkaline battery or a lithium battery, a secondary battery such as a NiCd battery, a NiMH battery or a Li battery, an AC adapter, etc. The recording medium I / F 226 is an interface with a recording medium 227 such as a memory card or a hard disk. The recording medium 227 is a memory card or the like for recording captured images, and is composed of a semiconductor memory, a magnetic disk, etc. The recording medium 227 may be removable or may be built-in.

[0033] The operation unit 228 is an input unit that accepts operations from the user (user operations) and is used to input various instructions to the system control unit 50. The operation unit 228 includes the shutter button 101, the power switch 102, the mode changeover switch 103, the touch panel 109, and other operation units 229. The other operation units 229 include the main electronic dial 104, the sub electronic dial 105, the video button 106, the direction keys 110, the SET button 111, the AE lock button 112, the enlargement button 113, the playback button 114, the menu button 115, the touch bar 119, and the like.

[0034] The shutter button 101 has a first shutter switch 230 and a second shutter switch 231. The first shutter switch 230 is turned on when the shutter button 101 is pressed halfway (instruction to prepare for shooting) during operation, and generates a first shutter switch signal SW1. The system control unit 50 starts preparation processes for shooting, such as AF processing, AE processing, AWB processing, and EF processing, in response to the first shutter switch signal SW1. The second shutter switch 231 is turned on when the shutter button 101 is pressed fully (instruction to shoot) and generates a second shutter switch signal SW2. The system control unit 50 starts a series of shooting processes, from reading out a signal from the imaging unit 211 to generating an image file including a shot image and writing it to the recording medium 227, in response to the second shutter switch signal SW2.

[0035] The mode changeover switch 103 changes the operation mode of the system control unit 50 to one of a still image shooting mode, a video shooting mode, a playback mode, etc. Modes included in the still image shooting mode include an auto shooting mode, an auto scene determination mode, a manual mode, an aperture priority mode (Av mode), a shutter speed priority mode (Tv mode), and a program AE mode (P mode). There are also various scene modes and custom modes that are shooting settings according to shooting scenes. The user can directly switch to one of the above-mentioned shooting modes using the mode changeover switch 103. Alternatively, the user can selectively switch to one of the displayed modes using the operation unit 228 after once switching to a list screen of shooting modes using the mode changeover switch 103. Similarly, the video shooting mode may also include a plurality of modes.

[0036] The touch panel 109 is a touch sensor that detects various touch operations on the display surface of the display unit 108 (the operation surface of the touch panel 109). The touch panel 109 and the display unit 108 can be configured as one unit. For example, the touch panel 109 is attached to the upper layer of the display surface of the display unit 108 so that the light transmittance does not interfere with the display of the display unit 108. Then, by associating input coordinates on the touch panel 109 with display coordinates on the display surface of the display unit 108, a GUI (Graphical User Interface) can be configured as if the user could directly operate the screen displayed on the display unit 108. The touch panel 109 can be any of various types such as a resistive film type, a capacitive type, a surface acoustic wave type, an infrared type, an electromagnetic induction type, an image recognition type, and an optical sensor type. Depending on the type, there is a type that detects a touch by contact with the touch panel 109, and a type that detects a touch by approaching a finger or a pen to the touch panel 109, but any type may be used.

[0037] The system control unit 50 can detect the following operations or states on the touch panel 109. A finger or pen that has not been touching the touch panel 109 now touches the touch panel 109, i.e., the start of touching (hereinafter referred to as Touch-Down). A state in which the touch panel 109 is touched by a finger or pen (hereinafter referred to as Touch-On). A finger or pen moves across the touch panel 109 while still touching it (hereinafter referred to as Touch-Move). A finger or pen that has been touching the touch panel 109 is released from the touch panel 109, i.e., the end of touching (hereinafter referred to as Touch-Up). A state in which nothing is touching the touch panel 109 (hereinafter referred to as Touch-Off).

[0038] When touch-down is detected, touch-on is also detected at the same time. After touch-down, touch-on will usually continue to be detected unless touch-up is detected. If touch-move is detected, touch-on will also be detected at the same time. Even if touch-on is detected, touch-move will not be detected if the touch position does not move. After it is detected that all fingers or pens that were touching have touched up, touch-off will occur.

[0039] These operations and states, and the position coordinates of the touch panel 109 touched by a finger or pen are notified to the system control unit 50 via the internal bus. The system control unit 50 determines what kind of operation (touch operation) has been performed on the touch panel 109 based on the notified information. For touch-move, the moving direction of the finger or pen moving on the touch panel 109 can also be determined for each vertical component and horizontal component on the touch panel 109 based on the change in the position coordinates. If a touch-move of a predetermined distance or more is detected, it is determined that a slide operation has been performed. An operation in which a finger is touched on the touch panel 109, quickly moved a certain distance, and then released is called a flick. In other words, a flick is an operation in which a finger is quickly traced on the touch panel 109 as if flicking it. If a touch-move of a predetermined distance or more at a predetermined speed or more is detected and a touch-up is detected immediately, it is determined that a flick has been performed (it can be determined that a flick has occurred following a slide operation). Furthermore, a touch operation in which multiple points (for example, two points) are touched together (multi-touch) and the touch positions are brought closer together is called a pinch in, and a touch operation in which the touch positions are moved farther apart is called a pinch out. Pinch out and pinch in are collectively called a pinch operation (or simply pinch).

[0040] Fig. 3 is a schematic diagram showing an example of the configuration of lens unit 300. Fig. 3 shows a state in which lens unit 300 is attached to camera 100. Note that, among the camera 100 shown in Fig. 3, the same configurations as those explained in Fig. 2 are given the same reference numerals and explanations thereof will be omitted as appropriate.

[0041] The lens unit 300 is a type of interchangeable lens that can be attached to and detached from the camera 100. The lens unit 300 is a twin lens capable of acquiring an optical image with parallax between a left image and a right image. The lens unit 300 has two optical systems. Each optical system has a wide viewing angle of approximately 180 degrees and can acquire an optical image in the range of the front hemisphere. Specifically, the two optical systems of the lens unit 300 can capture an object with a viewing field (angle of view) of 180 degrees in the left-right direction (horizontal angle, azimuth angle, yaw angle) and 180 degrees in the up-down direction (vertical angle, elevation angle, pitch angle). The lens unit 300 has a right-eye optical system 301R having a plurality of lenses and a reflecting mirror, a left-eye optical system 301L having a plurality of lenses and a reflecting mirror, and a lens system control circuit 303. The right-eye optical system 301R corresponds to an example of a first optical system, and the left-eye optical system 301L corresponds to an example of a second optical system. The right-eye optical system 301R and the left-eye optical system 301L have lenses 302R and 302L located on the subject side, which face the same direction and have approximately parallel optical axes. Each optical system is a so-called fisheye lens, and a circular optical image is formed on the imaging unit 211 (sensor).

[0042] The lens unit 300 of this embodiment is a lens for VR180 for capturing images for so-called VR180, which is a format of VR images that allows two-eye stereoscopic viewing. The lens for VR180 has a fisheye lens that allows the right-eye optical system 301R and the left-eye optical system 301L to capture a range of approximately 180 degrees. The lens for VR180 may be a lens that can capture a wide viewing angle range of about 160 degrees narrower than the range of 180 degrees as long as the right-eye optical system 301R and the left-eye optical system 301L can acquire images that allow two-eye VR display as VR180. The lens for VR180 can form a right image (first image) formed via the right-eye optical system 301R and a left image (second image) formed via the left-eye optical system 301L having parallax from the right image on one or two imaging elements of the attached camera.

[0043] Furthermore, the lens unit 300 is attached to the camera 100 by connecting the lens mount portion 304 of the lens unit 300 to the camera mount portion 305 of the camera 100. When the lens unit 300 is attached to the camera 100, the system control portion 50 of the camera 100 and the lens system control circuit 303 of the lens unit 300 are electrically connected to each other via the communication terminals 124 and 306.

[0044] In this embodiment, a right image formed through the right eye optical system 301R and a left image formed through the left eye optical system 301L having a parallax from the right image are formed side by side on the imaging unit 211 of the camera 100. That is, two optical images formed by the right eye optical system 301R and the left eye optical system 301L are formed on one imaging element. The imaging unit 211 converts the formed subject image (optical signal) into an analog electrical signal. By using the lens unit 300, it is possible to obtain one image data in which two images (right image, left image) having parallax obtained through two optical systems, the right eye optical system 301R and the left eye optical system 301L, are arranged side by side. The image obtained in this manner is called a binocular image (binocular image data). A binocular image is an image in which a right image corresponding to the right image and a left image corresponding to the left image are arranged side by side within the effective area of ​​the image data. The right image is also called a right eye image, and the left image is also called a left eye image.

[0045] FIG. 5(A) is a schematic diagram showing a display example when the twin-eye image data obtained through the lens unit 300 is displayed in a live view. The live view image (twin-eye image) 500 includes a live view image (right image) 501R corresponding to the right image acquired through the right-eye optical system 301R, and a live view image (left image) 501L corresponding to the left image acquired through the left-eye optical system 301L. In addition, when paying attention to each of the live view images 501R and 501L, each is circular, and the closer to the outer edge of the circle, the more distorted (compressed). In this embodiment, the right image corresponding to the right image is arranged in the right region in the twin-eye image, and the left image corresponding to the left image is arranged in the left region in the twin-eye image. In the twin-eye image, the right image corresponding to the right image may be arranged on the left, and the left image corresponding to the left image may be arranged on the right.

[0046] In addition, by displaying the acquired images in VR using an image for the left eye (left image) and an image for the right eye (right image), the user can view a three-dimensional VR image with a range of approximately 180 degrees, known as VR180.

[0047] Here, the VR image is an image that can be displayed in VR, which will be described later. The VR image includes an omnidirectional image (spherical image) captured by an omnidirectional camera (spherical camera), a panoramic image having a wider image range (effective image range) than the display range that can be displayed at one time on a display unit, and the like. In addition, the VR image is not limited to a still image, but also includes a video and a live image (image acquired from a camera in almost real time). The VR image has an image range (effective image range) of a field of view of 360 degrees in the left and right directions and 360 degrees in the up and down directions at maximum. In addition, the VR image includes an image having a wider angle of view than the angle of view that can be captured by a normal camera, or a wider image range than the display range that can be displayed at one time on a display unit, even if it is less than 360 degrees in the left and right directions or less than 360 degrees in the up and down directions. The image captured by the camera 100 using the lens unit 300 described above is a type of VR image. The VR image can be displayed in VR by, for example, setting the display mode of a display device (a display device that can display a VR image) to "VR view". By displaying a VR image with a 360-degree angle of view in VR and changing the position of the display device left and right (horizontal rotation direction), the user can view seamless omnidirectional images in the left and right directions.

[0048] Here, VR display (VR view) is a display method (display mode) capable of changing the display range, which displays an image of a VR image with a viewing range according to the posture of the display device. VR display includes "single-eye VR display (single-eye VR view)" in which a VR image is transformed (transformed by performing distortion correction) to map the VR image onto a virtual sphere and a single image is displayed. VR display also includes "two-eye VR display (two-eye VR view)" in which a VR image for the left eye and a VR image for the right eye are transformed to be mapped onto a virtual sphere and displayed side by side in the left and right regions. Stereoscopic vision is possible by performing "two-eye VR display" using a VR image for the left eye and a VR image for the right eye that have parallax from each other. In any VR display, for example, when a user wears a display device such as an HMD (head mounted display), an image with a viewing range according to the orientation of the user's face is displayed. For example, assume that a VR image with a viewing range centered on 0 degrees left and right (a specific direction, for example, north) and 90 degrees up and down (90 degrees from the zenith, i.e. horizontal) is displayed at a certain point in time. When the attitude of the display device is inverted from this state (for example, the display surface is changed from facing south to facing north), the display range of the same VR image is changed to an image with a field of view centered on 180 degrees in the left-right direction (the opposite direction, for example, south) and 90 degrees in the up-down direction. That is, when the user faces from north to south (i.e. turns backwards) while wearing the HMD, the image displayed on the HMD is also changed from a north image to a south image. Note that the VR image captured using the lens unit 300 of this embodiment is a VR180 image captured in a range of approximately 180 degrees forward, and no image exists in a range of approximately 180 degrees backward. When such a VR180 image is VR displayed and the attitude of the display device is changed to the side where no image exists, a blank area is displayed.

[0049] By displaying the VR image in this way, the user visually feels as if he or she is inside the VR image (in the VR space). The method of displaying the VR image is not limited to changing the posture of the display device. For example, the display range may be moved (scrolled) in response to user operation via a touch panel or directional buttons. Furthermore, during VR display (when in the "VR view" display mode), in addition to changing the display range due to posture changes, the display range may also be changed in response to touch-move on the touch panel, dragging with a mouse, pressing a directional button, etc. A smartphone attached to VR goggles (head-mounted adapter) is a type of HMD.

[0050] In the camera 100 configured as described above, an image captured through the lens unit 300 is an image in which images acquired through the right-eye optical system and the left-eye optical system are arranged side by side. A user may enlarge and display a part of an image in order to check the details of a live view image or a recorded image on the camera 100. When checking a part of a twin-eye image by enlarging it, it is desirable to display only a part of the right image or the left image. If the enlarged image includes both the right image and the left image, it is difficult for the user to intuitively understand which part of the original image is displayed by the enlarged image.

[0051] However, if the center position of the range to be enlarged is uniquely set to the center position of the entire image when enlarging, the boundary portion including both the image from the right eye optical system (right image) and the image from the left eye optical system (left image) will be enlarged. In this case, the enlarged image (enlarged image) will have the left end portion of the image from the right eye optical system on the right side of the enlarged image, and the right end portion of the image from the left eye optical system on the left side of the enlarged image, making it very difficult to confirm.

[0052] In this embodiment, therefore, the process of the camera 100 that performs live view enlargement processing suitable for shooting with a twin lens such as the lens unit 300 will be described with reference to the flowchart of FIG.

[0053] Fig. 4 is a flowchart showing an example of processing of the camera 100. The flowchart in Fig. 4 is realized by the system control unit 50 expanding a program recorded in the non-volatile memory 219 into the system memory 218 and executing it. The flowchart in Fig. 4 is started when the camera 100 is set to a still image shooting mode or a video shooting mode.

[0054] In S401, the system control unit 50 acquires information on the type of the attached lens unit and determines whether the lens unit is a twin lens. Here, it is assumed that the system control unit 50 determines whether the lens unit is a VR180 lens. The system control unit 50 communicates with the attached lens unit connected to the lens unit via the communication terminal 124 and acquires information on the type of the lens unit from the lens unit. If the attached lens unit is a twin lens (VR180 lens), the process proceeds to S402. On the other hand, for example, if the lens unit is not attached or the attached lens unit is a normal lens unit such as a single lens, the process proceeds to S421. That is, if the lens unit attached to the camera 100 is the lens unit 200, which is a conventional single lens, the process proceeds to S421. If the lens unit attached to the camera 100 is the lens unit 300, which is a twin lens, the process proceeds to S402.

[0055] In S402, the system control unit 50 determines whether the display mode for live view display is set to the twin-eye image display mode. The display mode for live view display of twin-eye images can be set in advance to any one of the twin-eye image display mode, the left image enlarged display mode, and the right image enlarged display mode. The display mode can be set by the user operating the menu screen. Information indicating the set display mode is stored in the non-volatile memory 219 in advance. In S402, the system control unit 50 determines whether information on the twin-eye image display mode is stored in the control variable stored in the non-volatile memory 219. If the twin-eye image display mode is set, the process proceeds to S403, and if the twin-eye image display mode is not set, the process proceeds to S406.

[0056] FIG. 5(a) is a diagram showing an example of a live view image 500 displayed in a live view in the twin-eye image display mode. The live view image 500 includes an image (right image) 501R captured through the right-eye optical system 301R and an image (left image) 501L captured through the left-eye optical system 301L. In addition, when focusing on each image 501R, 501L, each image is circular, and the closer to the outer edge of the circle, the more distorted it becomes. In the twin-eye image display mode, it is clear that two wide-field images are captured by two optical systems, and it is easy to recognize that a VR180 lens is attached and a VR image is being captured. On the other hand, in the twin-eye image display mode, two images are displayed small and separated on one screen, and it is not suitable for a user to check the focus, the facial expression of a subject, etc. in detail. Therefore, a user uses the twin-eye image display mode, for example, when there is no need to check the focus, the facial expression of a subject, etc. in detail.

[0057] 5(b) is a diagram showing an example of a live view image 502 displayed as a live view in the left image enlarged display mode. Compared to a live view image 500 displayed as a live view in the twin-eye image display mode, only a portion of the live image (left image) captured through the left eye optical system is displayed in an enlarged manner, making it easier for the user to check the details of the image.

[0058] The display optical system guide 503 indicates whether a live image captured through the left-eye optical system or the right-eye optical system is currently being displayed. An area 504 of the guide 503 indicates an area of ​​a binocular image corresponding to the left-eye optical system. An area 505 of the guide 503 indicates an area of ​​a binocular image corresponding to the right-eye optical system. The background of the side corresponding to the optical system currently being displayed is displayed with diagonal lines. In this example, the background of 504 corresponding to the left-eye optical system currently being displayed is displayed with diagonal lines. This allows the user to recognize which optical system, the left or right, is displaying the live image. A frame 506 of the guide 503 is a guide indicating the area to be enlarged of the binocular image. In this example, a circle on 504 indicating the left-eye optical system indicates the image area of ​​the left-eye optical system live image before enlargement, and a rectangle is displayed in the area corresponding to the position of the live image currently being enlarged.

[0059] The button 507 is a GUI that accepts an operation for switching the enlargement target. The button 507 is displayed on the display unit 108 as an operation button that executes a process of switching the image of the enlargement target between the left image and the right image by touching down the touch panel 109. The user can switch the display mode from the left image enlargement display mode to the right image enlargement display mode by pressing this enlargement target left / right switching button. When the display mode is the right image enlargement display mode, it can be switched to the left image enlargement display mode. In this embodiment, when switching the image of the enlargement target, the enlargement position is determined so that the position of the other image corresponding to the enlargement position of the image before switching becomes the enlargement position. For example, the distance to the subject at the current enlargement position may be measured, and the amount of parallax may be calculated by combining this with the left and right optical system positions, and the enlargement position may be shifted by the parallax.

[0060] 5(c) is a diagram showing an example of a live view image 508 displayed in the right image enlarged display mode. The right image enlarged display mode is similar to the left image enlarged display mode except that the image to be enlarged is the image (right image) 501R, so a description thereof will be omitted.

[0061] In S403, the system control unit 50 performs twin-eye image display in which a live image captured by the imaging unit 211 through the VR180 lens is displayed on the display unit 108 in twin-eye image display mode. The twin-eye image display mode is a mode in which the live images captured by the imaging unit 211 are arranged side-by-side, with a live image captured through the right-eye optical system of the VR180 lens and a live image captured through the left-eye optical system, and are displayed in live view on the display unit 108. As shown in FIG. 5(a), an image 500 in which a right image 501R and a left image 501L are arranged side-by-side is displayed on the display unit 108.

[0062] In S404, the system control unit 50 determines whether or not the user has performed an enlargement operation of the live view image. The system control unit 50 determines whether or not an enlargement instruction input by an enlargement operation has been accepted. For example, an enlargement instruction is input by pressing the enlargement button 113 or by a pinch-out operation on the touch panel 109. If an enlargement instruction has been accepted, the system control unit 50 determines that the user has performed an enlargement operation of the live view image, and proceeds to S405. If neither operation is detected, the system control unit 50 proceeds to S430.

[0063] In S405, the system control unit 50 sets the display mode for live view display to the left image enlarged display mode. Specifically, the system control unit 50 stores information on the left image enlarged display mode in a control variable stored in the non-volatile memory 219. The process proceeds to S430.

[0064] In S430, the system control unit 50 determines whether or not to end the display of the live view image. For example, when an instruction to switch from either the still image mode or the video mode to a menu mode in which a menu screen is displayed and the user makes settings is input, the system control unit 50 determines to end the display of the live view image. Also, when the user operates the power button to switch the power off, the system control unit 50 determines to end the display of the live view image. When the system control unit 50 determines to end the display of the live view image, the flow chart of the live view display process ends. Otherwise, the process returns to S401.

[0065] In S406, the system control unit 50 determines whether the display mode is set to the left image enlarged display mode. Specifically, the system control unit 50 determines whether information on the left image enlarged display mode is stored in the control variables stored in the non-volatile memory 219. If the left image enlarged display mode is set, the process proceeds to S407, and if the left image enlarged display mode is not set, the process proceeds to S414.

[0066] In S407, the system control unit 50 enlarges and displays the left image portion of the twin-eye image captured by the imaging unit 211 through the lens unit 300. The left image enlarged display mode is a mode in which only the image (left image) captured through the left optical system of the lens unit 300 among the live images captured by the imaging unit 211 is enlarged and displayed as a live view on the display unit 108. The system control unit 50 reads out information on the enlargement position from the control variable stored in the system memory 218, and enlarges and displays the area corresponding to the enlargement position of the image captured through the left optical system. At this time, if nothing is stored in the control variable, that is, if the enlargement position is not set in advance, the central part of the image captured through the left optical system is enlarged and displayed. FIG. 5(b) is a schematic diagram showing a live view image displayed in the left image enlarged display mode. As described above, a part of the left image 501L in FIG. 5(a) is enlarged and displayed as a live view image 502. In addition, a guide 503 and a button 507 are displayed. This allows the user to quickly check one of the left and right parts (the left image) in detail in response to performing a zoom-in operation while the twin-eye image is being displayed.

[0067] In S408, the system control unit 50 determines whether or not to end the enlarged display. Specifically, the system control unit 50 determines whether or not an instruction (enlargement end instruction) input in response to an operation to end the enlarged display has been received, and determines to end the enlarged display when the instruction has been received. For example, the system control unit 50 determines whether or not a user has performed an operation to instruct to end the enlarged display of the live view image (enlargement end operation). Specifically, the enlargement end operation is a user pressing the enlargement button 113. Also, a pinch-in operation (reducing operation) performed on the touch panel 109 may be detected as the enlargement end operation. When the enlargement end operation is detected, the system control unit 50 determines to end the enlarged display, and proceeds to S409. When the enlargement end operation is not performed and it is determined not to end the enlarged display, the system control unit 50 proceeds to S410. Note that it may also be determined to end the enlarged display in response to no operation being performed for a predetermined period of time after the enlarged display has been started (timeout).

[0068] In S409, the system control unit 50 sets the display mode for live view display to the twin-eye image display mode. Specifically, the system control unit 50 stores information on the twin-eye image display mode in the control variables stored in the non-volatile memory 219. Then, the process proceeds to S430.

[0069] In S410, the system control unit 50 determines whether or not an instruction to change the enlargement position (enlargement range) to be enlarged in the enlarged display has been input. The system control unit 50 determines whether or not the user has performed an operation to change the enlargement position. For example, an operation to change the enlargement position is a touch-move operation on the touch panel 109, an operation on the cursor key, etc. If an operation to change the enlargement position is detected, the system control unit 50 determines that an instruction to change the enlargement position has been input, and proceeds to S411. If not, proceeds to S412. Note that in the operation to change the enlargement position, the enlargement range can only be set inside the left image.

[0070] In S411, the system control unit 50 executes a process of changing the enlargement position. Specifically, the system control unit 50 changes the enlargement position of the live image captured through the left eye optical system based on the information on the direction and distance of the enlargement position change operation detected in S410. In addition, the system control unit 50 stores the information on the enlargement position in a control variable stored in the system memory 218. The process proceeds to S430.

[0071] In S412, the system control unit 50 determines whether or not the user has performed an operation to switch the enlargement target between left and right. Specifically, the system control unit 50 detects whether or not an operation has been performed on the button 507 displayed on the display unit 108. If an operation has been detected, the system control unit 50 proceeds to S413, and if not, the system control unit 50 proceeds to S430.

[0072] In S413, the system control unit 50 sets the display mode for live view display to the right image enlarged display mode. Specifically, the system control unit 50 stores information on the right image enlarged display mode in the control variable stored in the non-volatile memory 219. The process proceeds to S430.

[0073] The above-mentioned processes from S407 to S413 are processes in the left image enlarged display mode. In the left image enlarged display mode, only the left image is subject to the enlargement process and is enlarged and displayed. This prevents the user from confusing whether the displayed enlarged image is a part of the left image or a part of the right image.

[0074] Next, the operation in the right image enlarged display mode will be described.

[0075] In S414, the system control unit 50 enlarges and displays the right image portion of the twin-eye image captured by the imaging unit 211 through the lens unit 300. The right image enlargement display mode is a mode in which only the image (right image) captured through the right eye optical system of the lens unit 300 among the live images captured by the imaging unit 211 is enlarged and displayed as a live view on the display unit 108. The system control unit 50 reads out the information of the enlargement position from the control variable stored in the system memory 218, and enlarges and displays the area corresponding to the enlargement position of the image captured through the right eye optical system. At this time, if nothing is stored in the control variable, that is, if the enlargement position is not set in advance, the central part of the image captured through the right eye optical system is treated as the target area for the enlargement process, and the enlarged image is displayed by performing the enlargement process. FIG. 5(c) is a schematic diagram showing a live view image displayed in the right image enlargement display mode. As described above, a part of the right image 501R in FIG. 5(a) is enlarged and displayed as a live view image 508. In addition, the guide 503 and the button 507 are displayed. Thereafter, the process proceeds to S415.

[0076] In S415, the system control unit 50 determines whether or not to end the enlarged display. Specifically, the system control unit 50 determines whether or not an instruction (enlargement end instruction) input in response to an operation to end the enlarged display has been received, and determines to end the enlarged display when the instruction has been received. For example, the system control unit 50 determines whether or not a user has performed an operation to instruct to end the enlarged display of the live view image (enlargement end operation). Specifically, the enlargement end operation is a user pressing the enlargement button 113. Also, a pinch-in operation on the touch panel 109 may be detected as the enlargement end operation. When the enlargement end operation is detected, the system control unit 50 determines to end the enlarged display, and proceeds to S416. When the enlargement end operation is not performed and it is determined not to end the enlarged display, the system control unit 50 proceeds to S417. Note that it may also be determined to end the enlarged display in response to no operation being performed for a predetermined period of time after the enlarged display has been started (timeout).

[0077] In S416, the system control unit 50 sets the display mode for live view display to the twin-eye image display mode. Specifically, the system control unit 50 stores information on the twin-eye image display mode in the control variables stored in the non-volatile memory 219. Then, the process proceeds to S430.

[0078] In S417, the system control unit 50 determines whether or not an instruction to change the enlargement position (enlargement range) to be enlarged in the enlarged display has been input. The system control unit 50 determines whether or not the user has performed an operation to change the enlargement position. For example, an operation to change the enlargement position is a touch-move operation on the touch panel 109, an operation on the cursor key, etc. If an operation to change the enlargement position is detected, the system control unit 50 determines that an instruction to change the enlargement position has been input, and proceeds to S418. If not, proceeds to S419. Note that in the operation to change the enlargement position, the enlargement range can be set only inside the left image.

[0079] In S418, the system control unit 50 executes a process of changing the enlargement position. Specifically, the system control unit 50 changes the enlargement position of the live image captured through the left eye optical system based on the information on the direction and distance of the enlargement position change operation detected in S410. In addition, the system control unit 50 stores the information on the enlargement position in a control variable stored in the system memory 218. The process proceeds to S430.

[0080] In S419, the system control unit 50 determines whether or not the user has performed an operation to switch the enlargement target between left and right. Specifically, the system control unit 50 detects whether or not an operation has been performed on the button 507 displayed on the display unit 108. If an operation has been detected, the system control unit 50 proceeds to S413, and if not, the system control unit 50 proceeds to S430.

[0081] In S420, the system control unit 50 sets the display mode for live view display to the left image enlarged display mode. Specifically, the system control unit 50 stores information on the left image enlarged display mode in a control variable stored in the non-volatile memory 219. The process proceeds to S430.

[0082] The above-mentioned processes of S414 to S420 are processes in the right image enlarged display mode. In the right image enlarged display mode, only the right image of the twin-lens image is subject to the enlargement process and is enlarged and displayed. This prevents the user from confusing whether the displayed enlarged image is a part of the left image or a part of the right image.

[0083] As described above, the system control unit 50 of the camera 100 is the lens unit 300 that is attached to the camera 100 and captures a twin-lens image, and when an image based on the twin-lens image is displayed, only one of the left image and the right image is enlarged in response to an enlargement instruction. By controlling in this manner, it is possible to prevent parts of the left image and parts of the right image from being mixed in the displayed image when the image is enlarged, improving the user's visibility.

[0084] Furthermore, when an enlargement process is instructed, the system control unit 50 of the camera 100 of this embodiment sets different ranges to be enlarged depending on the type of lens unit attached to the camera 100. Next, an operation will be described when the lens unit 200, which is a conventional eye lens unit, is attached to the camera 100.

[0085] In S421, the system control unit 50 determines whether the display mode setting for live view display is the enlarged display mode. Specifically, the system control unit 50 determines whether information on the enlarged display mode is stored in the control variables stored in the non-volatile memory 219. If the enlarged display mode is set, the process proceeds to S425. If not, the process proceeds to S422.

[0086] In S422, the system control unit 50 performs live view display in which a live image being captured by the imaging unit 211 via the lens unit 200 is displayed on the display unit 108 in normal display mode. The normal display mode is a mode in which a live image being captured by the imaging unit 211 via the optical system of the lens unit 200 is displayed on the display unit 108 in live view without being enlarged. Fig. 6(a) is a diagram showing an example of a live view image 509 displayed as a live view in normal display mode. The process proceeds to S423.

[0087] In S423, the system control unit 50 determines whether or not the user has performed an enlargement operation of the live view image. The system control unit 50 determines whether or not an enlargement instruction input by an enlargement operation has been accepted. For example, an enlargement instruction is input by pressing the enlargement button 113 or by a pinch-out operation on the touch panel 109. If an enlargement instruction has been accepted, the system control unit 50 determines that the user has performed an enlargement operation of the live view image, and proceeds to S424. If neither operation is detected, the system control unit 50 proceeds to S430.

[0088] In S424, the system control unit 50 sets the display mode for live view display to the enlarged display mode. Specifically, the system control unit 50 stores information about the enlarged display mode in a control variable stored in the non-volatile memory 219. After that, the system control unit 50 proceeds to S430.

[0089] In S425, the system control unit 50 performs live view display in which a live image captured by the imaging unit 211 through the lens unit 200 is displayed on the display unit 108 in an enlarged display mode. The enlarged display mode is a mode in which a live image captured by the imaging unit 211 through the optical system of the lens unit 200 is enlarged and displayed on the display unit 108 in a live view. The system control unit 50 reads out information on the enlargement position from the control variables stored in the system memory 218, and enlarges and displays the corresponding position of the live image captured through the normal imaging lens. At this time, if nothing is stored in the control variables, the center position of the image is determined in advance as the initial position of the enlargement position. FIG. 6(b) is a diagram showing an example of a live view image 509 displayed in a live view in the enlarged display mode. 510 and 511 are enlargement position guides indicating which position of the live image before enlargement is enlarged by the currently displayed live image. 510 corresponds to the entire live image before enlargement, and 511 represents the currently displayed enlarged area within it. Then, the process proceeds to S426.

[0090] In S426, the system control unit 50 determines whether or not to end the enlarged display. Specifically, the system control unit 50 determines whether or not an instruction (enlargement end instruction) input in response to an operation to end the enlarged display has been received, and determines to end the enlarged display when the instruction has been received. For example, the system control unit 50 determines whether or not a user has performed an operation to instruct to end the enlarged display of the live view image (enlargement end operation). Specifically, the enlargement end operation is a user pressing the enlargement button 113. Also, a pinch-in operation on the touch panel 109 may be detected as the enlargement end operation. When the enlargement end operation is detected, the system control unit 50 determines to end the enlarged display, and proceeds to S427. When the enlargement end operation is not performed and it is determined not to end the enlarged display, the system control unit 50 proceeds to S428. Note that it may also be determined to end the enlarged display in response to no operation being performed for a predetermined period of time after the enlarged display has been started (timeout).

[0091] In S427, the system control unit 50 sets the display mode for live view display to the normal display mode. Specifically, the system control unit 50 stores information about the normal display mode in the control variables stored in the non-volatile memory 219. After that, the system control unit 50 proceeds to S430.

[0092] In S428, the system control unit 50 determines whether or not an instruction to change the enlargement position (enlargement range) to be enlarged in the enlarged display has been input. The system control unit 50 determines whether or not the user has performed an operation to change the enlargement position. For example, an operation to change the enlargement position is a touch-move operation on the touch panel 109, an operation on the cursor key, etc. If an operation to change the enlargement position is detected, the system control unit 50 determines that an instruction to change the enlargement position has been input, and proceeds to S429. If not, proceeds to S430.

[0093] In S429, the system control unit 50 changes the enlargement position of the live view image. Specifically, the system control unit 50 changes the enlargement position of the live image captured through the optical system of the lens unit 200 based on the information on the direction and distance of the enlargement position change operation detected in S428. The system control unit 50 also stores the information on the enlargement position in a control variable stored in the system memory 218. Then, the process proceeds to S430.

[0094] As described above, the system control unit 50 of the camera 100 in this embodiment enlarges the central part of the image in response to an enlargement instruction when the lens unit 200, which is a conventional single lens, is attached to the camera 100. The camera 100 can also be attached with the lens unit 300, which is a twin lens capable of acquiring a twin-lens image in which a left image and a right image having left and right parallax are arranged side-by-side. The system control unit 50 of the camera 100 enlarges the central part of one of the left image and the right image in response to an enlargement instruction when the twin lens is attached to the camera 100. That is, the position of the enlargement range to be the target of the enlargement process is changed depending on the type of the lens unit attached to the camera 100. This makes it possible for the user to easily realize an enlarged display with an appropriate range enlarged without having to switch the setting of the position to be enlarged each time depending on the type of the lens unit.

[0095] As described above, in this embodiment, even if images from the left and right optical systems are displayed side-by-side when shooting using a twin lens, only one of the left and right images is displayed in an enlarged manner. This makes it possible to prevent the user from having difficulty recognizing the enlarged portion when the boundary area between the left and right images is enlarged. In addition, by enlarging and displaying one of the left and right images, an electronic device is provided that makes it easy for the user to check the details of the image.

[0096] In this embodiment, the object to be enlarged and displayed is described as a live view image when a twin lens is used, but the present invention may also be applied to a case where the object to be enlarged and displayed is an image captured using a twin lens and played back and displayed from an SD card, etc.

[0097] In addition, in the present embodiment, when the enlargement position is moved, the enlargement position is moved within the area of ​​the left image while the left image is being enlarged, and within the area of ​​the right image while the right image is being enlarged. However, when an instruction to move the enlargement position beyond the edge of the left image or the right image is received, that is, an instruction to change the enlargement position to the outside of one of the images, the enlargement position may be moved to the edge area of ​​the other image. For example, when the right edge area of ​​the left image is displayed in the left image enlargement display mode, if an instruction to move the enlargement position further to the right is received, the display mode is switched to the right image enlargement display mode, and the enlargement position is moved to the left edge area of ​​the right image. At this time, the instruction to move is gradually given from a state in which the edge of the image is not enlarged, and may eventually become an instruction to move the enlargement position beyond the edge. In this case, the process of moving the enlargement position to the other image is not performed, and the enlargement position is only moved to a position where the edge of the image is enlarged, and when an instruction to move the enlargement position beyond the edge of the image is received again, the enlargement position may be moved to the edge area of ​​the other image.

[0098] In addition, when an instruction is given to move the enlarged position beyond the edge of the enlarged image, an enlarged version of another image may be displayed next to the image being enlarged, thereby displaying an enlarged image of both the right edge region of the left image and the left edge region of the right image.

[0099] In this example, the image displayed in live view is only an enlarged image of the image captured through one optical system, but the live image captured through the other optical system may be displayed together with the enlarged image without being enlarged. An example of display in this case is shown in FIG. 5(d). 512 is an enlarged image of the live image captured through the left optical system, and 513 is a live image captured through the right optical system. Here, the object that the user wants to check in detail is the enlarged image of the live image captured through the left optical system of 512, so that the live image captured through the right optical system of 513 is displayed so that a part of the live image is hidden. Thus, the present invention does not limit what other images are displayed at the same time as long as the object to be enlarged and displayed is only the live image captured through the left optical system or only the live image captured through the right optical system.

[0100] Although the present invention has been described in detail based on the preferred embodiments, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. Parts of the above-described embodiments may be combined as appropriate.

[0101] The present invention also includes cases where a software program that realizes the functions of the above-described embodiments is supplied to a system or device having a computer capable of executing the program directly from a recording medium or via wired / wireless communication, and the program is executed.

[0102] Therefore, the program code itself that is supplied to and installed in a computer to realize the functional processing of the present invention also realizes the present invention. In other words, the computer program itself for realizing the functional processing of the present invention is also included in the present invention.

[0103] In this case, so long as the program has the functions of a program, the form of the program is not important, such as object code, a program executed by an interpreter, or script data supplied to an OS.

[0104] The recording medium for supplying the program may be, for example, a hard disk, a magnetic recording medium such as a magnetic tape, an optical / magneto-optical storage medium, or a non-volatile semiconductor memory.

[0105] As a method of supplying the program, a method is also conceivable in which the computer program constituting the present invention is stored in a server on a computer network, and a connected client computer downloads the computer program to program it. [Explanation of symbols]

[0106] 50 System control section 100 Cameras 108 Display section 200 Lens unit 211 Imaging unit 214 Image Processing Unit 300 Lens Unit

Claims

1. a control means for displaying an image on a display unit based on a third image in which a first image captured through a first optical system and a second image captured through a second optical system, the second image having a parallax with respect to the first image, are arranged in a side-by-side manner, or a fourth image captured through a single optical system; a reception unit for receiving an enlargement instruction for enlarging and displaying a part of the image displayed on the display unit; having The control means when the enlargement instruction is received while the third image is being displayed, an enlarged image obtained by enlarging a first region that is a part of either the first image or the second image is displayed on the display unit; when the enlargement instruction is received while the fourth image is being displayed, an enlarged image obtained by enlarging a second region of the fourth image is displayed on the display unit; An electronic device, characterized in that a position of the first area relative to the third image is different from a position of the second area relative to the fourth image.

2. 2 . The electronic device according to claim 1 , wherein the enlarged image includes a portion of either the first image or the second image, but does not include a portion of the other of the first image or the second image.

3. The receiving means is capable of receiving an enlargement end instruction to end the enlargement, The electronic device according to claim 1 or 2, characterized in that, when the enlarged image is being displayed, the control means controls the display of the third image that is not enlarged in response to detecting the enlargement end instruction.

4. The electronic device according to any one of claims 1 to 3, characterized in that when the enlargement instruction is received while the third image is being displayed, a portion of the first image corresponding to an enlargement range including the center of the first image is enlarged and displayed on the display unit.

5. In response to the reception means receiving an operation to change an enlargement position of the third image, the control means changes a range of the third image to be subjected to an enlargement process; When the enlarged image is an image obtained by enlarging a portion of the first image, a range to be subjected to the enlargement process is changed within the first image, 4. The electronic device according to claim 1, wherein when the enlarged image is an image obtained by enlarging a portion of the second image, the range to be targeted for the enlargement process is changed within the second image.

6. In response to the reception means receiving an operation to change an enlargement position of the third image, the control means changes a range of the third image to be subjected to an enlargement process; When the enlarged image is an image obtained by enlarging a portion of the first image, if an operation to change a range to be a target of the enlargement process to outside the first image is received, the control means enlarges and displays a portion of the second image, The electronic device described in any one of claims 1 to 4, characterized in that when the enlarged image is an image obtained by enlarging a portion of the second image, and an operation is received to change the range to be targeted by the enlargement process to outside the second image, the control means enlarges and displays a portion of the first image.

7. the receiving means is capable of receiving a switching instruction for switching between a first display mode in which an enlarged image obtained by enlarging a portion of the first image is displayed and a second display mode in which an enlarged image obtained by enlarging a portion of the second image is displayed, 7. The electronic device according to claim 1, wherein the control unit switches the range of the third image to be enlarged in response to the switching instruction received by the reception unit.

8. The electronic device according to claim 7, characterized in that, when switching from the first display mode to the second display mode, the control means sets a position of the second image corresponding to the enlarged position of the first image in the third image as an enlarged position to generate an enlarged image.

9. The electronic device according to claim 7, characterized in that, when switching from the first display mode to the second display mode, the control means controls so that the enlarged position of the enlarged image after switching and the enlarged position of the image before switching are shifted by a parallax between the first image and the second image.

10. 10. The electronic device according to claim 1, wherein the control means performs a notification indicating whether the first image or the second image is being enlarged when the enlarged image is displayed.

11. 11. The electronic device according to claim 1, wherein the control means performs a notification indicating an enlarged position in the third image when the enlarged image is displayed.

12. A connection means capable of being connected to a lens unit; an imaging means for generating image data from an optical image input through the lens unit; and The control means when a first type of lens unit having the first optical system that inputs a first optical image and the second optical system that inputs a second optical image having a predetermined parallax with respect to the first optical image is connected to the connection means, in response to the reception means receiving the enlargement instruction, an enlarged image obtained by enlarging the first area of ​​the image generated by the imaging means is displayed on the display unit; When a second type of lens unit having the single optical system is connected to the connection means, in response to the reception means receiving the enlargement instruction, an enlarged image obtained by enlarging the second area of ​​the image generated by the imaging means is displayed on the display unit.

12. The electronic device according to claim 1, wherein the first and second electrodes are arranged in a first direction.

13. 13. The electronic device according to claim 12, wherein the first area is an area that includes only one of an area of ​​the image corresponding to the first optical image input through the first type of lens unit and an area of ​​the image corresponding to the second optical image input through the first type of lens unit.

14. 14. The electronic device according to claim 13, wherein the first region is either a region including a center of the first optical image in the image or a region including a center of the second optical image in the image.

15. 15. The electronic device according to claim 12, wherein the second region is a region including a center of the image.

16. 16. The electronic device according to claim 1, wherein the first region is an area included in a right half region or a left half region of the third image.

17. The electronic device according to claim 1 , wherein the first region is a region not including a center in the third image.

18. the third image has a third region different from the first region and the second region; The electronic device described in any one of claims 1 to 17, characterized in that when displaying an image on the display unit based on the third image, the control means, in response to the acceptance of the enlargement instruction by the acceptance means, displays on the display unit an enlarged image of the third image that does not include the third area.

19. 19. The electronic device according to claim 1, wherein the first area is an area that does not include a boundary between the first image and the second image.

20. a control step of displaying an image on a display unit based on a third image in which a first image captured through a first optical system and a second image captured through a second optical system, the second image having parallax with respect to the first image, are arranged in a side-by-side manner, or a fourth image captured through a single optical system; a receiving step of receiving an enlargement instruction for enlarging and displaying a part of the image displayed on the display unit; having In the control step, when the enlargement instruction is received while the third image is being displayed, an enlarged image obtained by enlarging a first region that is a part of either the first image or the second image is displayed on the display unit; when the enlargement instruction is received while the fourth image is being displayed, an enlarged image obtained by enlarging a second region of the fourth image is displayed on the display unit; A method for controlling an electronic device, wherein a position of the first area relative to the third image is different from a position of the second area relative to the fourth image.

21. A program for causing a computer to function as each of the means of the electronic device according to any one of claims 1 to 19.

22. A computer-readable storage medium storing a program for causing a computer to function as each of the means of the electronic device according to any one of claims 1 to 19.

Images