Electronic apparatus, method of controlling the same, and storage medium

Abstract

To confirm an image in every corner and to enlarge and display the image without confusing a user.SOLUTION: An acquisition unit configured to acquire a third image in which a first image captured via a first optical system and a second image captured via a second optical system and having a parallax with respect to the first image are arranged, and a setting unit configured to set a target range to which predetermined processing is applied in the third image according to a user operation, wherein the setting unit sets the target range such that the target range includes at least a part of the first image or the second image.SELECTED DRAWING: Figure 13

Description

[Technical Field]

[0001] The present invention relates to an electronic device, a control method thereof, a program, and a recording medium. [Background technology]

[0002] In recent years, digital cameras with two lens optical systems have become known. If the two optical systems are arranged to capture images in the same direction, it is possible to create an image capturing a 180-degree range (a hemispherical image) or an image that allows stereoscopic viewing from the two parallax images captured by each system. If the two optical systems are arranged to capture images in opposite directions, it is possible to create an image capturing a 360-degree range (a spherical image) from the two images captured by each system. When a fisheye lens is used to capture such a wide angle of view, the image is captured as a circle.

[0003] When capturing two images with parallax using a digital camera with two optical systems, the user must check two live view images while shooting. With a typical digital camera with a single optical system, the user can enlarge and check one live view image in detail.

[0004] Patent Document 1 discloses that two live view images acquired by two optical systems can be displayed on one screen, and that the live view image can be enlarged in response to a user pinching out (a zoom instruction) in the display area of ​​one of the two live view images. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Publication No. 2020-108114 Summary of the Invention [Problem to be solved by the invention]

[0006] However, the enlargement instruction disclosed in Patent Document 1 does not allow the user to know in advance which area will be enlarged in response to the instruction. Also, if an image is displayed in a circular shape on a rectangular screen and only the area other than the image is enlarged, the user may not be able to recognize which area of ​​the original image has been enlarged even when looking at the enlarged image.

[0007] Therefore, an object of the present invention is to enable an image to be enlarged so that every corner of the image can be checked and the image can be enlarged so as not to confuse the user. [Means for solving the problem]

[0008] In order to solve the above problems, the present invention provides: an acquisition means for acquiring a third image in which a first image captured through a first optical system and a second image captured through a second optical system and having a parallax with respect to the first image are arranged side by side; a setting unit that sets a target range of the third image to which predetermined processing is to be applied in response to a user operation, the third image has a different area from the first image and the second image; the setting means sets a movable area in which the target range included in the third image can be moved so that the area of ​​the first image or the area of ​​the second image is included inside the movable area; The movable area is set so that the target range cannot be set to include only an area that does not include either the first image area or the second image area. [Effects of the Invention]

[0009] According to the present invention, an image can be viewed in detail, and the image can be enlarged so as not to confuse the user. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is an external view of a digital camera 100. [Figure 2] 1 is a schematic block diagram showing an example of the hardware configuration of a digital camera 100. FIG. [Figure 3] FIG. 2 is a schematic diagram illustrating an example of the configuration of a lens unit. [Figure 4] This is a flowchart of the process of switching the display mode of the camera when a twin lens (lens for VR180) is attached, and the control process during a touch-down operation. [Figure 5] FIG. 10 is a diagram showing an example of a live view display of a camera when a twin lens (lens for VR 180 degrees) according to the present embodiment is attached. [Figure 6] 10 is a control flowchart relating to the movement of the magnification frame of the camera when a twin lens is attached. [Figure 7] FIG. 10 is a diagram illustrating the left and right boundaries of the live view of a camera when a twin lens is attached. [Figure 8] 10 is a flowchart of the enlargement process and shooting operation of the camera when a twin lens is attached. [Figure 9] FIG. 10 is a diagram for explaining the zoom operation of the camera when a twin lens is attached. [Figure 10] 10 is a control flowchart relating to a method for calculating the movement and display position of the enlargement frame upon touchdown. [Figure 11] 10 is a control flowchart relating to a method for calculating the movement and display position of the enlargement frame when a direction is specified. [Figure 12] FIG. 1 is a diagram showing an example of a physical coordinate system of an optical image acquired by an imaging unit of a camera when a twin lens is attached. [Figure 13] This is a diagram in which the physical coordinate system of the optical image acquired by the imaging unit of a camera equipped with two lenses is converted into a logical coordinate system. DETAILED DESCRIPTION OF THE INVENTION

[0011] A preferred embodiment of the present invention will be described below with reference to the drawings. In this embodiment, the electronic device will be described as a digital camera (image capture device).

[0012] The digital camera 100 according to this embodiment can acquire a twin-lens image in which a left image and a right image having a predetermined parallax in the left-right direction are arranged side by side in a single image, and display the image on the display unit. The digital camera 100 can also apply predetermined image processing to a target area of ​​the image displayed on the display unit. The predetermined image processing can be, for example, enlargement processing, and the enlargement processing will be described in detail below. The digital camera 100 displays an enlarged image of the target area enlarged in response to an enlargement instruction on the display unit. Note that the predetermined image processing is not limited to enlargement processing. For example, it can be processing that detects the luminance distribution or chromaticity distribution within the target area and generates a histogram or waveform monitor, or processing that applies filter processing such as contrast enhancement to the target area. In this embodiment, an enlargement instruction is issued by pressing the enlarge button 78, which is a depressible physical member. However, an enlargement instruction can also be issued by pinching in on the touch panel 70a, and the enlarged display can also be canceled by pinching out.

[0013] The digital camera 100 according to this embodiment displays an item indicating the target range in the twin-lens image in line with the twin-lens image. The item may be, for example, a frame-shaped indicator indicating the target range or a semi-transparent color image to be combined with the target range. The digital camera 100 can change the display position of the item (i.e., the target range indicated by the item) in response to a user operation. When displaying a twin-lens image, the digital camera 100 displays the item in a position that does not straddle both the left and right images. In other words, the target range is determined so as not to include both the left and right images. In other words, the target range is set so as to include only one of the left and right images.

[0014] Even if a user performs an operation to change the display position of an item (position of the target range), digital camera 100 controls the display of the item so that the target range indicated by the item does not straddle both the left and right images.

[0015] 1(a) and 1(b) show external views of a digital camera 100 as an example of a device to which the present invention can be applied. FIG. 1(a) is a front perspective view of the digital camera 100, and FIG. 1(b) is a rear perspective view of the digital camera 100. In FIG. 1, a display unit 28 is a display unit provided on the back of the camera that displays images and various information. A touch panel 70a is a touch detection means that can detect touch operations on the display surface (operation surface) of the display unit 28. An outside-finder display unit 43 is a display unit provided on the top surface of the camera that displays various camera settings such as shutter speed and aperture.

[0016] The shutter button 61 is an operation part for issuing shooting instructions. The mode selector switch 60 is an operation part for switching between various modes. The terminal cover 40 is a cover for protecting a connector (not shown) such as a connection cable that connects an external device to the digital camera 100. The main electronic dial 71 is a rotary operation part included in the operation part 70, and by turning this main electronic dial 71, settings such as shutter speed and aperture can be changed. The power switch 72 is an operation part for switching the power of the digital camera 100 on and off.

[0017] The sub electronic dial 73 is included in the operation unit 70 and is a rotary operation member included in the operation unit 70, which is used to move the selection frame, advance images, etc. The cross key 74 is included in the operation unit 70 and is a cross key (four-way key) that can be pressed up, down, left, or right. Operations can be performed according to the part of the cross key 74 that is pressed. The SET button 75 is included in the operation unit 70 and is a push button that is mainly used to confirm selections, etc. The video button 76 is used to start and stop video shooting (recording).

[0018] The enlargement button 78 is included in the operation unit 70 and is an operation button for turning the enlargement mode on and off in the live view display in the shooting mode. By turning the enlargement mode on and operating the main electronic dial 71, the LV image can be enlarged or reduced. In the playback mode, it functions as an enlargement button for enlarging the playback image and increasing the magnification ratio. The playback button 79 is included in the operation unit 70 and is an operation button for switching between the shooting mode and the playback mode. By pressing the playback button 79 in the shooting mode, the mode switches to the playback mode, and the most recent image recorded on the recording medium 200 can be displayed on the display unit 28.

[0019] The menu button 81 is included in the operation unit 70, and when the menu button 81 is pressed, a menu screen in which various settings can be made is displayed on the display unit 28. The user can intuitively make various settings using the menu screen displayed on the display unit 28, the cross key 74, and the SET button 75.

[0020] The multi-controller 82 can be used as an eight-way directional key, such as up, down, left, and right, by tilting it in any direction. It can also be used to activate an assigned function by pressing it. The display mode switching button 83 is an operating member for switching between multiple different display modes for information such as live view images and shooting information displayed on the display unit 28 or EVF 29. Each time the display mode switching button 83 is pressed, the display mode switches, allowing the user to view information about images being shot or played back in the display mode desired by the user.

[0021] The communication terminal 10 is a communication terminal for the digital camera 100 to communicate with the lens side (detachable).

[0022] The eyepiece 16 is the eyepiece of an eyepiece finder (a peer-type finder), and the user can view the image displayed on the internal EVF 29 through the eyepiece 16. The eyepiece detection unit 57 is an eyepiece detection sensor that detects whether the photographer has placed their eye on the eyepiece 16. The lid 202 is a lid for a slot that stores a recording medium 200. The grip 90 is a holding unit shaped to be easily held in the right hand when the user holds the digital camera 100. When the digital camera is held by gripping the grip 90 with the little finger, ring finger, and middle finger of the right hand, the shutter button 61 and main electronic dial 71 are located in positions that can be operated with the index finger of the right hand. In the same position, the sub electronic dial 73 is located in a position that can be operated with the thumb of the right hand.

[0023] FIG. 2 is a block diagram showing an example of the configuration of a digital camera 100 according to this embodiment. In FIG. 2, lens unit 150 is a lens unit equipped with an interchangeable photographic lens. Lens 103 typically consists of multiple lenses, but for simplicity, only a single lens is shown here. Communication terminal 6 is a communication terminal through which lens unit 150 communicates with digital camera 100, and communication terminal 10 is a communication terminal through which digital camera 100 communicates with lens unit 150. Lens unit 150 communicates with system controller 50 via communication terminals 6 and 10, controls aperture 1 via aperture drive circuit 2 using an internal lens system control circuit 4, and adjusts focus by displacing the position of lens 103 via AF drive circuit 3. Additionally, the type of lens unit 150 attached to digital camera 100 is identified via communication terminals 6 and 10.

[0024] The shutter 101 is a focal plane shutter that can freely control the exposure time of the imaging unit 22 under the control of the system control unit 50.

[0025] The imaging unit 22 is an imaging element configured with a CCD, CMOS element, or the like that converts an optical image into an electrical signal. The imaging unit 22 may have an imaging surface phase difference sensor that outputs defocus amount information to the system control unit 50. The A / D converter 23 converts an analog signal into a digital signal. The A / D converter 23 is used to convert the analog signal output from the imaging unit 22 into a digital signal.

[0026] The image processing unit 24 performs predetermined pixel interpolation, resizing such as reduction, and color conversion processing on the data from the A / D converter 23 or the data from the memory control unit 15. The image processing unit 24 also performs predetermined arithmetic processing using the captured image data. The system control unit 50 performs exposure control and distance measurement control based on the arithmetic results obtained by the image processing unit 24. This allows TTL (through-the-lens) type AF (autofocus) processing, AE (autoexposure) processing, and EF (flash pre-flash) processing to be performed. The image processing unit 24 also performs predetermined arithmetic processing using the captured image data, and performs TTL type AWB (auto white balance) processing based on the arithmetic results obtained.

[0027] The output data from the A / D converter 23 is written into the memory 32 via the image processing unit 24 and the memory control unit 15, or directly via the memory control unit 15. The memory 32 stores image data obtained by the imaging unit 22 and converted into digital data by the A / D converter 23, as well as image data to be displayed on the display unit 28 and the EVF 29. The memory 32 has a storage capacity sufficient to store a predetermined number of still images and a predetermined period of moving images and audio.

[0028] The memory 32 also serves as a memory (video memory) for image display. The D / A converter 19 converts the image display data stored in the memory 32 into an analog signal and supplies it to the display unit 28 and the EVF 29. In this way, the display image data written to the memory 32 is displayed on the display unit 28 and the EVF 29 via the D / A converter 19. The display unit 28 and the EVF 29 perform display according to the analog signal from the D / A converter 19 on a display device such as an LCD or an organic EL. The digital signal that has been A / D converted once by the A / D converter 23 and stored in the memory 32 is converted to analog in the D / A converter 19 and then sequentially transferred and displayed on the display unit 28 or the EVF 29, thereby performing a live view display (LV display). Hereinafter, an image displayed in live view will be referred to as a live view image (LV image).

[0029] The outside-finder liquid crystal display 43 displays various camera settings such as shutter speed and aperture via an outside-finder display drive circuit 44 .

[0030] The nonvolatile memory 56 is an electrically erasable and recordable memory, such as an EEPROM. The nonvolatile memory 56 stores constants, programs, etc. for the operation of the system control unit 50. The programs referred to here are programs for executing various flowcharts described later in this embodiment.

[0031] The system control unit 50 is a control unit made up of at least one processor or circuit, and controls the entire digital camera 100. By executing the programs recorded in the nonvolatile memory 56 mentioned above, each process of this embodiment, which will be described later, is realized. The system memory 52 uses, for example, a RAM, and stores constants and variables for the operation of the system control unit 50, programs read from the nonvolatile memory 56, and the like. The system control unit 50 also performs display control by controlling the memory 32, D / A converter 19, display unit 28, etc.

[0032] The system timer 53 is a timekeeping unit that measures the time used for various controls and the time of a built-in clock.

[0033] The operation unit 70 is an operating means for inputting various operational instructions to the system control unit 50. The mode selector switch 60 is an operating member included in the operation unit 70 and switches the operation mode of the system control unit 50 to one of still image capture mode, video capture mode, playback mode, etc. Modes included in the still image capture mode include auto capture mode, auto scene determination mode, manual mode, aperture priority mode (Av mode), shutter speed priority mode (Tv mode), and program AE mode (P mode). There are also various scene modes and custom modes that provide capture settings for specific shooting scenes. The mode selector switch 60 allows the user to directly switch to one of these modes. Alternatively, the user may first switch to a list screen of shooting modes using the mode selector switch 60, then select one of the displayed modes and switch using other operating members. Similarly, the video capture mode may also include multiple modes.

[0034] The first shutter switch 62 is turned on and generates a first shutter switch signal SW1 when the shutter button 61 provided on the digital camera 100 is pressed halfway (a shooting preparation command) during operation. The first shutter switch signal SW1 starts shooting preparation operations such as AF (autofocus) processing, AE (auto exposure) processing, AWB (auto white balance) processing, and EF (pre-flash) processing.

[0035] The second shutter switch 64 is turned on when the shutter button 61 is fully pressed (photographing instruction) and generates a second shutter switch signal SW2. The system control unit 50 starts a series of photographing processing operations, from reading out a signal from the imaging unit 22 to writing the captured image to the recording medium 200 as an image file, in response to the second shutter switch signal SW2.

[0036] The operation unit 70 is a variety of operation members (reception means) that serve as an input unit that receives operations from the user. The operation unit 70 includes at least the following operation members: the shutter button 61, the main electronic dial 71, the power switch 72, the sub electronic dial 73, the cross key 74, the SET button 75, the movie button 76, the AF lock button 77, the magnification button 78, the playback button 79, the menu button 81, and the multi-controller 82. Other operation members 70b collectively represent operation members that are not individually shown in the block diagram.

[0037] The power supply control unit 80 is composed of a battery detection circuit, a DC-DC converter, a switch circuit for switching between powered blocks, etc., and detects whether a battery is installed, the battery type, and the remaining battery charge. The power supply control unit 80 also controls the DC-DC converter based on the detection results and instructions from the system control unit 50, and supplies the required voltage for the required period to each unit, including the recording medium 200. The power supply unit 30 is composed of primary batteries such as alkaline batteries or lithium batteries, secondary batteries such as NiCd batteries, NiMH batteries, or Li batteries, an AC adapter, etc.

[0038] The recording medium I / F 18 is an interface with a recording medium 200 such as a memory card or a hard disk. The recording medium 200 is a recording medium such as a memory card for recording captured images, and is composed of a semiconductor memory, a magnetic disk, or the like.

[0039] The communication unit 54 is connected wirelessly or via a wired cable, and transmits and receives video signals and audio signals. The communication unit 54 can also be connected to a wireless LAN (Local Area Network) or the Internet. The communication unit 54 can also communicate with external devices via Bluetooth (registered trademark) or Bluetooth Low Energy. The communication unit 54 can transmit images (including LV images) captured by the imaging unit 22 and images recorded on the recording medium 200, and can also receive images and various other information from external devices.

[0040] The orientation detection unit 55 detects the orientation of the digital camera 100 with respect to the direction of gravity. Based on the orientation detected by the orientation detection unit 55, it is possible to determine whether an image captured by the imaging unit 22 was captured with the digital camera 100 held horizontally or vertically. The system control unit 50 can add orientation information corresponding to the orientation detected by the orientation detection unit 55 to the image file of the image captured by the imaging unit 22, or rotate and record the image. An acceleration sensor, a gyro sensor, or the like can be used as the orientation detection unit 55. The acceleration sensor or gyro sensor of the orientation detection unit 55 can also be used to detect movement of the digital camera 100 (panning, tilting, lifting, whether it is stationary, etc.).

[0041] The eyepiece detection unit 57 is an eyepiece detection sensor that detects (approach detection) whether the eye (object) is approaching (eyepiece) or moving away (eyepiece) from the viewfinder eyepiece unit 16. The system control unit 50 switches the display unit 28 and the EVF 29 between display (display state) and non-display (non-display state) depending on the state detected by the eyepiece detection unit 57. More specifically, at least in the shooting standby state and when the display destination switching is automatic, when the eye is not placed near the camera, the display is turned on as the display unit 28 and the EVF 29 is not displayed. Furthermore, when the eye is placed near the camera, the display is turned on as the display unit 29 and the EVF 29 is not displayed.

[0042] The eyepiece detection unit 57 can be, for example, an infrared proximity sensor, and can detect the approach of an object to the eyepiece 16 of the viewfinder that houses the EVF 29. When an object approaches, infrared light emitted from a light-emitting unit (not shown) of the eyepiece detection unit 57 is reflected and received by a light-receiving unit (not shown) of the infrared proximity sensor. The amount of received infrared light can also be used to determine the distance the object has approached from the eyepiece 16 (eyepiece distance). In this way, the eyepiece detection unit 57 performs eyepiece detection, detecting the proximity of an object to the eyepiece 16.

[0043] When an object is detected approaching within a predetermined distance from the eyepiece unit 16 from a non-eyepiece state (non-approaching state), it is detected that the eye has been placed in proximity. When an object that was detected as approaching from the eyepiece state (approaching state) moves away by more than a predetermined distance, it is detected that the eye has been removed. The threshold for detecting eye placement and the threshold for detecting eye removal may be different, for example, by providing hysteresis. Furthermore, after detecting eye placement, the eye placement state is maintained until eye removal is detected. After detecting eye removal, the eye placement state is maintained until eye placement is detected. Note that the infrared proximity sensor is just one example, and other sensors that can detect the approach of an eye or object that can be considered as eye placement may be used for the eye placement detection unit 57.

[0044] The touch panel 70a and the display unit 28 can be configured as an integrated unit. For example, the touch panel 70a is configured so that its light transmittance does not interfere with the display of the display unit 28, and is attached to the upper layer of the display surface of the display unit 28. Input coordinates on the touch panel 70a are then associated with display coordinates on the display screen of the display unit 28. This makes it possible to provide a GUI (Graphical User Interface) that allows the user to directly operate the screen displayed on the display unit 28. The system control unit 50 can detect the following operations or states on the touch panel 70a: A finger or pen that has not been touching the touch panel 70a touches the touch panel 70a again, that is, the start of touching (hereinafter referred to as touch-down). The touch panel 70a is in a state where it is touched with a finger or a pen (hereinafter referred to as Touch-On). Touching the touch panel 70a with a finger or a pen and moving it (hereinafter referred to as Touch-Move). The finger or pen that has been touching the touch panel 70a is released, that is, the touch ends (hereinafter referred to as "touch-up"). A state in which nothing is touching the touch panel 70a (hereinafter referred to as Touch-Off).

[0045] When touch down is detected, touch on is also detected at the same time. After touch down, touch on will usually continue to be detected unless touch up is detected. Touch move is also detected when touch on is detected. Even if touch on is detected, touch move will not be detected unless the touch position moves. Once it is detected that all fingers or pens that were touching have touched up, touch off occurs.

[0046] These operation states and the position coordinates of the finger or pen touching the touch panel 70a are notified to the system control unit 50 via the internal bus, and the system control unit 50 determines what operation (touch operation) has been performed on the touch panel 70a based on the notified information. Regarding touch moves, the direction of movement of the finger or pen moving on the touch panel 70a can also be determined for each vertical and horizontal component on the touch panel 70a based on changes in the position coordinates.

[0047] If a touch move of a predetermined distance or more is detected, it is determined that a slide operation has been performed. An operation in which a finger is touched to the touch panel, quickly moved a certain distance, and then released is called a flick. In other words, a flick is an operation in which a finger is quickly traced across the touch panel 70a as if flicking. If a touch move of a predetermined distance or more at a predetermined speed or more is detected, and a touch up is then detected, it can be determined that a flick has been performed (it can be determined that a flick occurred following a slide operation).

[0048] Furthermore, a touch operation in which multiple points (for example, two points) are touched together (multi-touch) and the touch positions are brought closer together is called a pinch in, and a touch operation in which the touch positions are moved farther apart is called a pinch out. Pinch out and pinch in are collectively called a pinch operation (or simply pinch). The touch panel 70a may be of any of a variety of touch panel types, including resistive film type, capacitive type, surface acoustic wave type, infrared type, electromagnetic induction type, image recognition type, and optical sensor type. Depending on the type, there are types that detect a touch by contact with the touch panel, and types that detect a touch by the approach of a finger or pen to the touch panel, but either type is acceptable.

[0049] Fig. 3 is a schematic diagram showing an example of the configuration of lens unit 300. Fig. 3 shows a state in which lens unit 300 is attached to digital camera 100. Note that, among the digital camera 100 shown in Fig. 3, the same components as those explained in Fig. 2 are given the same reference numerals, and explanations thereof will be omitted as appropriate.

[0050] Lens unit 300 is a type of interchangeable lens that can be attached to and detached from digital camera 100. Lens unit 300 is a twin lens that can capture optical images with parallax between left and right images. Lens unit 300 has two optical systems (photographing lenses), each with a wide viewing angle of 180 degrees, and can capture the range of the forward hemisphere. Specifically, the two optical systems of lens unit 300 can each input an optical image of a subject included in a field of view (angle of view) of 180 degrees in the left-right direction (horizontal angle, azimuth angle, yaw angle) and 180 degrees in the up-down direction (vertical angle, elevation angle, pitch angle).

[0051] The lens unit 300 includes a right-eye optical system 301R having a plurality of lenses and a reflecting mirror, a left-eye optical system 301L having a plurality of lenses and a reflecting mirror, and a lens system control circuit 303. The right-eye optical system 301R corresponds to an example of a first optical system, and the left-eye optical system 301L corresponds to an example of a second optical system. The right-eye optical system 301R and the left-eye optical system 301L each have lenses 302R and 302L located on the subject side, facing the same direction, and their optical axes are parallel. Each optical system is a so-called fisheye lens, and a circular optical image is formed on the imaging unit 22 (sensor). The optical image (left image) input via the left-eye optical system 301L and the optical image (right image) input via the right-eye optical system 301R are formed on the imaging surface of one imaging unit 22, and the imaging unit 22 acquires an image including each optical image.

[0052] The lens unit 300 of this embodiment is a VR180 lens for capturing images for so-called VR180, a VR image format that enables binocular stereoscopic viewing. The VR180 lens has fisheye lenses that enable the right-eye optical system 301R and the left-eye optical system 301L to each capture a 180-degree range. Note that the VR180 lens may be a lens that can capture a wide viewing angle range of approximately 160 degrees, which is narrower than the 180-degree range, as long as the right-eye optical system 301R and the left-eye optical system 301L can each capture images that enable binocular VR display as VR180. The VR180 lens can form a right image (first image) formed via the right-eye optical system 301R and a left image (second image) formed via the left-eye optical system 301L, which has parallax from the right image, on one or two image pickup elements of the attached camera. In the digital camera 100 according to this embodiment, a right image and a left image are formed on a single image sensor (sensor), and a single image (two-eye image) is generated in which an image corresponding to the right image and an image corresponding to the left image are arranged side by side. The two-eye image at this time includes an image corresponding to the right image, an image corresponding to the left image, and an area where no optical image is formed (shaded area).

[0053] Furthermore, the lens unit 300 is attached to the digital camera 100 via the lens mount section 304 and the camera mount section 305 of the digital camera 100. This electrically connects the system control section 50 of the digital camera 100 and the lens system control circuit 303 of the lens unit 300 via the communication terminal 10 of the digital camera 100 and the communication terminal 306 of the lens unit 300.

[0054] In this embodiment, a right image formed via the right-eye optical system 301R and a left image formed via the left-eye optical system 301L, which has parallax from the right image, are formed side by side on the imaging unit 22 of the digital camera 100. That is, two optical images formed by the right-eye optical system 301R and the left-eye optical system 301L are formed on a single imaging element. The imaging unit 22 converts the formed subject image (optical signal) into an analog electrical signal to acquire image data of the two-eye image. In this way, by using the lens unit 300, two images with parallax can be simultaneously acquired (as a set) from two locations (optical systems), the right-eye optical system 301R and the left-eye optical system 301L. Furthermore, by dividing the acquired images into an image for the left eye and an image for the right eye and displaying them in VR, the user can view a stereoscopic VR image with a 180-degree range, known as VR180.

[0055] Conventionally, with a normal single lens, an image incident on the lens is inverted point-symmetrically around the center of the optical axis and input to a sensor. An imaging device such as digital camera 100 generates natural (non-inverted) images by adjusting the sensor reading order and inverting the read images. On the other hand, with a twin lens, the image is inverted point-symmetrically up and down and input to the sensor, but the image acquired through the left-eye optical system is not inverted left and right and input to the sensor on the left side and the image acquired through the right-eye optical system on the right side. Therefore, if inversion processing is performed as in the past, the left and right sides of the image after inversion processing will be reversed from the left and right sides of the digital camera 100, i.e., the image acquired through the left-eye optical system will be displayed on the right side and the image acquired through the right-eye optical system will be displayed on the left side.

[0056] Here, a VR image is an image that can be displayed in VR, as described below. VR images include omnidirectional images (spherical images) captured by an omnidirectional camera (spherical camera) and panoramic images with a wider image range (effective image range) than can be displayed on a display unit at one time. VR images are not limited to still images, but also include videos and live images (images acquired from a camera in almost real time). VR images have an image range (effective image range) of up to 360 degrees horizontally and vertically. VR images also include images with a wider angle of view than can be captured by a normal camera, or an image range wider than can be displayed on a display unit at one time, even if the field of view is less than 360 degrees horizontally or vertically. Images captured by the digital camera 100 using the lens unit 300 described above are a type of VR image. VR images can be displayed in VR by, for example, setting the display mode of a display unit (a display unit capable of displaying VR images) to "VR view." By displaying a VR image with a 360-degree angle of view in VR and changing the position of the display device left and right (horizontal rotation direction), the user can enjoy seamless, omnidirectional images in both the left and right directions.

[0057] Here, VR display (VR view) is a display method (display mode) that displays VR images with a field of view that corresponds to the orientation of the display device, and allows for a change in the display range. VR display includes "single-eye VR display (single-eye VR view)," which displays a single image by mapping a VR image onto a virtual sphere (deformation that corrects distortion). VR display also includes "two-eye VR display (two-eye VR view)," which displays a VR image for the left eye and a VR image for the right eye side by side in left and right regions by mapping each onto a virtual sphere. Stereoscopic viewing is possible by performing "two-eye VR display" using a VR image for the left eye and a VR image for the right eye that have parallax from each other.

[0058] Regardless of the VR display, when a user wears a display device such as an HMD (head-mounted display), an image with a field of view that corresponds to the orientation of the user's face is displayed. For example, suppose a VR image is displayed with a field of view centered at 0 degrees left and right (a specific direction, e.g., north) and 90 degrees up and down (90 degrees from the zenith, i.e., horizontal) at a certain point in time. If the orientation of the display device is flipped from this state (e.g., the display surface is changed from facing south to facing north), the display range changes to an image with a field of view centered at 180 degrees left and right (the opposite direction, e.g., south) and 90 degrees up and down. In other words, when a user wears an HMD and turns their face from north to south (i.e., facing backwards), the image displayed on the HMD also changes from a north image to a south image.

[0059] The VR image captured using the lens unit 300 of this embodiment is a VR180 image capturing a range of 180 degrees forward, and does not contain any image in a range of 180 degrees backward. If such a VR180 image is displayed in VR and the position of the display device is changed to the side where no image exists, a blank area will be displayed.

[0060] By displaying VR images in this way, the user visually feels as if they are inside the VR image (in the VR space). Note that the method of displaying VR images is not limited to changing the posture of the display device. For example, the display range may be moved (scrolled) in response to user operation via a touch panel or directional buttons. Furthermore, during VR display (display mode "VR view"), in addition to changing the display range due to posture changes, the display range may also be changed in response to touch-move on the touch panel, dragging with a mouse, pressing directional buttons, etc. Note that a smartphone attached to VR goggles (head-mounted adapter) is a type of HMD.

[0061] In digital camera 100 configured as described above, the twin-eye image captured through lens unit 300 is an image including a right image and a left image input to imaging unit 22 through a right-eye optical system and a left-eye optical system. A user of digital camera 100 may enlarge and display a portion of an image to check the details of a live view image or a recorded image. When enlarging an image, the center position of the range to be enlarged may be uniquely set to the center position of the entire image.

[0062] When enlarging a portion of a twin-eye image to confirm that portion, it is desirable to display only a portion of the right or left image. If the center position of the range of the image to be enlarged is uniquely set to the center position of the entire image when enlarging, and the enlarged image includes both the right and left images, it will be difficult for the user to intuitively understand which part of the original image is displayed in the enlarged image. Specifically, the left edge of the right image will be aligned to the right side of the enlarged image, and the right edge of the left image will be aligned to the left side of the enlarged image, resulting in an enlarged image with a different left-right positional relationship relative to the field of view of the subject.

[0063] Therefore, in this embodiment, the processing of the digital camera 100 that performs live view magnification processing suitable for shooting with a twin lens such as the lens unit 300 will be described with reference to the flowchart of FIG.

[0064] Fig. 4 is a flowchart showing an example of processing in the shooting mode of the digital camera 100. The flowchart in Fig. 4 is implemented by the system control unit 50 by loading a program recorded in the nonvolatile memory 219 into the system memory 52 and executing it. The flowchart in Fig. 4 is started when the power of the digital camera 100 is turned on and the digital camera 100 is in a shooting standby state. When starting the control flowchart in Fig. 4, the system control unit 50 initializes control variables and the like and starts processing.

[0065] An example of a display on the display unit 28 when the control flowchart of Fig. 4 is executed will be described with reference to Fig. 5. Details of the display example shown in Fig. 5 will be explained after the explanation of the control flowchart of Fig. 4.

[0066] In S401, the system control unit 50 obtains the previously used display mode from the flag (N) stored in the nonvolatile memory 56, and displays a live view image and information related to shooting on the display unit 28 based on the previously used display mode. For example, if the flow is started by turning on the power, the previously used display mode is the display mode that was used when the power was previously turned off. Alternatively, if the flow is started by switching to shooting mode from a mode other than shooting mode, such as playback mode, it is the display mode that was used when processing was last performed in shooting mode.

[0067] In S402, the system control unit 50 determines whether or not the display mode switching button 83 has been pressed. If it has been pressed, the process proceeds to S403, and if not, the process proceeds to S412.

[0068] In S403, the system control unit 50 refers to the system memory 52 and determines whether the flag N indicating the display mode is 5 (N=5). If N=5, the process proceeds to S404; otherwise, the process proceeds to S405.

[0069] In S404, the system control unit 50 determines via the communication terminals 6 and 10 whether the attached lens is a twin lens (i.e., a lens for VR180). If it is a twin lens, the process proceeds to S406; if not (i.e., a normal single lens or no lens is attached), the process proceeds to S408. A twin lens is a lens with a left and right lens, and each lens is a wide-angle fisheye lens that can capture at least a 180-degree range on the side on which the lens is located, i.e., the range on the subject side. Data of the left and right images captured through the left-eye optical system 301L and right-eye optical system 301R can be captured by one or two image sensors.

[0070] In S405, since the determination in S403 is No, the system control unit 50 increments the flag N indicating the display mode by 1 (N=N+1) and stores it in the system memory 52.

[0071] In S406, the system control unit 50 sets the flag N to 6 (N=6) and stores it in the system memory 52.

[0072] In S407, when N=6, the system control unit 50 displays a display mode dedicated to twin lenses on the display unit 28. An example of the display at this time is shown in Fig. 5(f). Fig. 5(f) will be described in detail later.

[0073] In S408, since the determination in S404 is No, the system control unit 50 sets the flag N to 1 (N=1) and stores it in the system memory 52.

[0074] In S409, the system control unit 50 displays a live view image and information in a display mode corresponding to the display unit 28, in accordance with the value of the flag N stored in the system memory 52. ​​Examples of displays corresponding to the display modes displayed on the display unit 28 are shown in Figures 5(a) to 5(e). This step is reached even if the determination in S404 is No, so the display is also displayed when no twin lenses are attached, that is, when a single lens is attached or no lenses are attached.

[0075] 5(a) to 5(f) will be used to explain the LV image and information display displayed on the display unit 28. In FIGS. 5(a) to 5(f), two LV images are displayed when a twin lens (a lens for VR180) is attached to the digital camera 100. However, when a single lens is attached, one LV image is displayed, and the other displays are similar. When a single lens is attached, as described above with reference to FIG. 4, the display mode shown in FIG. 5(f) is not transitioned to. Each time the user performs a display mode switching operation (in this embodiment, pressing the display mode switching button 83), the information displayed on the display unit 28 is changed. Specifically, the displays shown in FIGS. 5(a) to 5(f) are performed according to the number of the flag N indicating the display mode described above with reference to FIG. 4. Note that, in this embodiment, the LV image displayed on the display unit 28 is a circular fisheye display; however, this is not limiting and the LV image in the circular fisheye display may be converted to an equirectangular display by performing equirectangular conversion processing.

[0076] FIG. 5(a) shows the display mode when flag N=1, that is, when the digital camera 100 is powered on and an LV image is displayed on the display unit 28 in a shooting standby state. Two LV images (LV500R, LV500L) are displayed side by side, and information displays 501a to 501c are also displayed on the display unit 28. The two LV images arranged side by side in this case are called side-by-side images. Information displays 501a to 501c show shooting information and are the minimum information display assumed to be essential for the user when shooting. Pressing the display mode switching button 83 in the state shown in FIG. 5(a) causes a transition to FIG. 5(b).

[0077] FIG. 5(b) shows the display mode when flag N=2. In FIG. 5(b), in addition to LV 500R, LV 500L, and information displays 501a to 501c, information displays 502a and 502b are displayed. Like information displays 501a to 501c, information displays 502a and 502b display shooting information and display various information related to shooting (for example, currently set settings and the type of inserted recording medium 200). Because the amount of information is greater than that of information displays 501a to 501c, the user can view more shooting information. However, the visibility of the LV image may be reduced. Pressing the display mode switching button 83 in the state shown in FIG. 5(b) causes a transition to FIG. 5(c).

[0078] FIG. 5(c) shows the display mode when flag N=3. In FIG. 5(c), in addition to the LV 500R, LV 500L, and information displays 501a-501c, 502a, and 502b, information display 503, which is a histogram of the LV image currently being captured, is displayed. Information display 503 is a graph with brightness on the horizontal axis and pixel count on the vertical axis, and serves as a guide for checking the brightness of the LV image currently being captured, the exposure level trend, and the overall gradation of the LV image. Some users may want to check information display 503 during capture, so it is displayed. However, because it is superimposed on a relatively large area of ​​the LV image, visibility is reduced. Pressing the display mode switch button 83 in the state shown in FIG. 5(c) transitions to FIG. 5(d).

[0079] FIG. 5(d) shows the display mode when flag N=4. In the display mode of FIG. 5(d), all of the information displays 501a-501c, 502a, 502b, and 503 are hidden, and only the LV500R and LV500L are displayed. This display allows the user to shoot while viewing only the LV image, without feeling overwhelmed by various shooting information. Pressing the display mode switching button 83 in the state shown in FIG. 5(d) transitions to FIG. 5(e).

[0080] Fig. 5(e) shows the display mode when flag N=5. In the display mode of Fig. 5(e), the LV image is not displayed, and only information about shooting is displayed in a table-like format. When the display mode switching button 83 is pressed in the state shown in Fig. 5(e), if a twin lens is attached, the display transitions to Fig. 5(f), and if a single lens is attached or no lens is attached, the display transitions to Fig. 5(a).

[0081] FIG. 5(f) shows the display mode when flag N=6 (S407 in FIG. 4). In other words, this is the display mode that transitions to only when a twin lens is attached to the digital camera 100. At this time, the display unit 28 displays LV500R, LV500L, information displays 505 and 506, and an enlargement frame 511, focus guide 512, and magic window 513 superimposed on the LV image. Information display 505 indicates that LV500R is an LV image captured by the right-eye optical system 301R, and displays "R," which means right. Information display 506 indicates that LV500L is an LV image captured by the left-eye optical system 301L, and displays "L," which means left.

[0082] In the case of an optical system such as that shown in digital camera 100, an image captured by the image sensor (imaging unit 22) is captured upside down. This upside-down image is then flipped 180 degrees and displayed on display unit 28 or EVF 29. In light of this structure, consider photographing using a lens having two optical systems (twin lens) as shown in FIG. 3. As mentioned above, if two LV images captured by the left and right optical systems and input to imaging unit 22 are displayed on display unit 28 without undergoing flipping processing, the LV images will be displayed upside down, which is inconvenient for the user. For this reason, flipping processing is performed on the two LV images input to imaging unit 22, just as in the case of a single lens.

[0083] However, even if the inversion process is performed, the two LV images displayed on the display unit 28 have the LV image (right image) acquired via the right-eye optical system 301R displayed in the left region, and the LV image (left image) acquired via the left-eye optical system 301L displayed in the right region. In particular, in this embodiment, since imaging is performed using one imaging element (imaging unit 22), the process of identifying the boundary between the two LV images on the single imaging element and swapping the left and right LV images places a heavy processing load on the system control unit 50. Therefore, the LV image input to the imaging unit 22 is flipped 180 degrees up and down and displayed on the display unit 28 without swapping the left and right images.

[0084] When two LV images are displayed on the display unit 28, the user generally assumes that the LV image displayed in the left area was captured by the left-eye optical system 301L, and that the LV image displayed in the right area was captured by the right-eye optical system 301R. In other words, without the display of information displays 505 and 506, the user is unlikely to understand that the left and right LV images are mirror-inverted, and if the user is not aware that the images are mirror-inverted at the time of capture, this can lead to confusion. For this reason, by displaying information displays 505 and 506, the user can clearly visually determine which optical system, left or right, each LV image was captured by.

[0085] The enlargement frame 511 superimposed on the LV image is a frame display that indicates the area of ​​the LV image that will be enlarged when the user issues an enlargement command (similar to S801 in FIG. 8, described below). The focus guide 512 is a frame that indicates the focus detection area and an indicator that displays, using information such as an index and color, the degree of focus on the subject at the position where the focus detection area is superimposed. In this embodiment, the degree of focus is expressed using three indexes displayed above or below the focus detection area. From the focus guide 512 in FIG. 5(f), it can be seen that the subject at the position where the focus detection area is displayed is out of focus and in a back focus state (the subject is not in focus because the focus is behind the subject). Furthermore, when the focus guide is not in focus, it is displayed in white. When these three indexes become two, it indicates that the subject is in focus, and the focus guide is displayed in green.

[0086] Magic window 513 is an indicator displayed on display unit 28 that indicates the range that is initially displayed before the user moves the viewpoint. This indicates the range that is initially displayed before the user moves the viewpoint when a single 180-degree image (semi-spherical image) is generated from LV500R and LV500L and played back on a browser or head-mounted display (HMD). By displaying magic window 513 on the LV image, the range that is initially displayed during playback, i.e., the range that the viewer sees first, can be visually confirmed during shooting, allowing the user to more effectively capture the composition and subject that they desire.

[0087] The magic window 513 is an indicator that is only needed when a 180-degree image is created, and is a specific indicator that is expected to be particularly necessary for users when shooting with a twin lens attached. For this reason, the display mode shown in Figure 5(f) is not displayed when a single lens is attached. Also, because the display position of the magic window 513 is fixed, as long as the user can confirm the range of the magic window 513, it is not necessarily necessary for it to be displayed at all times during subsequent shooting.

[0088] In this embodiment, the enlargement frame 511 and focus guide 512 are superimposed on only one of the two LV images, and the magic window 513 is superimposed on both of the two LV images. Since the enlargement frame 511 indicates the position to be enlarged, it is optimal to display only one, but the focus guide 512 may be displayed on both of the two LV images instead of just one.

[0089] In S410, similar to S404, the system control unit 50 determines whether or not the attached lens is a twin lens via the communication terminals 6 and 10. If it is a twin lens, the process proceeds to S411, and if not, the process proceeds to S412.

[0090] In S411, the system control unit 50 calculates the centers and sizes of the left and right images from the lens information acquired via the communication terminals 6 and 10. The calculation method at this time will be described with reference to FIG.

[0091] 12 is a diagram showing a physical coordinate system 1200 of an optical image formed on the imaging section 22 (image sensor) of the digital camera 100 according to this embodiment. The coordinate system 1200 corresponds to the imaging section 22 as viewed from the lens unit 300 side.

[0092] In this embodiment, a circular optical image 1201R formed by the left-eye optical system 301L and a circular optical image 1201L formed by the right-eye optical system 301R are formed on one image sensor. The image capturing unit 22 converts the formed subject image into an analog electrical signal, and a logical coordinate system 500 shown in FIG. 13 is formed.

[0093] The system control unit 50 can acquire the following information from the attached lens via the communication terminals 6 and 10. For example, the system control unit 50 can acquire a distance 1203R between the center line 1210 of the image sensor 1200 and the center position of the circular optical image 1201R, and a distance 1203L between the center line 1210 of the image sensor 1200 and the center position of the circular optical image 1201L. The system control unit 50 can also acquire a radius 1204R of the optical image 1201R and a radius 1204L of the optical image 1201L.

[0094] From this acquired lens information, it is possible to calculate the centers and sizes of two LV images (left and right images) acquired via two optical systems as shown in FIG.

[0095] Next, processing when a touchdown operation is performed on the touch panel 70a will be described. In response to a touchdown on the touch panel 70a while an image is being displayed, the system control unit 50 of the digital camera 100 displays items related to focus control and items indicating the magnification range within the image. If the lens unit connected to the digital camera 100 is not a twin lens (a conventional single lens), the system control unit 50 displays a focus guide indicating the degree of focus or an AF frame indicating the area targeted for autofocus at a position corresponding to the touchdown. Furthermore, if the lens unit connected to the digital camera 100 is a twin lens, the system control unit 50 positions the focus guide indicating the degree of focus in the center of either the area displaying the left image or the area displaying the right image in response to the touchdown. Furthermore, the system control unit 50 displays an enlargement frame indicating the magnification range at a position corresponding to the touchdown. If the lens unit connected to the digital camera 100 is a twin lens, the system control unit 50 displays the enlargement frame so that it includes the areas where the left and right optical images are formed (excluding only the shaded area that does not include the left and right images).

[0096] In S412, the system control unit 50 determines whether or not a touch-down operation has been performed on the touch panel 70a. If a touch-down operation has been performed, the system control unit 50 stores the coordinates (xt, xy) indicating the touch-down position (touch position) and proceeds to S413; if not, the system control unit 50 proceeds to S601 in FIG. 6.

[0097] In S413, similar to S404, the system control unit 50 determines whether or not the attached lens is a twin lens via the communication terminals 6 and 10. If it is a twin lens, the process proceeds to S414, and if not, the process proceeds to S423.

[0098] In S414, the system control unit 50 determines whether the touch position (dutch-down position) of the touch-down operation performed on the touch panel 70a in S412 is within the left region (region 701L) of the twin-lens image. FIG. 7 is a schematic diagram showing an example display of a twin-lens image. If the touch position is within the left region (region 701L), the process proceeds to S415, and if the touch position is within the right region (region 701R), the process proceeds to S417. Line 705 is the line that forms the exact boundary between the live view images (LV700R and LV700L) captured by the left and right optical systems. In this embodiment, line 705 is the center line when the imaging unit 22 is divided into two halves, left and right.

[0099] In S415, the system control unit 50 displays a focus guide in the center of the left area. If a focus guide is already displayed superimposed on the LV image in either the left or right area of ​​the LV image, the display is moved to the center of the left area (the center of the LV image captured by the right-eye optical system 301R shown in the left area). The focus guide is composed of a frame indicating the focus detection area and multiple indices that indicate the degree of focus in the focus detection area based on the relative display positions of the indices. The relative display positions of the indices allow the user to visually determine whether the focus detection area is in focus, to what extent it is out of focus, and if it is out of focus, whether it is in front of or behind the subject in the focus detection area. Note that the focus guide is not limited to this display format, and the degree of focus may be indicated by, for example, color, etc.

[0100] In S416, the system control unit 50 performs a process of calculating the position (left area) of the enlargement frame based on the touch operation. This process will be described later with reference to FIG.

[0101] In S417, since the determination in S414 is No, the system control unit 50 displays the focus guide in the center of the right area (the center of the LV image captured by the right-eye optical system 301L shown in the right area). At this time, if the focus guide is already displayed superimposed on the LV image, the display is moved to the center of the right area. An example of the display at this time is shown as guide 512 in FIG. 5(f).

[0102] In S418, the system control unit 50 performs a process of calculating the position (right area) of the enlargement frame based on the touch operation. This process will be described later with reference to FIG. 10(b).

[0103] 10(a) and 10(b) show the processing steps shown in S416 and S418 in FIG. 4. This is a control flowchart for calculating the position of the enlargement frame when the user performs a touchdown operation on the touch panel 70a. It is determined whether the touchdown position performed by the user is within a specific range in either the left or right region. If it is within the specific range, the enlargement frame display is moved to the touchdown position. If it is outside the specific range, the enlargement frame display is moved to the closest specific range from the touchdown position. The specific range here refers to the range that includes the display range of the left or right image. XminL, XmaxL, YminL, and YmaxL are coordinates in the left region that indicate the threshold value of the range in which the center of the enlargement frame can be moved. XminR, XmaxR, YminR, and YmaxR are coordinates in the right region that indicate the threshold value of the range in which the center of the enlargement frame can be moved. Details of this coordinate system will be explained using FIG. 13.

[0104] 10(a), the calculation process when the touch position (the position of the touchdown performed in S412) is in the left area will be described. The left area here refers to the area 13010L in FIG. 13. Note that the area 1301L is the same area as the area 701L in FIG. 7.

[0105] In S1001, the system control unit 50 determines whether the touch position is to the left of XminL (shown in FIG. 13). If it is to the left of XminL, the process proceeds to S1002, and if not, the process proceeds to S1003.

[0106] In S1002, the system control unit 50 sets the X coordinate of the center of the enlargement frame as X=XminL and stores it in the system memory 52.

[0107] In S1003, the system control unit 50 determines whether the touch position (the position of the touchdown performed in S412) is to the right of XmaxL. If it is to the right of XmaxL, the process proceeds to S1004; if not, the process proceeds to S1005.

[0108] In S1004, the system control unit 50 sets the X coordinate of the center of the enlargement frame to X=XmaxL and stores it in the system memory 52.

[0109] In S1005, the system control unit 50 sets the X coordinate of the center of the enlargement frame as X=xt of the touch position and stores it in the system memory 52.

[0110] In S1006, the system control unit 50 determines whether or not the touch position is above YminL. If it is above YminL, the process proceeds to S1007, and if not, the process proceeds to S1008.

[0111] In S1007, the system control unit 50 sets the Y coordinate of the center of the enlargement frame as Y=YminL and stores it in the system memory 52.

[0112] In S1008, the system control unit 50 determines whether or not the touch position is below YmaxL. If it is below YmaxL, the process proceeds to S1009, and if not, the process proceeds to S1010.

[0113] In S1009, the system control unit 50 sets the Y coordinate of the center of the enlargement frame as Y=YmaxL and substitutes it into the system memory 52.

[0114] In S1010, the system control unit 50 sets the Y coordinate of the center of the enlargement frame as Y=yt of the touch position and stores it in the system memory 62.

[0115] In S1011, the system control unit 50 moves the enlargement frame in accordance with the X and Y values ​​stored in the system memory 52. ​​At this time, the display position is moved so that the center of the enlargement frame in the vertical and horizontal directions coincides with the stored X and Y values.

[0116] Similarly, the calculation process when the touch position (the position of the touchdown performed in S412) is in the right region will be described using Fig. 10(b). The right region here refers to region 1310R in Fig. 13. Note that region 1301R is the same region as region 701R in Fig. 7.

[0117] In S1021, the system control unit 50 determines whether or not the touch position is to the left of XminR (shown in FIG. 13). If it is to the left of XminR, the process proceeds to S1022, and if not, the process proceeds to S1023.

[0118] In S1022, the system control unit 50 sets the X coordinate of the center of the enlargement frame as X=XminR and stores it in the system memory 52.

[0119] In S1023, the system control unit 50 determines whether the touch position is to the right of XmaxR (shown in FIG. 13). If it is to the right of XmaxR, the process proceeds to S1024, and if not, the process proceeds to S1025.

[0120] In S1024, the system control unit 50 sets the X coordinate of the center of the enlargement frame as X=XmaxR and stores it in the system memory 52.

[0121] In S1025, the system control unit 50 sets the X coordinate of the center of the enlargement frame as X=xt of the touch position, and stores it in the system memory 52.

[0122] In S1026, the system control unit 50 determines whether the touch position is above YminR (shown in FIG. 13). If it is above YminR, the process proceeds to S1027, and if not, the process proceeds to S1028.

[0123] In S1027, the system control unit 50 sets the Y coordinate of the center of the enlargement frame as Y=YminR and stores it in the system memory 52.

[0124] In S1028, the system control unit 50 determines whether the touch position is below YmaxR (shown in FIG. 13). If it is below YmaxR, the process proceeds to S1029, and if not, the process proceeds to S1030.

[0125] In S1029, the system control unit 50 sets the Y coordinate of the center of the enlargement frame as Y=YmaxR and substitutes it into the system memory 52.

[0126] In S1030, the system control unit 50 sets the Y coordinate of the center of the enlargement frame as Y=yt of the touch position and stores it in the system memory 52.

[0127] In S1031, the system control unit 50 moves the enlargement frame in accordance with the X and Y values ​​stored in the system memory 52. ​​At this time, the display position is moved so that the center of the enlargement frame in the vertical and horizontal directions is at the stored X and Y values.

[0128] By performing the control described above, the enlargement frame does not move in response to a touch operation by the user into an area where the left or right image is not displayed (where no optical image is formed). In other words, even if the user performs a touch operation (touch down) in an area where no optical image is formed (area 1311 in FIG. 13), the entire target range included in the enlargement frame does not become an area where no optical image is formed. In this case, the enlargement frame moves to include at least a portion of the area where the left or right image is displayed (circular area 1301L or 1301R in FIG. 13). As a result, when the user issues an enlargement command, an enlarged display including at least a portion of the left or right image is displayed on the display unit 28. Because only an enlarged display of the area where no left or right image is included (area 1311 where no optical image is formed) is not displayed on the display unit 28, user confusion and perceived poor operability can be reduced.

[0129] Next, the control that is executed in response to touchdown when the lens attached to the digital camera 100 is not a twin lens (a single lens) will be described.

[0130] In S419, the system control unit 50 refers to the nonvolatile memory 56 and determines whether the focus mode setting is autofocus mode (AF mode) or manual focus mode (MF mode). If it is MF mode, the process proceeds to S420, and if it is AF mode, the process proceeds to S421. If the focus guide display setting is ON in MF mode, the focus guide is displayed to assist with focusing during MF operation.

[0131] In S420, the system control unit 50 moves the focus guide display to the touch position designated by the user in S412.

[0132] In S421, the system control unit 50 displays an AF frame (autofocus frame) indicating the in-focus position at the touch position designated by the user in S412. In S422, the system control unit 50 displays an enlargement frame at the touch position made in S412.

[0133] That is, if the lens attached to digital camera 100 is not a twin lens (it is a single lens), the magnification frame and focus guide will be displayed at the position touched by the user regardless of the focus mode setting. Also, the magnification frame is displayed in conjunction with the focus detection area of ​​the AF frame and focus guide. On the other hand, if a twin lens is attached, the display position of the magnification frame is not linked to the focus detection area of ​​the focus guide.

[0134] In this embodiment, when a twin lens is attached, the display position of the focus guide is fixed to the center of the display area of ​​the left and right LV images. Therefore, if the display position of the focus guide and the display position of the magnification frame were linked, only the center of the LV image could be enlarged, which would be inconvenient for the user. Furthermore, with a twin lens, two LV images are displayed on the display unit 28, and each LV image is less than half the size of an LV image when a single lens is attached. Therefore, there is a high possibility that the user will enlarge the LV image more times than when a single lens is attached to check it in more detail. Therefore, the magnification frame (i.e., the magnification range of the LV image) is not linked to the focus guide so that the user can freely check the desired position.

[0135] Even if the focus guide is not fixed to the center, when a twin lens is attached, the focus guide and magnification frame are not linked. Users use the focus guide to make more precise focus adjustments, but there may be times when they want to zoom in on a position other than the desired focus position to check it in more detail. For example, if they want to zoom in and check within the range of the magic window described below, or an area close to the circumference of the LV image in circular fisheye display, it is easier for the user to operate if the positions of the focus guide and magnification frame are not linked.

[0136] FIG. 6 is a control flowchart of the display control of the digital camera 100 when an operation is performed on an operation member capable of indicating a direction according to this embodiment.

[0137] The system control unit 50 of the digital camera 100 moves the position of an item in the image in response to a direction instruction received while the twin-lens image and an item such as the enlargement frame are displayed. If the lens unit connected to the digital camera 100 is not a twin-lens unit (a conventional single-lens unit), the system control unit 50 moves the focus guide or AF frame and the enlargement frame in response to the direction instruction.

[0138] Furthermore, if the lens unit connected to the digital camera 100 is a twin-lens unit, the system control unit 50 moves the enlargement frame in response to the direction instruction. However, the focus guide is not moved. Furthermore, when the system control unit 50 receives an instruction to the left while the enlargement frame is displayed in the right region of the display unit and is near the boundary, the system control unit 50 moves the display position of the enlargement frame to the left region so that the enlargement frame does not include both the left and right images. When the system control unit 50 receives an instruction to the right while the enlargement frame is displayed in the left region of the display unit and is near the boundary, the system control unit 50 moves the display position of the enlargement frame to the right region so that the enlargement frame does not include both the left and right images.

[0139] In S601, the system control unit 50 determines whether a direction has been specified using the multi-controller (MC) 82 or the cross key 74 of the operation unit 70. If a direction has been specified, the process proceeds to S602; otherwise, the process proceeds to S610.

[0140] In S602, similar to S411, the system control unit 50 acquires the type of attached lens via the communication terminals 6 and 10 and determines whether it is a twin lens. If it is a twin lens, the process proceeds to S607; if not, the process proceeds to S603.

[0141] In S603, as in S421, the system control unit 50 determines whether the current focus mode of the camera is AF mode or MF mode. If it is AF mode, proceed to S604, and if it is MF mode, proceed to S605. Note that in MF mode, if the display setting for the focus guide to assist in MF focusing is ON, the focus guide is displayed on one of the LV images displayed on the display unit 28. If a touch-down operation has not been performed on the touch panel 70a as described above in S410, the focus guide is displayed superimposed on the LV image in the right region.

[0142] In S604, the system control unit 50 moves the AF frame displayed on the display unit 28 in the direction instructed in S601.

[0143] In S605, the system control unit 50 moves the focus guide displayed on the display unit 28 in the direction instructed in S601. If the focus guide display setting is turned off by the user, this step is skipped. At this time, the entire focus guide is moved, but it is also possible to move only the focus detection area instead of the entire focus guide.

[0144] In S606, the system control unit 50 moves the enlargement frame displayed on the display unit 28 in conjunction with the position of the AF frame or the frame indicating the focus detection area of ​​the focus guide that was moved in S604 or S605.

[0145] In S607, the system control unit 50 determines whether the currently displayed enlargement frame is displayed in the left area. If it is in the left area, the process proceeds to S608. If not, that is, if it is displayed in the right area, the process proceeds to S609. At this time, the system control unit 50 determines whether the entire enlargement frame is displayed in the left area. In other words, it determines whether the coordinates of the center position of the enlargement frame are at least within the area 1310L.

[0146] In S608, the system control unit 50 performs a process of calculating the position (left region) of the enlargement frame based on the direction instruction. This process will be described later with reference to FIG.

[0147] In S609, the system control unit 50 performs a process of calculating the position (right region) of the enlargement frame based on the direction instruction. This process will be described later with reference to FIG. 11(b).

[0148] 11(a) and 11(b) show the processing steps shown in S608 and S609 in FIG. 6. This is a control flowchart for calculating the position of the enlargement frame to be displayed when the user inputs a direction instruction using the MC 82 or the cross key 74. The system determines whether the display position (center coordinates of the enlargement frame) of the currently displayed enlargement frame is inside a specific range of the left and right regions. If it is inside the specific range, the system moves the enlargement frame one step in the direction of the instruction in accordance with the user's instruction. If the center coordinates of the enlargement frame are on the boundary of a specific range of the left and right regions, the system controls the enlargement frame to not move or to jump from one optical image to the other (e.g., from the left image to the right image) depending on the direction of the instruction. The specific range here is the same as the specific range described above in FIG. 10, and is a rectangular range that includes the display range of the left or right image. The coordinate system used for this determination will be described with reference to FIG. 13.

[0149] 11(a), the calculation process will be described when the display area of ​​the enlargement frame that was displayed before the instruction to move the enlargement frame (direction instruction) is given is the left area. The left area here refers to the area 1310L in FIG. 13.

[0150] In S1101, the system control unit 50 determines whether or not a right direction instruction has been made. The instruction in this step refers to the direction instruction given by the user to the MC 82 or the cross key 74 in S601 of Fig. 6. If it has been made, the process proceeds to S1102; if not, the process proceeds to S1104.

[0151] In S1102, the system control unit 50 determines whether the X coordinate of the center of the enlargement frame before the instruction is X=XmaxL. If so, the process proceeds to S1103, and if not, the process proceeds to S1106.

[0152] In S1103, the system control unit 50 moves the enlargement frame so that the X coordinate of the center of the enlargement frame becomes X=XminR.

[0153] In S1104, the system control unit 50 determines whether or not the instruction is for a left direction. If it is a left direction instruction, the process proceeds to S1105, and if not, the process proceeds to S1108.

[0154] In S1105, the system control unit 50 determines whether the X coordinate of the center of the enlargement frame before the instruction is X=XminL. If so, the process proceeds to S1107, and if not, the process proceeds to S1106.

[0155] In S1106, the system control unit 50 moves the display position of the enlargement frame in the indicated direction. At this time, the amount of movement of the display position in response to one direction instruction is assumed to be one pixel of the display unit .

[0156] In S1107, the system control unit 50 does not move the enlargement frame. The determination of Yes in S1105 reveals that the left side of the enlargement frame displayed before the user issues a direction instruction is inscribed within the rectangle 1302L shown in FIG. 13. If the enlargement frame were moved one pixel to the left in response to a leftward instruction in this state, the enlargement range indicated by the enlargement frame (the range to be enlarged) would include an area where no optical image is formed (area 1311). If such control is performed, the enlarged display displayed on the display unit 28 would include much of the area other than the left or right image, which may be perceived as inconvenient for the user. Therefore, the enlargement frame is prevented from moving outside the rectangle 1302L that is in contact with the circular area 1301L in which the left image is displayed (the enlargement range indicated by the enlargement frame does not include the area outside the rectangle 1302L).

[0157] In S1108, the system control unit 50 determines whether or not the instruction is an upward instruction. If it is an upward instruction, the process proceeds to S1109, and if not, the process proceeds to S1111.

[0158] In S1109, the system control unit 50 determines whether the Y coordinate of the center of the enlargement frame before the instruction is Y=YminL. If so, the process proceeds to S1110, and if not, the process proceeds to S1112.

[0159] In S1110, the system control unit 50 does not move the enlargement frame. It can be seen that the top side of the enlargement frame displayed before the user issues a direction instruction is inscribed in the rectangle 1302L shown in FIG. 13. If the enlargement frame were to be moved upward by one pixel in response to an upward instruction in this state, the enlargement range indicated by the enlargement frame (the range to be enlarged) would include an area where no optical image is formed (area 1311). As described in S1107, this state may be perceived by the user as being inconvenient, so the enlargement range indicated by the enlargement frame is made not to include the area outside the rectangle 1302L.

[0160] In S1111, the system control unit 50 determines whether the Y coordinate of the center of the enlargement frame before the instruction is Y=YmaxL. If so, the process proceeds to S1113, and if not, the process proceeds to S1112.

[0161] In S1112, similarly to S11106, the system control unit 50 moves the display position of the enlargement frame in the indicated direction. At this time, the amount of movement of the display position in response to one direction instruction is assumed to be one pixel of the display unit 28.

[0162] In S1113, the system control unit 50 does not move the enlargement frame. The determination of Yes in S1111 indicates that the bottom side of the enlargement frame displayed before the user issues a directional instruction is inscribed within the rectangle 1302L shown in FIG. 13. If the enlargement frame were to be moved downward by one pixel in response to a downward instruction in this state, the enlargement range indicated by the enlargement frame (the range to be enlarged) would include an area where no optical image is formed (area 1311). As described in S1107 and S1110, this state may be perceived by the user as being inconvenient, so the enlargement range indicated by the enlargement frame is made not to include the area outside the rectangle 1302L.

[0163] Similarly, the calculation process when the display area of ​​the enlargement frame that was displayed before the instruction to move the enlargement frame (direction instruction) is given is the right area will be described using Fig. 11(b). The right area here refers to the area 1310R in Fig. 13.

[0164] In S1121, the system control unit 50 determines whether or not the instruction is a rightward instruction. The instruction in this step refers to the direction instruction given by the user to the MC 82 or the cross key 74 in S601 of Fig. 6. If it is a rightward instruction, proceed to S1122; if not, proceed to S1124.

[0165] In S1122, the system control unit 50 determines whether the X coordinate of the center of the enlargement frame before the instruction is X=XmaxR. If so, the process proceeds to S1123, and if not, the process proceeds to S1126.

[0166] In S1123, the system control unit 50 does not move the enlargement frame. As described in S1107, if the enlargement frame is moved one pixel to the left in accordance with the user's instruction, the enlargement range indicated by the enlargement frame (the range to be enlarged) will include an area (area 1311) where no optical image is formed. In this state, the user may find usability poor. For this reason, the enlargement frame is set so that it does not move outside the range of rectangle 1302R that is adjacent to circular area 1301R where the right image is displayed (the enlargement range indicated by the enlargement frame does not include the area outside the range of rectangle 1302R).

[0167] In S1124, the system control unit 50 determines whether or not the instruction is a left direction instruction. If it is a left direction instruction, the process proceeds to S1125, and if not, the process proceeds to S1128.

[0168] In S1125, the system control unit 50 determines whether the X coordinate of the center of the enlargement frame before the instruction is X=XminR. If so, the process proceeds to S1127, and if not, the process proceeds to S1126.

[0169] In S1126, the system control unit 50 moves the display position of the enlargement frame in the indicated direction. At this time, the amount of movement of the display position in response to one direction instruction is assumed to be one pixel of the display unit .

[0170] In S1127, the system control unit 50 moves the enlargement frame to X=XminL, so that the X coordinate of the center of the enlargement frame becomes X=XminL.

[0171] In S1128, the system control unit 50 determines whether or not the instruction is an upward instruction. If it is an upward instruction, the process proceeds to S1129, and if not, the process proceeds to S1131.

[0172] In S1129, the system control unit 50 determines whether the Y coordinate of the center of the enlargement frame before the instruction is Y=YminR. If so, the process proceeds to S1130, and if not, the process proceeds to S1132.

[0173] In S1130, the system control unit 50 does not move the enlargement frame. As described in S1110, if the enlargement frame were moved upward by one pixel in response to a user instruction, the enlargement range indicated by the enlargement frame (the range to be enlarged) would include an area where no optical image is formed (area 1311). Since this situation could cause the user to feel that the system is difficult to use, the enlargement range indicated by the enlargement frame is set so that it does not include the area outside the rectangle 1302R.

[0174] In S1131, the system control unit 50 determines whether the Y coordinate of the center of the enlargement frame before the instruction is Y=YmaxR. If so, the process proceeds to S1133, and if not, the process proceeds to S1132.

[0175] In S1132, similarly to S1126, the system control unit 50 moves the display position of the enlargement frame in the indicated direction. At this time, the amount of movement of the display position in response to one direction instruction is assumed to be one pixel of the display unit 28.

[0176] In S1133, the system control unit 50 does not move the enlargement frame. As described in S1113, if the enlargement frame were moved downward by one step in response to a user instruction, the enlargement range indicated by the enlargement frame (the range to be enlarged) would include an area where no optical image is formed (area 1311). Since this situation could cause the user to feel that the system is difficult to use, the enlargement range indicated by the enlargement frame is set so that it does not include the area outside the rectangle 1302R.

[0177] In this embodiment, the enlargement range indicated by the enlargement frame is controlled so that the proportion of the left or right image included within the enlargement range is at least half (50% or more) of the size of the enlargement frame, and the proportion of the shaded portion (area 1311) included within the enlargement range is less than half (50%) of the size of the enlargement frame. However, it is sufficient that the enlargement range indicated by the enlargement frame includes at least one pixel of the left or right image, and it is sufficient that the entire enlargement range does not become an area where no optical image is formed, i.e., the shaded portion (area 1311). In other words, in this embodiment, the rectangular areas 1302L and 1302R that make the enlargement frame movable do not necessarily need to circumscribe the circular areas 1301L and 1301R, be rectangular, or even be provided (calculated). For example, when a touch operation or a movement operation is performed, the target range included within the current enlargement frame is determined. When a touch operation is performed, in S418 and S416 of FIG. 4 (FIGS. 10(a) and (b)), it is determined whether a portion in which the optical images of the left and right images are formed is included within the target range of the enlargement frame when the enlargement frame is moved so that the position of the touch operation is at the center of the enlargement frame. When a movement operation (direction instruction) is performed, in S608 and S609 of FIG. 6 (FIGS. 11(a) and (b)), it is determined whether a portion in which the optical images of the left and right images are formed is included within the target range of the enlargement frame after the movement. It may also be determined whether the target range of the enlargement frame before the movement contains only one pixel of the optical images of the left and right images. If even one pixel is included within the target range of the enlargement frame after the display and movement, the enlargement frame can be moved; if not, the enlargement frame cannot be moved.

[0178] The above is the flow of movement control of items such as the enlargement frame and focus guide when a direction instruction is input using the MC 82 or the cross key 74 or the like.

[0179] Next, a description will be given of control when an operation is performed to return the display positions of items such as the enlargement frame and focus guide to their predetermined positions. The system control unit 50 displays items such as the enlargement frame and focus guide at predetermined positions in response to receiving a predetermined operation (such as pressing the MC 82 or the SET button 75). When a twin-eye image is being displayed, the system control unit 50 displays the item in the center of either the right area or the left area in which the item was displayed before receiving the predetermined operation in response to receiving the predetermined operation. On the other hand, when a twin-eye image is not being displayed, the system control unit 50 displays the item in the center of the screen in response to receiving the predetermined operation. This makes it possible to suitably control the display position of the item depending on whether the displayed image is a twin-eye image or not.

[0180] In S610, the system control unit 50 determines whether the center of the MC 82 has been pressed (not the up / down / left / right movement operation) or the SET button 75 has been pressed. If the MC 82 has been pressed or depressed, the process proceeds to S611, and if not, the process proceeds to S801 in Fig. 8. Pressing the MC 82 or pressing the SET button 75 in this step can be considered a center movement instruction to move (return) the currently displayed enlargement frame to the center of the LV image of the displayed area.

[0181] In S611, similarly to S411, the system control unit 50 acquires the type of attached lens via the communication terminals 6 and 10 and determines whether it is a twin lens. If it is a twin lens, the process proceeds to S616; if not, the process proceeds to S612.

[0182] In S612, similarly to S421, the system control unit 50 determines whether the current focus mode of the camera is AF mode or MF mode. If it is AF mode, the process proceeds to S613, and if it is MF mode, the process proceeds to S614.

[0183] In S613, the system control unit 50 moves the AF frame to the center of the LV image displayed on the display unit .

[0184] In S614, the system control unit 50 moves the focus guide frame to the center of the LV image displayed on the display unit .

[0185] In S615, the system control unit 50 moves the enlargement frame to the center of the LV image displayed on the display unit 28 in conjunction with the position of the AF frame or the focus detection area of ​​the focus guide.

[0186] In S616, the system control unit 50 determines whether the enlargement frame is displayed in the LV image in the right region. That is, it determines whether the enlargement frame is displayed in region 701R in Fig. 7. If so, the process proceeds to S618; if not, the process proceeds to S617.

[0187] In S617, since the determination in S616 is No, the system control unit 50 moves the display position of the enlargement frame to the center of the LV image displayed in the left area, that is, to the center of the LV image displayed in area 701L in FIG.

[0188] In S618, since the determination in S616 is Yes, the system control unit 50 moves the display position of the enlargement frame to the center of the LV image displayed in the right region, that is, to the center of the LV image displayed in region 701R in FIG.

[0189] The above is the flow showing the control when an operation is executed to return the display positions of items such as the enlargement frame and focus guide to their predetermined positions.

[0190] 13 is started when the determination in S410 of Fig. 4 is Yes, that is, when it is determined that a twin-lens camera is attached. By calculating the centers and sizes of two LV images (left and right images) using the lens information as shown in Fig. 12, it is possible to determine the positions at which the two LV images are displayed in one optical image made up of the two LV images and a blank (hatched) area captured by the imaging unit 22.

[0191] When moving the enlargement frame on two LV images as described in Figures 4 and 6, if the enlargement frame is allowed to move into the margins, the enlarged display may not include any of the LV image. Alternatively, the enlarged display may be mostly margins, with only a small amount of the LV image included, which is likely to confuse the user. For this reason, the rectangular area (areas 1302L, 1302R) where the circular areas that are the display areas of the two LV images meet is calculated, and when the user instructs to move the enlargement frame, it is allowed to move only within the calculated rectangular area.

[0192] First, the system control unit 50 calculates the center positions of rectangular regions 1302L and 1302R from the acquired lens information shown in Fig. 12. The rectangular regions 1302L and 1302R are circumscribing rectangles of the circular regions 1301L and 1301R. The circular regions 1301L and 1301R are regions obtained by transforming the circular optical image 1201L formed by the right-eye optical system 301R and the circular optical image 1201R formed by the left-eye optical system 301L onto the logical coordinate system 1300. The system control unit 50 acquires distances 1203L and 1203R between the center position of the physical coordinate system 1200 of the optical image and the circular optical images 1201L and 1201R, respectively, from the attached lens via the communication terminals 6 and 10.

[0193] The center positions 1304L and 1304R of the rectangular regions 1302L and 1302R can be expressed by the following equations using the center position 1303 of the logical coordinate system 1300 of the optical image, a conversion coefficient k determined from the ratio of the sizes of the physical coordinate system and the logical coordinate system, and the distances 1203L and 1203R.

[0194] 1304L=1303-(1203L÷k) 1304R=1303-(1203R÷k) Next, the system control unit 50 calculates the sizes of rectangular regions 1302L and 1302R from the lens information. As shown in Fig. 12, radii 1204L and 1204R of circular optical images 1201L and 1201R are obtained from the lens information. The sizes of rectangular regions 1302L and 1302R can be expressed by the following equations using the radii 1204L and 1204R and a conversion coefficient k determined from the ratio of the sizes of the physical coordinate system and the logical coordinate system. Size of 1302L = (1204L ÷ k) × 2 Size of 1302R = (1204R ÷ k) × 2

[0195] The distances 1203L and 1203R and the radii 1204L and 1204R are determined by the type of lens, and the conversion coefficient k for converting the physical coordinate system of the optical image into the logical coordinate system is determined by the type of image sensor. By performing calculations in this manner, the center positions and sizes of the rectangular areas 1302L and 1302R can be determined even if the type of lens or image sensor changes.

[0196] The coordinates for restricting the movement of the enlargement frame, as described above with reference to FIGS. 10(a) and 10(b), can be determined from the center positions and sizes of the rectangular regions 1302L and 1302R and the size of the enlargement frame.

[0197] XminL, XmaxL, YminL, and YmaxL can be calculated from the size of the rectangular area 1302L and the enlargement frame.

[0198] XminL and XmaxL are coordinates in the horizontal axis (X axis) direction, and when the center coordinates of the enlargement frame reach XminL and XmaxL, these coordinates indicate that the enlargement frame is in contact with the inside of the left and right sides of rectangle 1302L. When the center coordinates of the enlargement frame reach XminL and XmaxL and an instruction is given to move in the opposite direction from center position 1304L as seen from the enlargement frame, control is exercised to restrict the movement of the enlargement frame or to jump to the other LV image (rectangular area).

[0199] XminL is the center position of the enlargement frame when the left side of the enlargement frame is in contact with the left side of rectangle 1302L. In other words, XminL is the value obtained by subtracting half the size of the enlargement frame in the horizontal direction (X-axis direction) inside rectangle 1302L and toward center position 1304L from the X coordinate of the left side of rectangle 1302L.

[0200] XmaxL is the center position of the enlargement frame when the right side of the enlargement frame is in contact with the right side of rectangle 1302L. In other words, XmaxL is the value obtained by subtracting half the size of the enlargement frame in the horizontal direction (X-axis direction) inside rectangle 1302L and toward center position 1304L from the X coordinate of the right side of rectangle 1302L.

[0201] YminL and YmaxL are coordinates along the vertical axis (Y axis), and when the center coordinates of the enlargement frame reach YminL and YmaxL, these coordinates indicate that the enlargement frame is in contact with the inside of the top and bottom sides of rectangle 1302L. When the center coordinates of the enlargement frame reach YminL and YmaxL and an instruction is given to move in the opposite direction from center position 1304L as seen from the enlargement frame, the movement of the enlargement frame is restricted.

[0202] YminL is the center position of the enlargement frame when the top side of the enlargement frame is in contact with the top side of rectangle 1302L. In other words, YminL is the value obtained by subtracting half the size of the enlargement frame in the vertical direction (Y-axis direction) inside rectangle 1302L and toward center position 1304L from the Y coordinate of the top side of rectangle 1302L.

[0203] YmaxL is the center position of the enlargement frame when the bottom side of the enlargement frame is in contact with the bottom side of rectangle 1302L. In other words, XmaxL is the value obtained by subtracting half the size of the enlargement frame in the vertical direction (Y-axis direction) inside rectangle 1302L and toward center position 1304L from the Y coordinate of the bottom side of rectangle 1302L.

[0204] Similarly, XminR, XmaxR, YminR, and YmaxR can be calculated from the size of the rectangular area 1302R and the enlargement frame. Unlike the rectangular area 1302L, it is mirror-symmetric with respect to the line 1305.

[0205] Like XminL and XmaxL, XminR and XmaxR are coordinates along the horizontal axis (X axis), and when the center coordinates of the enlargement frame reach XminR and XmaxR, they indicate that the enlargement frame is in contact with the inside of the left and right sides of the rectangle 1302L. When the center coordinates of the enlargement frame reach XminR and XmaxR, and an instruction is given to move the enlargement frame in the opposite direction from the center position 1304L as seen from the enlargement frame, the movement of the enlargement frame is restricted or the enlargement frame is controlled to jump to the other LV image (rectangular area).

[0206] XminR is the center position of the enlargement frame when the left side of the enlargement frame touches the left side of rectangle 1302R, and XmaxR is the center position of the enlargement frame when the right side of the enlargement frame touches the right side of rectangle 1302R. XminR is the value obtained by subtracting half the horizontal size of the enlargement frame from the X coordinate of the left side of rectangle 1302R, located inside rectangle 1302R and toward center position 1304R, and XmaxR is the value obtained by subtracting half the horizontal size of the enlargement frame from the X coordinate of the right side of rectangle 1302R, located inside rectangle 1302R and toward center position 1304R.

[0207] Like YminL and YmaxL, YminR and YmaxR are coordinates along the vertical axis (Y axis), and when the center coordinates of the enlargement frame reach YminR and YmaxR, they indicate that the enlargement frame is in contact with the inside of the top and bottom sides of rectangle 1302L. When the center coordinates of the enlargement frame reach YminR and YmaxR, and an instruction is given to move the enlargement frame in the opposite direction from center position 1304R as seen from the enlargement frame, the movement of the enlargement frame is restricted.

[0208] YminR is the center position of the enlargement frame when the top side of the enlargement frame touches the top side of rectangle 1302R, and YmaxR is the center position of the enlargement frame when the bottom side of the enlargement frame touches the bottom side of rectangle 1302R. YminR is the value obtained by subtracting half the vertical size of the enlargement frame from the Y coordinate of the top side of rectangle 1302R, located inside rectangle 1302R and on the side of center position 1304R, and YmaxR is the value obtained by subtracting half the vertical size of the enlargement frame from the Y coordinate of the bottom side of rectangle 1302R, located inside rectangle 1302R and on the side of center position 1304R.

[0209] XminL and XminR, XmaxL and XmaxR, YminL and YminR, and YmaxL and YmaxR change depending on the acquired lens information, i.e., the values ​​of center positions 1304L and 1304R and circular regions 1301L and 1301R. Even in a twin lens, lens information may differ depending on manufacturing parameters, etc. For this reason, XminL and XminR, XmaxL and XmaxR, YminL and YminR, and YmaxL and YmaxR do not necessarily match. In other words, the center position and size of each rectangular region 1302L and 1302R are obtained from the lens information for each of the left and right optical systems, and the X and Y coordinates that perform different control on the display position of the enlargement frame are calculated.

[0210] effect As described above, when a position is specified by touch operation or a direction (movement instruction) is given using the MC 82 or the cross key 74, the center coordinates of the enlargement frame indicating the enlargement area are controlled so as not to move outside the rectangular area inscribed in the circularly displayed LV image. In other words, even if a user gives an instruction, the center coordinates of the enlargement frame will not move to areas other than the rectangular areas 1302L and 1302R that are in contact with the circular areas 1301L and 1301R. This control prevents areas in which the LV image is not displayed from being enlarged when the user gives an enlargement instruction, reducing the possibility of user confusion. Furthermore, the enlarged display allows the user to check every corner of the LV image in more detail.

[0211] Next, the enlargement process and the process of changing the enlargement ratio that are executed when the enlargement button 78 is pressed will be described.

[0212] Fig. 8 is a control flowchart relating to the enlargement operation and shooting operation of the LV image displayed on the display unit 28 according to this embodiment. A display example of the display unit 28 when the control flowchart of Fig. 8 is executed will be described with reference to Fig. 9. Details of the display example shown in Fig. 9 will be explained after the explanation of the control flowchart of Fig. 8.

[0213] In S801, the system control unit 50 determines whether the enlarge button 78 has been pressed. If it has been pressed, the process proceeds to S802; if not, the process proceeds to S819. In this embodiment, the user issues an enlargement instruction by pressing the enlarge button 78, but this is not limiting. For example, it is also possible to enlarge the display by pinching in on the touch panel 70a and cancel the enlarged display by pinching out.

[0214] In S802, similarly to S411, the system control unit 50 acquires the type of attached lens via the communication terminals 6 and 10 and determines whether it is a twin lens. If it is a twin lens, the process proceeds to S803; if not, the process proceeds to S812.

[0215] In S803, the system control unit 50 enlarges the LV image at the position where the enlargement frame is displayed by six times and displays it on the display unit 28. The size of the enlargement frame displayed before the enlargement process is executed is set in advance so that when the enlargement process is executed at a six-times enlargement rate, the entire enlarged image is displayed on the display unit 28. The six-times enlargement rate in this case is based on the state in which the LV image displayed on the display unit 28 is not enlarged (at the same size). Display examples at this time are shown in FIGS. 9(c) and (d).

[0216] In S804, the system control unit 50 determines whether or not an operation to move the enlargement position (enlarged area) has been performed. If an operation to move the enlargement position has been performed, the process proceeds to S805; if not, the process proceeds to S806. The operation to move the enlargement position is assumed to be a directional instruction using the MC 82 or the direction keys of the cross key 74, as described using the control flowchart of FIG. 6. Note that the operation can also be performed by operating the touch panel 70a.

[0217] In S805, based on the operation for moving the enlargement position in S804, the system control unit 50 moves the enlargement position only within the currently enlarged area, either to the left or right of the display area of ​​the two LV images displayed on the display unit 28. In other words, even if the area to be enlarged is in contact with the line 705 in either the left or right area and a movement operation is performed to move the center of the enlargement position closer to the line 705, the movement operation is invalidated and the enlargement position is not moved.

[0218] As shown in S607 to S614, when the enlargement frame is moved while the LV image is at full size, the user can visually recognize the enlargement frame displayed on the display unit 28, so the user will not lose track of the enlargement frame even if it can be moved from one area where the enlargement frame is displayed to another area. In contrast, if the enlarged position moves across areas when an enlarged image is displayed, it is difficult for the user to intuitively understand which position the enlarged image is displaying.

[0219] Assume that a user wishes to check the left end of the LV image in the right area in more detail (where the left side of the enlargement position is in contact with line 705). If the user unintentionally moves the enlargement frame while enlarging and checking the left end area of ​​the LV image in the right area, causing the enlarged area to become the LV image at the right end of the LV image in the left area, this may confuse the user. Therefore, when an enlarged image is displayed and the user instructs to move the enlargement position, if the enlargement position is at the end of each LV image, the enlargement position is prevented from moving beyond the left or right area.

[0220] In S806, the system control unit 50 determines whether a left / right switching operation has been performed. If a left / right switching operation has been performed, the process proceeds to S807; if not, the process proceeds to S808. A left / right switching operation refers to an operation of switching from one image to the other of two images arranged side by side. Specifically, a left / right switching operation refers to pressing a button having a left / right switching function (for example, an INFO button (not shown)).

[0221] In S807, the system control unit 50 moves the enlargement position from the area where the enlargement position was set before the left-right switching button was pressed to the other area, and performs an enlarged display. At this time, the system control unit 50 moves the enlargement position so that the relative position of the enlargement position in the area where the enlargement position was set before the left-right switching button was pressed is maintained even after moving to the other area. For example, when an LV image of the right area is enlarged, the system calculates the distance from the center of the LV image of the right area to the enlargement position. In response to a left-right switching operation performed by the user, the system calculates the distance from the center of the LV image to the enlargement position to the distance from the center of the LV image of the opposite area (here, the left area), and displays the calculated distance on the display unit 28 as the enlargement position. By using this control, when a user wants to check the same position on both the left and right LV images displayed, switching between the left and right LV images can be performed easily with fewer steps, and does not require time during shooting.

[0222] In S808, the system control unit 50 determines whether or not the enlargement button 78 has been pressed. If it has been pressed, the process proceeds to S809, and if not, the process returns to S804.

[0223] In S809, the system control unit 50 refers to the system memory 52 and determines whether the magnification of the LV image displayed on the display unit 28 is 15 times. If it is 15 times, the process proceeds to S810; if not, the process proceeds to S811.

[0224] In S810, the system control unit 50 cancels the enlarged state of the LV image and displays the non-enlarged (actual size) LV image on the display unit 28. Display examples at this time are shown in Figures 9(a) and 9(b).

[0225] In S811, the system control unit 50 enlarges and displays the LV image on the display unit 28 at a magnification of 15 times at the display position of the enlargement frame superimposed on the LV image. The magnification of 15 times in this case is based on the magnification of the LV image in a non-enlarged (actual size) state. Display examples are shown in Figures 9(e) and (f).

[0226] In S812, since the determination in S802 is No, the system control unit 50 enlarges and displays the LV image at a magnification of 6 times on the display unit 28 at the display position of the enlargement frame superimposed on the LV image. The magnification of 6 times in this case is a magnification ratio based on the LV image in a non-enlarged (actual size) state.

[0227] In S813, similarly to S804, the system control unit 50 determines whether or not an operation to move the enlargement position has been performed. If an operation to move the enlargement position has been performed, the process proceeds to S814; if not, the process proceeds to S815.

[0228] In S814, the system control unit 50 moves the enlargement position within the display area of ​​the LV image based on the operation to move the enlargement position. In this step, since the determination in S802 is No, it is determined that the lens attached to the digital camera 010 is a single lens or that no lens is attached. In other words, since only one LV image is displayed on the display unit 28, the enlargement position can be moved without considering the left and right areas as in S805.

[0229] In S815, similarly to S808, the system control unit 50 determines whether or not the enlargement button 78 has been pressed. If it has been pressed, the process proceeds to S816, and if not, the process returns to S813.

[0230] In S816, the system control unit 50 determines whether the current magnification ratio of the LV image is 15 by referring to the system memory 52. ​​If it is 15, the process proceeds to S817, and if not, the process proceeds to S818.

[0231] In S817, similarly to S810, the system control unit 50 cancels the enlarged state of the LV image and displays the non-enlarged (actual size) LV image on the display unit .

[0232] In S818, the system control unit 50 enlarges and displays the LV image at a magnification of 15 times on the display unit 28 at the display position of the enlargement frame superimposed on the LV image. The magnification of 15 times in this case is a magnification based on the LV image in a non-enlarged (actual size) state.

[0233] In S819, the system control unit 50 determines whether the first shutter switch 62 is on. If the first shutter switch 62 is on, the process proceeds to S820; if not, the process proceeds to S830. As described above, the first shutter switch 62 being on indicates that the shutter button 61 is half-pressed. In other words, it can be assumed that the user is about to take a picture.

[0234] In S820, similar to S411, the system control unit 50 acquires the type of attached lens via the communication terminals 6 and 10 and determines whether it is a twin lens. If it is a twin lens, the process proceeds to S823; if not, the process proceeds to S821.

[0235] In S821, the system control unit 50 determines whether the focus mode is set to AF mode. If it is set to AF mode, the process proceeds to S822, and if not (if it is set to MF mode), the process proceeds to S823. Switching between AF mode and MF mode can be done using a setting menu screen or a switch provided on the outside of the lens unit 150.

[0236] In S822, the system control unit 50 performs AF processing based on the AF frame position.

[0237] In S823, the system control unit 50 performs other photographing preparation processes such as AE and AWB.

[0238] In S824, the system control unit 50 determines whether or not the second shutter switch 64 is turned on. If the second shutter switch 64 is turned on, that is, if the shutter button 61 is fully pressed, the process proceeds to S825; otherwise, the process proceeds to S829.

[0239] In S825, similarly to S411, the system control unit 50 acquires the type of attached lens via the communication terminals 6 and 10 and determines whether it is a twin lens. If it is a twin lens, the process proceeds to S826; if not, the process proceeds to S827.

[0240] In S826, the system control unit 50 performs a series of image capturing processes up to recording the images captured by the twin lenses, twin lens information, and the like, as an image file on the recording medium 200.

[0241] In S827, the system control unit 50 performs a series of photographing processes up to recording the captured image and normal (single lens) lens information and the like on the recording medium 200 as an image file.

[0242] In S828, the system control unit 50 determines whether or not the first shutter switch 62 continues to be on. If the first shutter switch 62 continues to be on, the process returns to S824; otherwise, the process proceeds to S830.

[0243] In S829, the system control unit 50 determines whether any other operation other than those described above has been detected. If any other operation has been detected, the process proceeds to S830; otherwise, the process proceeds to S831. Specifically, the system control unit 50 determines whether the menu button 81, the play button 79, or the like has been pressed.

[0244] In S830, the system control unit 50 starts executing other processing corresponding to the detected other operation. When the menu button 81 is pressed, a setting menu screen is displayed, and when the play button 79 is pressed, an image stored in the recording medium 200 is displayed on the display unit 28.

[0245] In S831, the system control unit 50 determines whether or not the shooting standby state has ended. For example, if the shooting standby state has ended due to power-off or the like, the control flowchart in Fig. 8 ends; if not, the process returns to S401 in Fig. 4.

[0246] 9(a) to 9(f), the LV image displayed on the display unit 28 when an enlargement instruction is given by the user will be described.

[0247] FIG. 9(a) shows a display example in which the magnification is the same (i.e., no magnification) and the magnification frame is displayed superimposed on the left region, i.e., the LV image (LV900R) captured via the right-eye optical system 301R. The display unit 28 displays the LV900R captured via the right-eye optical system 301R and the LV900L captured via the left-eye optical system 301L. As described above, the LV900R displayed in the left region is captured via the right-eye optical system 301R, and the LV900L displayed in the right region is captured via the left-eye optical system 301L. Display items 901 and 902 are displayed to notify the user that the images are reversed. The display item 901 displays "R" to indicate right, and the display item 902 displays "L" to indicate left. When the enlargement button 78 is pressed once in the state shown in Figure 9(a), the state transitions to that shown in Figure 9(c), and when the left / right switching button (not shown) is pressed once, the enlargement frame superimposed on LV900R moves to the same relative position on LV900L, transitioning to the state shown in Figure 9(b).

[0248] 9(b) shows a display example in which the magnification is 1x (i.e., no magnification) and the magnification frame is displayed superimposed on the right region, i.e., the LV image (LV900L) captured by the left-eye optical system 301L. In FIG. 9(b), the magnification frame 904 is displayed superimposed on the LV900L. Pressing the magnification button 78 once in the state shown in FIG. 9(b) transitions to the state shown in FIG. 9(d), and pressing the left / right switching button once moves the magnification frame superimposed on the LV900L to the same relative position on the LV900R, transitioning to the state shown in FIG. 9(a).

[0249] 9(c) is a display example when the LV900R is enlarged at a magnification of 6. The enlarged image displayed on the display unit 28 has a display item 901 indicating which optical system was used to capture the image, superimposed on the enlarged LV image, LV910R.

[0250] 9(d) is a display example in which the LV900L is enlarged by a magnification of 6. The enlarged image displayed on the display unit 28 has a display item 902 indicating which optical system was used to capture the image, superimposed on the enlarged LV image LV910L.

[0251] 9(e) is a display example in which the LV900R is enlarged and displayed at a magnification of 5. The enlarged image displayed on the display unit 28 is superimposed on the LV920R enlarged by 15 times, and a display item 901 showing the LV image captured by the right-eye optical system 301R is displayed.

[0252] 9(f) is a display example in which the LV900L is enlarged and displayed at a magnification of 5. The enlarged image displayed on the display unit 29 is superimposed on the LV920L enlarged by 15 times, and a display item 902 showing the LV image captured by the left eye optical system 301L is displayed.

[0253] That is, Figures 9(a) and (b) are LV images displayed on the display unit 28 when the magnification is 1x (i.e., no magnification), Figures 9(c) and (d) are LV images displayed when the magnification is 6x, and Figures 9(e) and (f) are LV images displayed on the display unit 28 when the magnification is 15x.

[0254] Each time the enlargement button 78 is pressed, the enlargement magnification of the LV image displayed on the display unit 28 changes in the following order: 1x → 6x → 5x → 1x. Also, when the left / right switching button is pressed, if the enlargement magnification is 1x, the enlargement frame is switched to be superimposed on the other LV image. In other words, if the enlargement frame is superimposed on the LV900R displayed in the left area, the display area is switched so that it is superimposed on the LV900L displayed in the right area. If the enlargement magnification is other than 1x, the enlargement position is switched to the area of ​​the other LV image that is in the same relative position. In this case, the enlargement magnification does not change.

[0255] It has been explained that operations such as switching display modes, moving the enlargement frame or enlargement position, and enlargement are performed using operation buttons with dedicated functions, but each function may also be assigned to a button to which various arbitrary functions can be assigned.

[0256] As described above, when a lens having two optical systems (twin lens) is attached and image capture is performed, the enlargement frame indicating the enlargement position of the LV image during capture is set to include the area where an optical image is formed (and not include only the area where no optical image is formed). Two LV images captured via the two optical systems are displayed side by side on the display, and the enlargement frame is displayed and moved so as to include at least a portion of the optical image (left image or right image) so as not to include only the area where no optical image is formed. This makes it possible to avoid enlarging only the area where no optical image is formed when the user issues an enlargement command, thereby reducing user confusion.

[0257] Furthermore, when two LV images are displayed at the same size (not enlarged), control is performed so that the center of the enlargement frame does not move outside the rectangular area inscribed in the circularly displayed LV image when a position is specified by a touch operation or a direction (movement instruction) is given using the MC 82 or the cross key 74. In other words, even if a user gives an instruction, the center coordinates of the enlargement frame do not move to the area 1311 indicating the margin (shaded area) that is obtained by excluding the rectangular areas 1302L and 1302R that are adjacent to the circular areas 1301L and 1301R from the area 1310 of the display unit 28. This control prevents areas where no LV image is displayed from being enlarged when the user gives an enlargement instruction, reducing the possibility of user confusion. Furthermore, the enlarged display allows the user to check every corner of the LV image in more detail.

[0258] On the other hand, if one of the two LV images is enlarged, even if an instruction to move the enlargement position is given when the edge of the boundary of the currently enlarged image (the right edge if the left region is enlarged, or the left edge if the right region is enlarged) is reached, the enlargement position will not move in the instructed direction. In other words, in a situation where it is difficult for the user to visually recognize the current enlargement position, the enlargement position will not move beyond the region (the boundary of the LV images). This makes it possible to reduce unintentional crossing of the boundary of the LV images and to reduce user confusion.

[0259] Additionally, when a lens with two optical systems (twin lens) is attached, the focus guide and magnification frame are not linked (de-linked). This means that when two LV images are displayed, as with a twin lens, and it is difficult to check the entire LV image in detail without magnification, there is a high possibility that users will want to enlarge the LV image regardless of the focus position to check it in more detail. Therefore, rather than allowing users to enlarge only the position of the focus guide, which has a frame indicating the focus detection area, the focus guide and AF frame are de-linked so that users can enlarge the position of their choice. On the other hand, when a normal lens (single lens) is attached, the focus guide / AF frame and magnification frame are primarily linked, and moving the focus guide / AF frame also moves the position of the magnification frame. When a single lens is attached, only one LV image is displayed, and the LV image is displayed larger on the display than when two LV images are displayed. This makes it easier to check the LV image in more detail at 100% magnification than when a twin lens is attached.

[0260] The various controls described above as being performed by the system control unit 50 may be performed by a single piece of hardware, or the entire device may be controlled by multiple pieces of hardware (e.g., multiple processors or circuits) sharing the processing.

[0261] Furthermore, although the present invention has been described in detail based on preferred embodiments thereof, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. Furthermore, each of the above-described embodiments merely represents one embodiment of the present invention, and each embodiment can be combined as appropriate.

[0262] Furthermore, in the above-described embodiment, the present invention has been described as being applied to digital camera 100, but this is not limiting and the present invention can be applied to any imaging control device that can display images captured by two optical systems. In other words, the present invention can be applied to personal computers, PDAs, mobile phone terminals, portable image viewers, printer devices with displays, digital photo frames, music players, game consoles, electronic book readers, home appliances, in-vehicle devices, medical equipment, and the like.

[0263] The present invention is not limited to application to the imaging device itself, but can also be applied to a control device that communicates with an imaging device (including a network camera) via wired or wireless communication and remotely controls the imaging device. Examples of devices that remotely control an imaging device include smartphones, tablet PCs, and desktop PCs. The imaging device can be remotely controlled by issuing commands from the control device to the imaging device to perform various operations and settings based on operations or processes performed on the control device. Furthermore, a live view image captured by the imaging device may be received via wired or wireless communication and displayed on the control device.

[0264] (Other embodiments) The present invention can also be realized by executing the following process. That is, software (programs) that realize the functions of the above-described embodiments are supplied to a system or device via a network or various storage media, and the computer (or CPU, MPU, etc.) of the system or device reads and executes the program code. In this case, the program and the storage media storing the program constitute the present invention.

Claims

1. an acquisition means for acquiring a third image in which a first image captured via a first optical system and a second image captured via a second optical system and having a parallax with respect to the first image are arranged side by side; a setting unit that sets a target range of the third image to which predetermined processing is to be applied in response to a user operation, the third image has a third region in which no optical image different from the first image or the second image is formed, the setting means sets a movable area in which the target range included in the third image can be moved so that the area of ​​the first image or the area of ​​the second image is included inside the movable area; The movable area is set so that the target range cannot include only the third area that does not include either the first image area or the second image area. An electronic device characterized by:

2. The electronic device according to claim 1 , wherein the first image and the second image are displayed in a circular shape.

3. a first receiving means for receiving a position specification of an item indicating the target range; a second receiving means for receiving an expansion instruction for expanding the target range; a display means for displaying the third image and the item; The setting means In response to the user's designation of the position, change the position of the item to the designated position; 3. The electronic device according to claim 1, wherein when the user issues the enlargement instruction, the third image is controlled to be enlarged based on the target range indicated by the item.

4. 4. The electronic device according to claim 1, wherein the setting unit controls the target range so that the target range includes at least one pixel of the first image or the second image.

5. 4. The electronic device according to claim 1, wherein the setting unit controls the target range so that at least half of the target range includes either the first image or the second image.

6. 2. The electronic device according to claim 1, wherein either the first image or the second image is entirely contained within the movable area.

7. The electronic device according to claim 1 , wherein only one of the first image and the second image is included inside the movable area.

8. 2. The electronic device according to claim 1, wherein the third area is an area that is not photographed through the first optical system and an area that is not photographed through the second optical system.

9. an acquisition means for acquiring a third image in which a first image captured via a first optical system and a second image captured via a second optical system and having a parallax with respect to the first image are arranged side by side; a setting unit that sets a target range of the third image to which predetermined processing is to be applied in response to a user operation, the setting means sets the target range so that the target range includes at least a part of the first image or the second image; The electronic device is characterized in that the target range is a range smaller than an area of ​​the third image that is different from both an area of ​​the first image and an area of ​​the second image.

10. an acquiring step of acquiring a third image in which a first image captured through a first optical system and a second image captured through a second optical system and having a parallax with respect to the first image are arranged side by side; a setting step of setting a target range of the third image to which predetermined processing is to be applied in response to a user operation, the third image has a different area from the first image and the second image; the setting step sets a movable area in which the target range included in the third image can be moved so that the movable area includes an area of ​​the first image in the third image or an area of ​​the second image in the third image; A method for controlling an electronic device, characterized in that the movable area is set so that the target range cannot be set to include only an area that does not include either the first image area or the second image area.

11. A program for causing a computer to function as each of the means of the electronic device according to any one of claims 1 to 8.

12. 9. A computer-readable recording medium storing a program for causing a computer to function as each of the means of the electronic device according to claim 1.

Images