Electronic equipment, control method therefor, program and storage medium

Abstract

To allow a user to visually recognize an enlarged position in a state where a plurality of live view images are displayed.SOLUTION: Electronic equipment includes: acquisition means of acquiring a third image in which a first image captured via a first optical system and a second image captured via a second optical system and having parallax with respect to the first image are arranged side by side; and setting means of setting a target range which is included in the third image and to which predetermined processing is applied, according to a user operation, the setting means setting the target region such that an item indicating the target region includes only one of the first image and the second image.SELECTED DRAWING: Figure 7

Description

[Technical Field]

[0001] The present invention relates to an electronic device, a control method thereof, a program, and a recording medium. [Background technology]

[0002] In recent years, digital cameras with two lens optical systems have become known. If the two optical systems are arranged to capture images in the same direction, it is possible to create an image capturing a 180-degree range (a hemispherical image) or an image that allows stereoscopic viewing from the two images captured by each system, which have parallax. If the two optical systems are arranged to capture images in opposite directions, it is possible to create an image capturing a 360-degree range (a spherical image) from the two images captured by each system.

[0003] When capturing two images with parallax using a digital camera with two optical systems, the user must check two live view images while shooting. With a typical digital camera with a single optical system, the user can enlarge and check one live view image in detail.

[0004] Patent Document 1 discloses that in a digital camera having one optical system, the positions of the enlargement frame and the AF frame can be set separately within a live view image. When a user issues an instruction to enlarge, enlargement is performed at the display position of the enlargement frame displayed on one live view image. Patent Document 2 discloses that a spherical image acquired by two optical systems is displayed, and when a user issues an instruction to prepare for shooting, a live view image of a specific enlargement range is enlarged and displayed. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Japanese Patent Application Publication No. 2013-201527 [Patent Document 2] JP 2019-12881 A Summary of the Invention [Problem to be solved by the invention]

[0006] However, Patent Document 1 does not disclose a case where two live view images are displayed, and does not consider which live view image the enlargement frame will be displayed on and which live view image will be enlarged.In Patent Document 2, it is not possible to know which part of the fisheye image will be enlarged, or the enlargement range, until a shooting preparation instruction is given.

[0007] Therefore, an object of the present invention is to enable a user to visually recognize the enlargement position when a plurality of live view images are displayed. [Means for solving the problem]

[0008] In order to solve the above problems, the present invention provides: an acquisition means for acquiring a third image in which a first image captured through a first optical system and a second image captured through a second optical system and having a parallax with respect to the first image are arranged side by side; a setting unit that sets a target range of the third image to which predetermined processing is to be applied in response to a user operation, The setting means sets the target range so that the item indicating the target range includes only one of the first image and the second image. [Effects of the Invention]

[0009] According to the present invention, the user can visually recognize the enlargement position when a plurality of live view images are displayed. [Brief explanation of the drawings]

[0010] [Figure 1] FIG. 1 is an external view of a digital camera 100. [Figure 2] 1 is a schematic block diagram showing an example of the hardware configuration of a digital camera 100. FIG. [Figure 3] FIG. 2 is a schematic diagram illustrating an example of the configuration of a lens unit. [Figure 4] 10 is a flowchart of a display mode switching process of a camera when a twin lens is attached and a process when a live view is touched according to the present embodiment. [Figure 5] FIG. 10 is a diagram showing an example of a live view display of the camera when twin lenses are attached according to the present embodiment. [Figure 6] 10 is a flowchart of a process for moving the enlargement frame of a camera when a twin lens is attached according to the present embodiment. [Figure 7] 10A and 10B are diagrams illustrating the left and right boundaries of a live view of a camera when a twin lens is attached according to the present embodiment. [Figure 8] 10 is a flowchart of a magnification process and a photographing operation of a camera when a twin lens is attached according to an embodiment. [Figure 9] 10A and 10B are diagrams for explaining a zoom operation of a camera when twin lenses are attached according to an embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] A preferred embodiment of the present invention will be described below with reference to the drawings. In this embodiment, the electronic device will be described as a digital camera (image capture device).

[0012] The digital camera 100 according to this embodiment can acquire a twin-lens image in which a left image and a right image having a predetermined parallax in the left-right direction are arranged side by side in a single image, and display the image on the display unit. The digital camera 100 can also apply predetermined image processing to a target area of ​​the image displayed on the display unit. The predetermined image processing can be, for example, enlargement processing, and the enlargement processing will be described in detail below. The digital camera 100 displays an enlarged image of the target area enlarged in response to an enlargement instruction on the display unit. Note that the predetermined image processing is not limited to enlargement processing. For example, it can be processing that detects the luminance distribution or chromaticity distribution within the target area and generates a histogram or waveform monitor, or processing that applies filter processing such as contrast enhancement to the target area. In this embodiment, an enlargement instruction is issued by pressing the enlarge button 78, which is a depressible physical member. However, an enlargement instruction can also be issued by pinching in on the touch panel 70a, and the enlarged display can also be canceled by pinching out.

[0013] The digital camera 100 according to this embodiment displays an item indicating the target range in the twin-lens image in line with the twin-lens image. The item may be, for example, a frame-shaped indicator indicating the target range or a semi-transparent color image to be combined with the target range. The digital camera 100 can change the display position of the item (i.e., the target range indicated by the item) in response to a user operation. When displaying a twin-lens image, the digital camera 100 displays the item in a position that does not straddle both the left and right images. In other words, the target range is determined so as not to include both the left and right images. In other words, the target range is set so as to include only one of the left and right images.

[0014] Even if a user performs an operation to change the display position of an item (position of the target range), digital camera 100 controls the display of the item so that the target range indicated by the item does not straddle both the left and right images.

[0015] 1(a) and 1(b) show external views of a digital camera 100 as an example of a device to which the present invention can be applied. FIG. 1(a) is a front perspective view of the digital camera 100, and FIG. 1(b) is a rear perspective view of the digital camera 100. In FIG. 1, a display unit 28 is a display unit provided on the back of the camera that displays images and various information. A touch panel 70a is a touch detection means that can detect touch operations on the display surface (operation surface) of the display unit 28. An outside-finder display unit 43 is a display unit provided on the top surface of the camera that displays various camera settings such as shutter speed and aperture.

[0016] The shutter button 61 is an operation part for issuing shooting instructions. The mode selector switch 60 is an operation part for switching between various modes. The terminal cover 40 is a cover for protecting a connector (not shown) such as a connection cable that connects an external device to the digital camera 100. The main electronic dial 71 is a rotary operation part included in the operation part 70, and by turning this main electronic dial 71, settings such as shutter speed and aperture can be changed. The power switch 72 is an operation part for switching the power of the digital camera 100 on and off.

[0017] The sub electronic dial 73 is included in the operation unit 70 and is a rotary operation member included in the operation unit 70, which is used to move the selection frame, advance images, etc. The cross key 74 is included in the operation unit 70 and is a cross key (four-way key) that can be pressed up, down, left, or right. Operations can be performed according to the part of the cross key 74 that is pressed. The SET button 75 is included in the operation unit 70 and is a push button that is mainly used to confirm selections, etc. The video button 76 is used to start and stop video shooting (recording).

[0018] The enlargement button 78 is included in the operation unit 70 and is an operation button for turning the enlargement mode on and off in the live view display in the shooting mode. By turning the enlargement mode on and operating the main electronic dial 71, the LV image can be enlarged or reduced. In the playback mode, it functions as an enlargement button for enlarging the playback image and increasing the magnification ratio. The playback button 79 is included in the operation unit 70 and is an operation button for switching between the shooting mode and the playback mode. By pressing the playback button 79 in the shooting mode, the mode switches to the playback mode, and the most recent image recorded on the recording medium 200 can be displayed on the display unit 28.

[0019] The menu button 81 is included in the operation unit 70, and when the menu button 81 is pressed, a menu screen in which various settings can be made is displayed on the display unit 28. The user can intuitively make various settings using the menu screen displayed on the display unit 28, the cross key 74, and the SET button 75.

[0020] The multi-controller 82 can be used as an eight-way directional key, such as up, down, left, and right, by tilting it in any direction. It can also be used to activate an assigned function by pressing it. The display mode switching button 83 is an operating member for switching between multiple different display modes for information such as live view images and shooting information displayed on the display unit 28 or EVF 29. Each time the display mode switching button 83 is pressed, the display mode switches, allowing the user to view information about images being shot or played back in the display mode desired by the user.

[0021] The communication terminal 10 is a communication terminal for the digital camera 100 to communicate with the lens side (detachable).

[0022] The eyepiece 16 is the eyepiece of an eyepiece finder (a peer-type finder), and the user can view the image displayed on the internal EVF 29 through the eyepiece 16. The eyepiece detection unit 57 is an eyepiece detection sensor that detects whether the photographer has placed their eye on the eyepiece 16. The lid 202 is a lid for a slot that stores a recording medium 200. The grip 90 is a holding unit shaped to be easily held in the right hand when the user holds the digital camera 100. When the digital camera is held by gripping the grip 90 with the little finger, ring finger, and middle finger of the right hand, the shutter button 61 and main electronic dial 71 are located in positions that can be operated with the index finger of the right hand. In the same position, the sub electronic dial 73 is located in a position that can be operated with the thumb of the right hand.

[0023] FIG. 2 is a block diagram showing an example of the configuration of a digital camera 100 according to this embodiment. In FIG. 2, lens unit 150 is a lens unit equipped with an interchangeable photographic lens. Lens 103 typically consists of multiple lenses, but for simplicity, only a single lens is shown here. Communication terminal 6 is a communication terminal through which lens unit 150 communicates with digital camera 100, and communication terminal 10 is a communication terminal through which digital camera 100 communicates with lens unit 150. Lens unit 150 communicates with system controller 50 via communication terminals 6 and 10, controls aperture 1 via aperture drive circuit 2 using an internal lens system control circuit 4, and adjusts focus by displacing the position of lens 103 via AF drive circuit 3. Additionally, the type of lens unit 150 attached to digital camera 100 is identified via communication terminals 6 and 10.

[0024] The shutter 101 is a focal plane shutter that can freely control the exposure time of the imaging unit 22 under the control of the system control unit 50.

[0025] The imaging unit 22 is an imaging element configured with a CCD, CMOS element, or the like that converts an optical image into an electrical signal. The imaging unit 22 may have an imaging surface phase difference sensor that outputs defocus amount information to the system control unit 50. The A / D converter 23 converts an analog signal into a digital signal. The A / D converter 23 is used to convert the analog signal output from the imaging unit 22 into a digital signal.

[0026] The image processing unit 24 performs predetermined pixel interpolation, resizing such as reduction, and color conversion processing on the data from the A / D converter 23 or the data from the memory control unit 15. The image processing unit 24 also performs predetermined arithmetic processing using the captured image data. The system control unit 50 performs exposure control and distance measurement control based on the arithmetic results obtained by the image processing unit 24. This allows TTL (through-the-lens) type AF (autofocus) processing, AE (autoexposure) processing, and EF (flash pre-flash) processing to be performed. The image processing unit 24 also performs predetermined arithmetic processing using the captured image data, and performs TTL type AWB (auto white balance) processing based on the arithmetic results obtained.

[0027] The output data from the A / D converter 23 is written into the memory 32 via the image processing unit 24 and the memory control unit 15, or directly via the memory control unit 15. The memory 32 stores image data obtained by the imaging unit 22 and converted into digital data by the A / D converter 23, as well as image data to be displayed on the display unit 28 and the EVF 29. The memory 32 has a storage capacity sufficient to store a predetermined number of still images and a predetermined period of moving images and audio.

[0028] The memory 32 also serves as a memory (video memory) for image display. The D / A converter 19 converts the image display data stored in the memory 32 into an analog signal and supplies it to the display unit 28 and the EVF 29. In this way, the display image data written to the memory 32 is displayed on the display unit 28 and the EVF 29 via the D / A converter 19. The display unit 28 and the EVF 29 perform display according to the analog signal from the D / A converter 19 on a display device such as an LCD or an organic EL. The digital signal that has been A / D converted once by the A / D converter 23 and stored in the memory 32 is converted to analog in the D / A converter 19 and then sequentially transferred and displayed on the display unit 28 or the EVF 29, thereby performing a live view display (LV display). Hereinafter, an image displayed in live view will be referred to as a live view image (LV image).

[0029] The outside-finder liquid crystal display 43 displays various camera settings such as shutter speed and aperture via an outside-finder display drive circuit 44 .

[0030] The nonvolatile memory 56 is an electrically erasable and recordable memory, such as an EEPROM. The nonvolatile memory 56 stores constants, programs, etc. for the operation of the system control unit 50. The programs referred to here are programs for executing various flowcharts described later in this embodiment.

[0031] The system control unit 50 is a control unit made up of at least one processor or circuit, and controls the entire digital camera 100. By executing the programs recorded in the nonvolatile memory 56 mentioned above, each process of this embodiment, which will be described later, is realized. The system memory 52 uses, for example, a RAM, and stores constants and variables for the operation of the system control unit 50, programs read from the nonvolatile memory 56, and the like. The system control unit 50 also performs display control by controlling the memory 32, D / A converter 19, display unit 28, etc.

[0032] The system timer 53 is a timekeeping unit that measures the time used for various controls and the time of a built-in clock.

[0033] The operation unit 70 is an operation means for inputting various operation instructions to the system control unit 50 . The mode selector switch 60 is an operating member included in the operation unit 70, and switches the operating mode of the system control unit 50 to one of still image capture mode, video capture mode, playback mode, etc. Modes included in the still image capture mode include auto capture mode, auto scene determination mode, manual mode, aperture priority mode (Av mode), shutter speed priority mode (Tv mode), and program AE mode (P mode). There are also various scene modes and custom modes that provide capture settings for specific shooting scenes. The user can directly switch to one of these modes using the mode selector switch 60. Alternatively, the user may first switch to a list screen of shooting modes using the mode selector switch 60, then select one of the displayed modes and switch using other operating members. Similarly, the video capture mode may also include multiple modes.

[0034] The first shutter switch 62 is turned on and generates a first shutter switch signal SW1 when the shutter button 61 provided on the digital camera 100 is pressed halfway (a shooting preparation command) during operation. The first shutter switch signal SW1 starts shooting preparation operations such as AF (autofocus) processing, AE (auto exposure) processing, AWB (auto white balance) processing, and EF (pre-flash) processing.

[0035] The second shutter switch 64 is turned on when the shutter button 61 is fully pressed (photographing instruction) and generates a second shutter switch signal SW2. The system control unit 50 starts a series of photographing processing operations, from reading out a signal from the imaging unit 22 to writing the captured image to the recording medium 200 as an image file, in response to the second shutter switch signal SW2.

[0036] The operation unit 70 is a variety of operation members (reception means) that serve as an input unit that receives operations from the user. The operation unit 70 includes at least the following operation members: the shutter button 61, the main electronic dial 71, the power switch 72, the sub electronic dial 73, the cross key 74, the SET button 75, the movie button 76, the AF lock button 77, the magnification button 78, the playback button 79, the menu button 81, and the multi-controller 82. Other operation members 70b collectively represent operation members that are not individually shown in the block diagram.

[0037] The power supply control unit 80 is composed of a battery detection circuit, a DC-DC converter, a switch circuit for switching between powered blocks, etc., and detects whether a battery is installed, the battery type, and the remaining battery charge. The power supply control unit 80 also controls the DC-DC converter based on the detection results and instructions from the system control unit 50, and supplies the required voltage for the required period to each unit, including the recording medium 200. The power supply unit 30 is composed of primary batteries such as alkaline batteries or lithium batteries, secondary batteries such as NiCd batteries, NiMH batteries, or Li batteries, an AC adapter, etc.

[0038] The recording medium I / F 18 is an interface with a recording medium 200 such as a memory card or a hard disk. The recording medium 200 is a recording medium such as a memory card for recording captured images, and is composed of a semiconductor memory, a magnetic disk, or the like.

[0039] The communication unit 54 is connected wirelessly or via a wired cable, and transmits and receives video signals and audio signals. The communication unit 54 can also be connected to a wireless LAN (Local Area Network) or the Internet. The communication unit 54 can also communicate with external devices via Bluetooth (registered trademark) or Bluetooth Low Energy. The communication unit 54 can transmit images (including LV images) captured by the imaging unit 22 and images recorded on the recording medium 200, and can also receive images and various other information from external devices.

[0040] The orientation detection unit 55 detects the orientation of the digital camera 100 with respect to the direction of gravity. Based on the orientation detected by the orientation detection unit 55, it is possible to determine whether an image captured by the imaging unit 22 was captured with the digital camera 100 held horizontally or vertically. The system control unit 50 can add orientation information corresponding to the orientation detected by the orientation detection unit 55 to the image file of the image captured by the imaging unit 22, or rotate and record the image. An acceleration sensor, a gyro sensor, or the like can be used as the orientation detection unit 55. The acceleration sensor or gyro sensor of the orientation detection unit 55 can also be used to detect movement of the digital camera 100 (panning, tilting, lifting, whether it is stationary, etc.).

[0041] The eyepiece detection unit 57 is an eyepiece detection sensor that detects (approach detection) whether the eye (object) is approaching (eyepiece) or moving away (eyepiece) from the viewfinder eyepiece unit 16. The system control unit 50 switches the display unit 28 and the EVF 29 between display (display state) and non-display (non-display state) depending on the state detected by the eyepiece detection unit 57. More specifically, at least in the shooting standby state and when the display destination switching is automatic, when the eye is not placed near the camera, the display is turned on as the display unit 28 and the EVF 29 is not displayed. Furthermore, when the eye is placed near the camera, the display is turned on as the display unit 29 and the EVF 29 is not displayed.

[0042] The eyepiece detection unit 57 can be, for example, an infrared proximity sensor, and can detect the approach of an object to the eyepiece 16 of the viewfinder that houses the EVF 29. When an object approaches, infrared light emitted from a light-emitting unit (not shown) of the eyepiece detection unit 57 is reflected and received by a light-receiving unit (not shown) of the infrared proximity sensor. The amount of received infrared light can also be used to determine the distance the object has approached from the eyepiece 16 (eyepiece distance). In this way, the eyepiece detection unit 57 performs eyepiece detection, detecting the proximity of an object to the eyepiece 16.

[0043] When an object is detected approaching within a predetermined distance from the eyepiece unit 16 from a non-eyepiece state (non-approaching state), it is detected that the eye has been placed in proximity. When an object that was detected as approaching from the eyepiece state (approaching state) moves away by more than a predetermined distance, it is detected that the eye has been removed. The threshold for detecting eye placement and the threshold for detecting eye removal may be different, for example, by providing hysteresis. Furthermore, after detecting eye placement, the eye placement state is maintained until eye removal is detected. After detecting eye removal, the eye placement state is maintained until eye placement is detected. Note that the infrared proximity sensor is just one example, and other sensors that can detect the approach of an eye or object that can be considered as eye placement may be used for the eye placement detection unit 57.

[0044] The touch panel 70a and the display unit 28 can be configured as an integrated unit. For example, the touch panel 70a is configured so that its light transmittance does not interfere with the display of the display unit 28, and is attached to the upper layer of the display surface of the display unit 28. Input coordinates on the touch panel 70a are then associated with display coordinates on the display screen of the display unit 28. This makes it possible to provide a GUI (Graphical User Interface) that allows the user to directly operate the screen displayed on the display unit 28. The system control unit 50 can detect the following operations or states on the touch panel 70a: A finger or pen that has not been touching the touch panel 70a touches the touch panel 70a again, that is, the start of touching (hereinafter referred to as touch-down). The touch panel 70a is in a state where it is touched with a finger or a pen (hereinafter referred to as Touch-On). Touching the touch panel 70a with a finger or a pen and moving it (hereinafter referred to as Touch-Move). The finger or pen that has been touching the touch panel 70a is released, that is, the touch ends (hereinafter referred to as "touch-up"). A state in which nothing is touching the touch panel 70a (hereinafter referred to as Touch-Off).

[0045] When touch down is detected, touch on is also detected at the same time. After touch down, touch on will usually continue to be detected unless touch up is detected. Touch move is also detected when touch on is detected. Even if touch on is detected, touch move will not be detected unless the touch position moves. Once it is detected that all fingers or pens that were touching have touched up, touch off occurs.

[0046] These operation states and the position coordinates of the finger or pen touching the touch panel 70a are notified to the system control unit 50 via the internal bus, and the system control unit 50 determines what operation (touch operation) has been performed on the touch panel 70a based on the notified information. Regarding touch moves, the direction of movement of the finger or pen moving on the touch panel 70a can also be determined for each vertical and horizontal component on the touch panel 70a based on changes in the position coordinates.

[0047] If a touch move of a predetermined distance or more is detected, it is determined that a slide operation has been performed. An operation in which a finger is touched to the touch panel, quickly moved a certain distance, and then released is called a flick. In other words, a flick is an operation in which a finger is quickly traced across the touch panel 70a as if flicking. If a touch move of a predetermined distance or more at a predetermined speed or more is detected, and a touch up is then detected, it can be determined that a flick has been performed (it can be determined that a flick occurred following a slide operation).

[0048] Furthermore, a touch operation in which multiple points (for example, two points) are touched together (multi-touch) and the touch positions are brought closer together is called a pinch in, and a touch operation in which the touch positions are moved farther apart is called a pinch out. Pinch out and pinch in are collectively called a pinch operation (or simply pinch). The touch panel 70a may be of any of a variety of touch panel types, including resistive film type, capacitive type, surface acoustic wave type, infrared type, electromagnetic induction type, image recognition type, and optical sensor type. Depending on the type, there are types that detect a touch by contact with the touch panel, and types that detect a touch by the approach of a finger or pen to the touch panel, but either type is acceptable.

[0049] Fig. 3 is a schematic diagram showing an example of the configuration of lens unit 300. Fig. 3 shows a state in which lens unit 300 is attached to digital camera 100. Note that, among the digital camera 100 shown in Fig. 3, the same components as those explained in Fig. 2 are given the same reference numerals, and explanations thereof will be omitted as appropriate.

[0050] Lens unit 300 is a type of interchangeable lens that can be attached to and detached from digital camera 100. Lens unit 300 is a twin lens that can capture optical images with parallax between left and right images. Lens unit 300 has two optical systems (photographing lenses), each with a wide viewing angle of 180 degrees, and can capture the range of the forward hemisphere. Specifically, the two optical systems of lens unit 300 can each input an optical image of a subject included in a field of view (angle of view) of 180 degrees in the left-right direction (horizontal angle, azimuth angle, yaw angle) and 180 degrees in the up-down direction (vertical angle, elevation angle, pitch angle).

[0051] The lens unit 300 includes a right-eye optical system 301R having a plurality of lenses and a reflecting mirror, a left-eye optical system 301L having a plurality of lenses and a reflecting mirror, and a lens system control circuit 303. The right-eye optical system 301R corresponds to an example of a first optical system, and the left-eye optical system 301L corresponds to an example of a second optical system. The right-eye optical system 301R and the left-eye optical system 301L each have lenses 302R and 302L located on the subject side, facing the same direction, and their optical axes are parallel. Each optical system is a so-called fisheye lens, and a circular optical image is formed on the imaging unit 22 (sensor). The optical image (left image) input via the left-eye optical system 301L and the optical image (right image) input via the right-eye optical system 301R are formed on the imaging surface of one imaging unit 22, and the imaging unit 22 acquires an image including each optical image.

[0052] The lens unit 300 of this embodiment is a VR180 lens (twin lens) for capturing images for so-called VR180, a VR image format that enables twin-eye stereoscopic viewing. The VR180 lens has fisheye lenses that enable the right-eye optical system 301R and the left-eye optical system 301L to each capture a 180-degree range. Note that the VR180 lens may be a lens that can capture a wide viewing angle range of approximately 160 degrees, which is narrower than the 180-degree range, as long as the right-eye optical system 301R and the left-eye optical system 301L can each acquire images that enable twin-eye VR display as VR180. The VR180 lens can form a right image (first image) formed via the right-eye optical system 301R and a left image (second image) formed via the left-eye optical system 301L, which has parallax from the right image, on one or two image pickup elements of the attached camera. In the digital camera 100 according to this embodiment, a right image and a left image are formed on a single image sensor (sensor), and a single image (two-eye image) is generated in which an image corresponding to the right image and an image corresponding to the left image are arranged side by side. The two-eye image at this time includes an image corresponding to the right image and an image corresponding to the left image, as well as an area where no optical image is formed (blacked-out portion).

[0053] Furthermore, the lens unit 300 is attached to the digital camera 100 via the lens mount section 304 and the camera mount section 305 of the digital camera 100. This electrically connects the system control section 50 of the digital camera 100 and the lens system control circuit 303 of the lens unit 300 via the communication terminal 10 of the digital camera 100 and the communication terminal 306 of the lens unit 300.

[0054] In this embodiment, a right image formed via the right-eye optical system 301R and a left image formed via the left-eye optical system 301L, which has parallax from the right image, are formed side by side on the imaging unit 22 of the digital camera 100. That is, two optical images formed by the right-eye optical system 301R and the left-eye optical system 301L are formed on a single imaging element. The imaging unit 22 converts the formed subject image (optical signal) into an analog electrical signal to acquire image data of the two-eye image. In this way, by using the lens unit 300, two images with parallax can be simultaneously acquired (as a set) from two locations (optical systems), the right-eye optical system 301R and the left-eye optical system 301L. Furthermore, by dividing the acquired images into an image for the left eye and an image for the right eye and displaying them in VR, the user can view a stereoscopic VR image with a 180-degree range, known as VR180.

[0055] Conventionally, with a normal single lens, an image incident on the lens is inverted point-symmetrically around the center of the optical axis and input to a sensor. An imaging device such as digital camera 100 generates natural (non-inverted) images by adjusting the sensor reading order and inverting the read images. On the other hand, with a twin lens, the image is inverted point-symmetrically up and down and input to the sensor, but the image acquired through the left-eye optical system is not inverted left and right and input to the sensor on the left side and the image acquired through the right-eye optical system on the right side. Therefore, if inversion processing is performed as in the past, the left and right sides of the image after inversion processing will be reversed from the left and right sides of the digital camera 100, i.e., the image acquired through the left-eye optical system will be displayed on the right side and the image acquired through the right-eye optical system will be displayed on the left side.

[0056] Here, a VR image is an image that can be displayed in VR, as described below. VR images include omnidirectional images (spherical images) captured by an omnidirectional camera (spherical camera) and panoramic images with a wider image range (effective image range) than can be displayed on a display unit at one time. VR images are not limited to still images, but also include videos and live images (images acquired from a camera in almost real time). VR images have an image range (effective image range) of up to 360 degrees horizontally and vertically. VR images also include images with a wider angle of view than can be captured by a normal camera, or an image range wider than can be displayed on a display unit at one time, even if the field of view is less than 360 degrees horizontally or vertically. Images captured by the digital camera 100 using the lens unit 300 described above are a type of VR image. VR images can be displayed in VR by, for example, setting the display mode of a display unit (a display unit capable of displaying VR images) to "VR view." By displaying a VR image with a 360-degree angle of view in VR and changing the position of the display device left and right (horizontal rotation direction), the user can enjoy seamless, omnidirectional images left and right.

[0057] Here, VR display (VR view) is a display method (display mode) that displays VR images with a field of view that corresponds to the orientation of the display device, and allows for a change in the display range. VR display includes "single-eye VR display (single-eye VR view)," which displays a single image by mapping a VR image onto a virtual sphere (deformation that corrects distortion). VR display also includes "two-eye VR display (two-eye VR view)," which displays a VR image for the left eye and a VR image for the right eye side by side in left and right regions by mapping each onto a virtual sphere. Stereoscopic viewing is possible by performing "two-eye VR display" using a VR image for the left eye and a VR image for the right eye that have parallax from each other.

[0058] Regardless of the VR display, when a user wears a display device such as an HMD (head-mounted display), an image with a field of view that corresponds to the orientation of the user's face is displayed. For example, suppose a VR image is displayed with a field of view centered at 0 degrees left and right (a specific direction, e.g., north) and 90 degrees up and down (90 degrees from the zenith, i.e., horizontal) at a certain point in time. If the orientation of the display device is flipped from this state (e.g., the display surface is changed from facing south to facing north), the display range changes to an image with a field of view centered at 180 degrees left and right (the opposite direction, e.g., south) and 90 degrees up and down. In other words, when a user wears an HMD and turns their face from north to south (i.e., facing backwards), the image displayed on the HMD also changes from a north image to a south image.

[0059] The VR image captured using the lens unit 300 of this embodiment is a VR180 image capturing a range of 180 degrees forward, and does not contain any image in a range of 180 degrees backward. If such a VR180 image is displayed in VR and the position of the display device is changed to the side where no image exists, a blank area will be displayed.

[0060] By displaying VR images in this way, the user visually feels as if they are inside the VR image (in the VR space). Note that the method of displaying VR images is not limited to changing the posture of the display device. For example, the display range may be moved (scrolled) in response to user operation via a touch panel or directional buttons. Furthermore, during VR display (display mode "VR view"), in addition to changing the display range due to posture changes, the display range may also be changed in response to touch-move on the touch panel, dragging with a mouse, pressing directional buttons, etc. Note that a smartphone attached to VR goggles (head-mounted adapter) is a type of HMD.

[0061] In digital camera 100 configured as described above, the twin-eye image captured through lens unit 300 is an image including a right image and a left image input to imaging unit 22 through a right-eye optical system and a left-eye optical system. A user of digital camera 100 may enlarge and display a portion of an image to check the details of a live view image or a recorded image. When enlarging an image, the center position of the range to be enlarged may be uniquely set to the center position of the entire image.

[0062] When enlarging a portion of a twin-eye image to confirm that portion, it is desirable to display only a portion of the right or left image. If the center position of the range of the enlarged image is uniquely set to the center of the entire image when enlarging, and the enlarged image includes both the right and left images, it will be difficult for the user to intuitively understand which part of the original image is displayed in the enlarged image. Specifically, the left edge of the right image will be aligned to the right side of the enlarged image, and the right edge of the left image will be aligned to the left side of the enlarged image, resulting in an enlarged image with a different left-right positional relationship to the field of view of the subject.

[0063] Therefore, in this embodiment, the processing of the digital camera 100 that performs live view magnification processing suitable for shooting with a twin lens such as the lens unit 300 will be described with reference to the flowchart of FIG.

[0064] Fig. 4 is a flowchart showing an example of processing in the shooting mode of the digital camera 100. The flowchart in Fig. 4 is implemented by the system control unit 50 by loading a program recorded in the nonvolatile memory 219 into the system memory 52 and executing it. The flowchart in Fig. 4 is started when the power of the digital camera 100 is turned on and the digital camera 100 is in a shooting standby state. When starting the control flowchart in Fig. 4, the system control unit 50 initializes control variables and the like and starts processing.

[0065] An example of a display on the display unit 28 when the control flowchart of Fig. 4 is executed will be described with reference to Fig. 5. Details of the display example shown in Fig. 5 will be explained after the explanation of the control flowchart of Fig. 4.

[0066] In S401, the system control unit 50 obtains the previously used display mode from the flag (N) stored in the nonvolatile memory 56, and displays a live view image and information related to shooting on the display unit 28 based on the previously used display mode. For example, if the flow is started by turning on the power, the previously used display mode is the display mode that was used when the power was previously turned off. Alternatively, if the flow is started by switching to shooting mode from a mode other than shooting mode, such as playback mode, it is the display mode that was used when processing was last performed in shooting mode.

[0067] In S402, the system control unit 50 determines whether or not the display mode switching button 83 has been pressed. If it has been pressed, the process proceeds to S403, and if not, the process proceeds to S410.

[0068] In S403, the system control unit 50 refers to the system memory 52 and determines whether the flag N indicating the display mode is 5 (N=5). If N=5, the process proceeds to S404; otherwise, the process proceeds to S405.

[0069] In S404, the system control unit 50 determines via the communication terminals 6 and 10 whether the attached lens is a twin lens (i.e., a two-lens system). If it is a twin lens, the process proceeds to S406; if not (i.e., a normal single lens system or no lens is attached), the process proceeds to S408. A twin lens system has a left and a right lens, and each lens is a wide-angle fisheye lens capable of capturing at least a 180-degree range on the side on which the lens is located, i.e., the range on the subject side. Data of the left and right images captured through the left-eye optical system 301L and right-eye optical system 301R can be captured by one or two image sensors.

[0070] In S405, since the determination in S403 is No, the system control unit 50 increments the flag N indicating the display mode by 1 (N=N+1) and stores it in the system memory 52.

[0071] In S406, the system control unit 50 sets the flag N to 6 (N=6) and stores it in the system memory 52.

[0072] In S407, when N=6, the system control unit 50 displays a display mode dedicated to twin lenses on the display unit 28. An example of the display at this time is shown in Fig. 5(f). Fig. 5(f) will be described in detail later.

[0073] In S408, since the determination in S404 is No, the system control unit 50 sets the flag N to 1 (N=1) and stores it in the system memory 52.

[0074] In S409, the system control unit 50 displays a live view image and information in a display mode corresponding to the display unit 28, in accordance with the value of the flag N stored in the system memory 52. ​​Examples of displays corresponding to the display modes displayed on the display unit 28 are shown in Figures 5(a) to 5(e). This step is reached even if the determination in S404 is No, so the display is also displayed when no twin lenses are attached, that is, when a single lens is attached or no lenses are attached.

[0075] 5(a) to 5(f) will be used to explain the LV image and information display displayed on the display unit 28. In FIGS. 5(a) to 5(f), two LV images are displayed when a twin lens (twin lens) is attached to the digital camera 100. However, when a single lens is attached, one LV image is displayed, and the other displays are similar. When a single lens is attached, as described above with reference to FIG. 4, the display mode shown in FIG. 5(f) is not transitioned to. Each time the user performs a display mode switching operation (in this embodiment, pressing the display mode switching button 83), the information displayed on the display unit 28 is changed. Specifically, the displays shown in FIGS. 5(a) to 5(f) are performed according to the number of the flag N indicating the display mode described above with reference to FIG. 4. Note that, in this embodiment, the LV image displayed on the display unit 28 is a circular fisheye display; however, this is not limiting and the LV image in the circular fisheye display may be converted to an equirectangular display by performing equirectangular conversion processing.

[0076] FIG. 5(a) shows the display mode when flag N=1, that is, when the digital camera 100 is powered on and an LV image is displayed on the display unit 28 in a shooting standby state. Two LV images (LV500R, LV500L) are displayed side by side, and information displays 501a to 501c are also displayed on the display unit 28. The two LV images arranged side by side in this case are called side-by-side images. Information displays 501a to 501c show shooting information and are the minimum information display assumed to be essential for the user when shooting. Pressing the display mode switching button 83 in the state shown in FIG. 5(a) causes a transition to FIG. 5(b).

[0077] FIG. 5(b) shows the display mode when flag N=2. In FIG. 5(b), in addition to LV 500R, LV 500L, and information displays 501a to 501c, information displays 502a and 502b are displayed. Like information displays 501a to 501c, information displays 502a and 502b display shooting information and display various information related to shooting (for example, currently set settings and the type of inserted recording medium 200). Because the amount of information is greater than that of information displays 501a to 501c, the user can view more shooting information. However, the visibility of the LV image may be reduced. Pressing the display mode switching button 83 in the state shown in FIG. 5(b) causes a transition to FIG. 5(c).

[0078] FIG. 5(c) shows the display mode when flag N=3. In FIG. 5(c), in addition to the LV 500R, LV 500L, and information displays 501a-501c, 502a, and 502b, information display 503, which is a histogram of the LV image currently being captured, is displayed. Information display 503 is a graph with brightness on the horizontal axis and pixel count on the vertical axis, and serves as a guide for checking the brightness of the LV image currently being captured, the exposure level trend, and the overall gradation of the LV image. Some users may want to check information display 503 during capture, so it is displayed. However, because it is superimposed on a relatively large area of ​​the LV image, visibility is reduced. Pressing the display mode switch button 83 in the state shown in FIG. 5(c) transitions to FIG. 5(d).

[0079] FIG. 5(d) shows the display mode when flag N=4. In the display mode of FIG. 5(d), all of the information displays 501a-501c, 502a, 502b, and 503 are hidden, and only the LV500R and LV500L are displayed. This display allows the user to shoot while viewing only the LV image, without feeling overwhelmed by various shooting information. Pressing the display mode switching button 83 in the state shown in FIG. 5(d) transitions to FIG. 5(e).

[0080] Fig. 5(e) shows the display mode when flag N=5. In the display mode of Fig. 5(e), the LV image is not displayed, and only information about shooting is displayed in a table-like format. When the display mode switching button 83 is pressed in the state shown in Fig. 5(e), if a twin lens is attached, the display transitions to Fig. 5(f), and if a single lens is attached or no lens is attached, the display transitions to Fig. 5(a).

[0081] FIG. 5(f) shows the display mode when flag N=6 (S407 in FIG. 4). In other words, this is a display mode that transitions to only when a twin lens is attached to the digital camera 100. At this time, the display unit 28 displays LV500R, LV500L, information displays 505 and 506, and an enlargement frame 511, focus guide 512, and magic window 513 superimposed on the LV image. The information display 505 indicates that the LV500R is an LV image (right image) captured by the right-eye optical system 301R, and displays "R" meaning right. The information display 506 indicates that the LV500L is an LV image (left image) captured by the left-eye optical system 301L, and displays "L" meaning left.

[0082] In the case of an optical system such as that shown in digital camera 100, an image captured by the image sensor (imaging unit 22) is captured upside down. This upside-down image is then flipped 180 degrees and displayed on display unit 28 or EVF 29. In light of this structure, consider photographing using a lens having two optical systems (twin lens) as shown in FIG. 3. As mentioned above, if two LV images captured by the left and right optical systems and input to imaging unit 22 are displayed on display unit 28 without undergoing flipping processing, the LV images will be displayed upside down, which is inconvenient for the user. For this reason, flipping processing is performed on the two LV images input to imaging unit 22, just as in the case of a single lens.

[0083] However, even if the inversion process is performed, the two LV images displayed on the display unit 28 have the LV image (right image) acquired via the right-eye optical system 301R displayed in the left region, and the LV image (left image) acquired via the left-eye optical system 301L displayed in the right region. In particular, in this embodiment, since imaging is performed using one imaging element (imaging unit 22), the process of identifying the boundary between the two LV images on the single imaging element and swapping the left and right LV images places a heavy processing load on the system control unit 50. Therefore, the LV image input to the imaging unit 22 is flipped 180 degrees up and down and displayed on the display unit 28 without swapping the left and right images.

[0084] When two LV images are displayed on the display unit 28, the user generally assumes that the LV image displayed in the left area was captured by the left-eye optical system 301L, and that the LV image displayed in the right area was captured by the right-eye optical system 301R. In other words, without the display of information displays 505 and 506, the user is unlikely to understand that the left and right LV images are mirror-inverted, and if the user is not aware that the images are mirror-inverted at the time of capture, this can lead to confusion. For this reason, by displaying information displays 505 and 506, the user can clearly visually determine which optical system, left or right, each LV image was captured by.

[0085] The enlargement frame 511 superimposed on the LV image is a frame display that indicates the area of ​​the LV image that will be enlarged when the user issues an enlargement command (described later in S801 of FIG. 8). The focus guide 512 is a frame that indicates the focus detection area and an indicator that displays, using information such as an index and color, the degree of focus on the subject at the position where the focus detection area is superimposed. In this embodiment, the degree of focus is expressed using three indexes displayed above or below the focus detection area. The focus guide 512 in FIG. 5(f) indicates that the subject at the position where the focus detection area is displayed is out of focus and is in back focus (the subject is not in focus because the focus is behind the subject). Furthermore, when the focus guide is not in focus, it is displayed in white. When these three indexes become two, it indicates that the subject is in focus, and the focus guide is displayed in green.

[0086] Magic window 513 is an indicator displayed on display unit 28 that indicates the range that is initially displayed before the user moves the viewpoint. This indicates the range that is initially displayed before the user moves the viewpoint when a single 180-degree image (semi-spherical image) is generated from LV500R and LV500L and played back on a browser or head-mounted display (HMD). By displaying magic window 513 on the LV image, the range that is initially displayed during playback, i.e., the range that the viewer sees first, can be visually confirmed during shooting, allowing the user to more effectively capture the composition and subject that they desire.

[0087] The magic window 513 is an indicator that is only needed when a 180-degree image is created, and is a specific indicator that is expected to be particularly necessary for users when shooting with a twin lens attached. For this reason, the display mode shown in Figure 5(f) is not displayed when a single lens is attached. Also, because the display position of the magic window 513 is fixed, as long as the user can confirm the range of the magic window 513, it is not necessarily necessary for it to be displayed at all times during subsequent shooting.

[0088] In this embodiment, the enlargement frame 511 and focus guide 512 are superimposed on only one of the two LV images, and the magic window 513 is superimposed on both of the two LV images. Since the enlargement frame 511 indicates the position to be enlarged, it is optimal to display only one, but the focus guide 512 may be displayed on both of the two LV images instead of just one.

[0089] Next, processing when a touchdown operation is performed on the touch panel 70a will be described. In response to a touchdown on the touch panel 70a while an image is being displayed, the system control unit 50 of the digital camera 100 displays items related to focus control and items indicating the magnification range within the image. If the lens unit connected to the digital camera 100 is not a twin lens (a conventional single lens), the system control unit 50 displays a focus guide indicating the degree of focus or an AF frame indicating the target area for autofocus at a position corresponding to the touchdown. Furthermore, if the lens unit connected to the digital camera 100 is a twin lens, the system control unit 50 positions the focus guide indicating the degree of focus at the center of either the area displaying the left image or the area displaying the right image in response to the touchdown (centering). Furthermore, the system control unit 50 displays an enlargement frame indicating the magnification range at a position corresponding to the touchdown. If the lens unit connected to the digital camera 100 is a twin lens, the system control unit 50 displays the enlargement frame so that it does not include both the left and right images.

[0090] In S410, the system control unit 50 determines whether or not a touch-down operation has been performed on the touch panel 70a. If a touch-down operation has been performed, the system control unit 50 stores the coordinates (xt, xy) indicating the touch-down position (touch position) and proceeds to S411; if not, the system control unit 50 proceeds to S601 in FIG. 6.

[0091] In S411, similar to S404, the system control unit 50 determines whether or not the attached lens is a twin lens via the communication terminals 6 and 10. If it is a twin lens, the process proceeds to S412, and if not, the process proceeds to S421.

[0092] In S412, the system control unit 50 determines whether the touch position (dutch-down position) of the touch-down operation performed on the touch panel 70a in S410 is within the right region (region 701R) of the twin-lens image. FIG. 7 is a schematic diagram showing an example display in which a twin-lens image is displayed. If the touch position is within the right region (region 701R), the process proceeds to S413, and if the touch position is within the left region (region 701L), the process proceeds to S417. Line 705 is the line that forms the exact boundary between the live view images (LV700R and LV700L) captured by the left and right optical systems. In this embodiment, line 705 is the center line when the imaging unit 22 is divided into two halves, left and right.

[0093] In S413, the system control unit 50 displays the focus guide in the center of the right area (returning the display position to the center). If a focus guide is already displayed superimposed on the LV image in either the left or right area of ​​the LV image, the display is moved to the center of the right area (the center of the LV image captured by the left-eye optical system 301L shown in the right area). An example of this display is shown in guide 512 in FIG. 5(f). The focus guide is composed of a frame indicating the focus detection area and multiple indices that indicate the degree of focus in the focus detection area based on the relative display positions of the indices. The relative display positions of the indices allow the user to visually determine whether the focus detection area is in focus, to what extent it is out of focus, and, if out of focus, whether it is in front of or behind the subject in the focus detection area. Note that the focus guide is not limited to this display format, and the degree of focus may be indicated by, for example, color, etc.

[0094] In S414, the system control unit 50 determines whether the touch position of the touch-down operation on the touch panel 70a performed in S410 is near a boundary. Specifically, the system control unit 50 determines whether the touch position is in the area between the line 705 in FIG. 7 and a line a predetermined distance to the right of the line 705. If so, the process proceeds to S415; if not, the process proceeds to S416. Here, the predetermined distance is assumed to be half the horizontal length of the enlargement frame. Note that the predetermined distance can be set arbitrarily. The position on the touch panel 70a is represented in an xy coordinate system. Here, the x coordinate of the line a predetermined distance to the right of the line 705 is assumed to be Rmin. In other words, when the x component of the center coordinate of the enlargement frame is Rmin, the left side of the enlargement frame is in contact with (overlaps with) the line 705. If the x component of the center coordinate of the enlargement frame is smaller than Rmin, the enlargement frame may straddle the left and right regions.

[0095] In S415, the system control unit 50 displays the enlargement frame so that its center is aligned with the coordinates (Rmin, yt). By performing such control, even if the user performs a touch operation near the line 705, the enlargement frame is displayed so that it includes only the right region without crossing the line 705.

[0096] In S416, the system control unit 50 displays the enlargement frame so that the center of the enlargement frame coincides with the coordinates (xt, yt) of the touch position.

[0097] In S417, since the determination in S412 is No, the system control unit 50 displays the focus guide in the center of the left area (the center of the LV image captured by the right-eye optical system 301R shown in the left area). At this time, if the focus guide is already displayed superimposed on the LV image, the display is moved to the center of the left area.

[0098] In S418, the system control unit 50 determines whether the touch position of the touchdown operation performed on the touch panel 70a in S410 is in the area between the line 705 in FIG. 7 and a line a predetermined distance to the left of the line 705. If so, the process proceeds to S419; if not, the process proceeds to S420. As described in S414, the predetermined distance is half the horizontal length of the enlargement frame. The predetermined distance may be set arbitrarily by the user. Here, the x-coordinate of the line a predetermined distance to the left of the line 705 is defined as Lmax. In other words, when the x-component of the center coordinate of the enlargement frame is Lmax, the right side of the enlargement frame is in contact with (overlaps with) the line 704. If the x-component of the center coordinate of the enlargement frame is greater than Lmax, the enlargement frame may straddle the left and right regions.

[0099] In S419, the system control unit 50 displays the enlargement frame so that the center of the enlargement frame is aligned with the coordinates (Lmax, yt).

[0100] In S420, the system control unit 50 displays the enlargement frame so that the center of the enlargement frame coincides with the coordinates (xt, yt) of the touch position.

[0101] By controlling in this manner, the enlargement frame will not be displayed across both the left and right regions, even if the user uses a touch operation to specify the position of the enlargement frame in an area including the vicinity of line 705. If the enlargement frame were displayed across both the left and right regions, as will be described later, when the user performs an enlargement operation (presses enlarge button 78), the boundary between the left and right LV images would be enlarged, which could confuse the user. For this reason, the enlargement frame is prevented from being displayed across both the left and right regions.

[0102] Next, the control that is executed in response to touchdown when the lens attached to the digital camera 100 is not a twin lens (a single lens) will be described.

[0103] In S421, the system control unit 50 refers to the nonvolatile memory 56 and determines whether the focus mode setting is autofocus mode (AF mode) or manual focus mode (MF mode). If it is MF mode, the process proceeds to S422, and if it is AF mode, the process proceeds to S423. If the focus guide display setting is ON in MF mode, the focus guide is displayed to assist in focusing during MF operation.

[0104] In S422, the system control unit 50 moves the focus guide display to the touch position designated by the user in S410.

[0105] In S423, the system control unit 50 displays an AF frame (autofocus frame) indicating the in-focus position at the touch position designated by the user in S410.

[0106] In S424, the system control unit 50 displays an enlargement frame at the touch position made in S410.

[0107] That is, if the lens attached to digital camera 100 is not a twin lens (it is a single lens), the magnification frame and focus guide will be displayed at the position touched by the user regardless of the focus mode setting. Also, the magnification frame is displayed in conjunction with the focus detection area of ​​the AF frame and focus guide. On the other hand, if a twin lens is attached, the display position of the magnification frame is not linked to the focus detection area of ​​the focus guide.

[0108] In this embodiment, when a twin lens is attached, the display position of the focus guide is fixed to the center of the display area of ​​the left and right LV images. Therefore, if the display position of the focus guide and the display position of the magnification frame were linked, only the center of the LV image could be enlarged, which would be inconvenient for the user. Furthermore, with a twin lens, two LV images are displayed on the display unit 28, and each LV image is less than half the size of an LV image when a single lens is attached. Therefore, there is a high possibility that the user will enlarge the LV image more times than when a single lens is attached to check it in more detail. Therefore, the magnification frame (i.e., the magnification range of the LV image) is not linked to the focus guide so that the user can freely check the desired position.

[0109] Even if the focus guide is not fixed to the center, when a twin lens is attached, the focus guide and magnification frame are not linked. Users use the focus guide to make more precise focus adjustments, but there may be times when they want to zoom in on a position other than the desired focus position to check it in more detail. For example, if they want to zoom in and check within the range of the magic window described below, or an area close to the circumference of the LV image in circular fisheye display, it is easier for the user to operate if the positions of the focus guide and magnification frame are not linked.

[0110] FIG. 6 is a control flowchart of the display control of the digital camera 100 when an operation is performed on an operation member capable of indicating a direction according to this embodiment.

[0111] The system control unit 50 of the digital camera 100 moves the position of an item in the image (specifies the position of the item) in response to a direction instruction received while displaying a twin-lens image and an item such as a magnification frame. If the lens unit connected to the digital camera 100 is not a twin-lens unit (a conventional single-lens unit), the system control unit 50 moves the focus guide or AF frame and the magnification frame in response to the direction instruction.

[0112] Furthermore, if the lens unit connected to the digital camera 100 is a twin-lens unit, the system control unit 50 moves the enlargement frame in response to the direction instruction. However, the focus guide is not moved. Furthermore, when the system control unit 50 receives an instruction to the left while the enlargement frame is displayed in the right region of the display unit and is near the boundary, the system control unit 50 moves the display position of the enlargement frame to the left region so that the enlargement frame does not include both the left and right images. When the system control unit 50 receives an instruction to the right while the enlargement frame is displayed in the left region of the display unit and is near the boundary, the system control unit 50 moves the display position of the enlargement frame to the right region so that the enlargement frame does not include both the left and right images.

[0113] In S601, the system control unit 50 determines whether a direction has been specified using the multi-controller (MC) 82 or the cross key 74 of the operation unit 70. If a direction has been specified, the process proceeds to S602; otherwise, the process proceeds to S617.

[0114] In S602, similar to S411, the system control unit 50 acquires the type of attached lens via the communication terminals 6 and 10 and determines whether it is a twin lens. If it is a twin lens, the process proceeds to S607; if not, the process proceeds to S603.

[0115] In S603, as in S421, the system control unit 50 determines whether the current focus mode of the camera is AF mode or MF mode. If it is AF mode, proceed to S604, and if it is MF mode, proceed to S605. Note that in MF mode, if the display setting for the focus guide to assist in MF focusing is ON, the focus guide is displayed on one of the LV images displayed on the display unit 28. If a touch-down operation has not been performed on the touch panel 70a as described above in S410, the focus guide is displayed superimposed on the LV image in the right region.

[0116] In S604, the system control unit 50 moves the AF frame displayed on the display unit 28 in the direction instructed in S601.

[0117] In S605, the system control unit 50 moves the focus guide displayed on the display unit 28 in the direction instructed in S601. If the focus guide display setting is turned off by the user, this step is skipped. At this time, the entire focus guide is moved, but it is also possible to move only the focus detection area instead of the entire focus guide.

[0118] In S606, the system control unit 50 moves the enlargement frame displayed on the display unit 28 in conjunction with the position of the AF frame or the frame indicating the focus detection area of ​​the focus guide that was moved in S604 or S605.

[0119] In S607, the system control unit 50 determines whether the direction instruction determined in S601 by the MC 82 or the cross key 74 is a rightward direction instruction. If it is rightward, the process proceeds to S608, and if not, the process proceeds to S611.

[0120] In S608, the system control unit 50 determines whether the position coordinate of the center of the enlargement frame before the instruction was given in S601 is Lmax. If the center coordinate is Lmax, the process proceeds to S609; otherwise, the process proceeds to S610. If the position coordinate of the center of the enlargement frame before the direction instruction was given is Lmax, the right side of the enlargement frame is in contact with the line 705 before the direction instruction was input.

[0121] In S609, the system control unit 50 moves the enlargement frame so that its center is at coordinate (Rmin, y coordinate before the direction is specified). That is, when the enlargement frame is displayed in the left region so that its right side is in contact with line 705, and an instruction to move the enlargement frame further to the right is input, the enlargement frame moves to the right region. By performing control in this manner, the enlargement frame is not displayed across the left and right regions.

[0122] In this step, since S602 returns Yes, it is determined that a twin lens is attached to the digital camera 100. Therefore, there are two LV images displayed on the display unit 28, and each of them divides the display unit 28 into left and right halves. In other words, if the display position of the enlargement frame is moved so that it straddles the line 705 in FIG. 7, i.e., so as to include both the left and right areas, when the user issues an enlargement instruction, an enlarged image including both the left and right LV images is displayed, which may confuse the user. Therefore, when the enlargement frame is moved, it is so designed that it does not straddle the line 705 (does not include both the left and right areas), and when the left or right side of the enlargement frame reaches the boundary between the left and right areas indicated by the line 705, the entire enlargement frame is displayed in only one of the left or right areas.

[0123] In S610, the system control unit 50 moves the display position of the enlargement frame to the right. At this time, the amount of movement of the display position in response to one direction instruction is assumed to be one pixel of the display unit 28. Note that when the right side of the enlargement frame reaches the right side of the area 701R (the right edge of the display unit 28), the enlargement frame does not move even if an instruction to move it to the right is given.

[0124] In S611, the system control unit 50 determines whether the direction indicated by the MC 82 or the cross key 74 determined in S601 is leftward. If it is leftward, the process proceeds to S612; otherwise, the process proceeds to S615.

[0125] In S612, the system control unit 50 determines whether the center position of the enlargement frame before the instruction was given in S601 is Rmin. If the center coordinate is Rmin, the process proceeds to S613; otherwise, the process proceeds to S614. If the center position coordinate of the enlargement frame before the direction instruction was given is Rmin, the left side of the enlargement frame is in contact with line 705 before the direction instruction was input.

[0126] In S613, the system control unit 50 moves the enlargement frame so that its center is at coordinate (Lmax, y coordinate before the direction is specified). That is, when the enlargement frame is displayed in the right region so that its left side is in contact with the line 705, and an instruction to move the enlargement frame further to the left is input, the enlargement frame moves to the left region. By performing control in this manner, the enlargement frame is not displayed across the left and right regions.

[0127] In S614, the system control unit 50 moves the display position of the enlargement frame to the left. At this time, the amount of movement of the display position in response to one direction instruction is assumed to be one pixel of the display unit 28. Note that when the left side of the enlargement frame reaches the left side of the area 701L (the left edge of the display unit 28), the enlargement frame does not move even if an instruction to move it to the left is given.

[0128] In S615, the system control unit 50 determines whether the direction indicated by the MC 82 or the cross key 74 determined in S601 is up or down. If it is up or down, the process proceeds to S616; if not, the process proceeds to S617.

[0129] In S616, the system control unit 50 moves the display position of the enlargement frame in the instructed vertical direction. At this time, the amount of movement of the display position in response to one direction instruction is assumed to be one pixel of the display unit 28.

[0130] If the system control unit 50 determines in S602 that a twin lens is attached to the digital camera 100, then in response to a movement instruction (directional instruction), only the enlargement frame moves, and the focus guide does not move from the position already displayed. That is, in S609, S610, S613, S614, and S616, only the enlargement frame moves in response to the directional instruction, and the focus guide does not move (it is fixed at the center of the LV image in the displayed area).

[0131] The above is the flow of movement control of items such as the enlargement frame and focus guide when a direction instruction is input using the MC 82 or the cross key 74 or the like.

[0132] Next, a description will be given of control when an operation is performed to return the display positions of items such as the enlargement frame and focus guide to their predetermined positions. The system control unit 50 displays items such as the enlargement frame and focus guide at predetermined positions in response to receiving a predetermined operation (such as pressing the MC 82 or the SET button 75). When a twin-eye image is being displayed, the system control unit 50 displays the item in the center of either the right area or the left area in which the item was displayed before receiving the predetermined operation in response to receiving the predetermined operation. On the other hand, when a twin-eye image is not being displayed, the system control unit 50 displays the item in the center of the screen in response to receiving the predetermined operation. This makes it possible to suitably control the display position of the item depending on whether the displayed image is a twin-eye image or not.

[0133] In S617, the system control unit 50 determines whether the center of the MC 82 has been pressed (not the up / down / left / right movement operation) or the SET button 75 has been pressed. If the MC 82 has been pressed or depressed, the process proceeds to SS618; if not, the process proceeds to S801 in Fig. 8. Pressing the MC 82 or pressing the SET button 75 in this step can be considered a center movement instruction to move the currently displayed enlargement frame to the center of the LV image of the displayed area (return to center).

[0134] In S618, similarly to S411, the system control unit 50 acquires the type of attached lens via the communication terminals 6 and 10 and determines whether it is a twin lens. If it is a twin lens, the process proceeds to S623; if not, the process proceeds to S619.

[0135] In S619, similar to S421, the system control unit 50 determines whether the current focus mode of the camera is AF mode or MF mode. If it is AF mode, the process proceeds to S620, and if it is MF mode, the process proceeds to S621.

[0136] In S620, the system control unit 50 moves the AF frame to the center of the LV image displayed on the display unit .

[0137] In S621, the system control unit 50 moves the focus guide frame to the center of the LV image displayed on the display unit .

[0138] In S622, the system control unit 50 moves the enlargement frame to the center of the LV image displayed on the display unit 28 in conjunction with the position of the AF frame or the focus detection area of ​​the focus guide.

[0139] In S623, the system control unit 50 determines whether or not the enlargement frame is displayed in the LV image in the right region. That is, it determines whether or not the enlargement frame is displayed in region 701R in Fig. 7. If so, the process proceeds to S625; if not, the process proceeds to S624.

[0140] In S624, since the determination in S623 is No, the system control unit 50 moves the display position of the enlargement frame to the center of the LV image displayed in the left area, that is, to the center of the LV image displayed in area 701L in FIG.

[0141] In S625, since the determination in S623 is Yes, the system control unit 50 moves the display position of the enlargement frame to the center of the LV image displayed in the right region, that is, to the center of the LV image displayed in region 701R in FIG.

[0142] The above is the flow showing the control when an operation is executed to return the display positions of items such as the enlargement frame and focus guide to their predetermined positions.

[0143] Next, the enlargement process and the process of changing the enlargement ratio that are executed when the enlargement button 78 is pressed will be described.

[0144] Fig. 8 is a control flowchart relating to the enlargement operation and shooting operation of the LV image displayed on the display unit 28 according to this embodiment. A display example of the display unit 28 when the control flowchart of Fig. 8 is executed will be described with reference to Fig. 9. Details of the display example shown in Fig. 9 will be explained after the explanation of the control flowchart of Fig. 8.

[0145] In S801, the system control unit 50 determines whether the enlarge button 78 has been pressed. If it has been pressed, the process proceeds to S802; if not, the process proceeds to S819. In this embodiment, the enlargement instruction is given by pressing the enlargement button 78, which is a depressible physical member, but it is also possible to give an enlargement instruction by pinching in on the touch panel 70a, and cancel the enlarged display by pinching out.

[0146] In S802, similarly to S411, the system control unit 50 acquires the type of attached lens via the communication terminals 6 and 10 and determines whether it is a twin lens. If it is a twin lens, the process proceeds to S803; if not, the process proceeds to S812.

[0147] In S803, the system control unit 50 enlarges the LV image at the position where the enlargement frame is displayed by six times and displays it on the display unit 28. The size of the enlargement frame displayed before the enlargement process is executed is set in advance so that when the enlargement process is executed at a six-times enlargement rate, the entire enlarged image is displayed on the display unit 28. The six-times enlargement rate in this case is based on the state in which the LV image displayed on the display unit 28 is not enlarged (at the same size). Display examples at this time are shown in FIGS. 9(c) and (d).

[0148] In S804, the system control unit 50 determines whether or not an operation to move the enlargement position (enlarged area) has been performed. If an operation to move the enlargement position has been performed, the process proceeds to S805; if not, the process proceeds to S806. The operation to move the enlargement position is assumed to be a directional instruction using the MC 82 or the direction keys of the cross key 74, as described using the control flowchart of FIG. 6. Note that the operation can also be performed by operating the touch panel 70a.

[0149] In S805, based on the operation for moving the enlargement position in S804, the system control unit 50 moves the enlargement position only within the currently enlarged area, either to the left or right of the display area of ​​the two LV images displayed on the display unit 28. In other words, even if the area to be enlarged is in contact with the line 705 in either the left or right area and a movement operation is performed to move the center of the enlargement position closer to the line 705, the movement operation is invalidated and the enlargement position is not moved.

[0150] As shown in S607 to S614, when the enlargement frame is moved while the LV image is at full size, the user can visually recognize the enlargement frame displayed on the display unit 28, so the user will not lose track of the enlargement frame even if it can be moved from one area where the enlargement frame is displayed to another area. In contrast, if the enlarged position moves across areas when an enlarged image is displayed, it is difficult for the user to intuitively understand which position the enlarged image is displaying.

[0151] Assume that a user wishes to check the left end of the LV image in the right area in more detail (where the left side of the enlargement position is in contact with line 705). If the user unintentionally moves the enlargement frame while enlarging and checking the left end area of ​​the LV image in the right area, causing the enlarged area to become the LV image at the right end of the LV image in the left area, this may confuse the user. Therefore, when an enlarged image is displayed and the user instructs to move the enlargement position, if the enlargement position is at the end of each LV image, the enlargement position is prevented from moving beyond the left or right area.

[0152] In S806, the system control unit 50 determines whether a left / right switching operation has been performed. If a left / right switching operation has been performed, the process proceeds to S807; if not, the process proceeds to S808. A left / right switching operation refers to an operation of switching from one image to the other of two images arranged side by side. Specifically, a left / right switching operation refers to pressing a button having a left / right switching function (for example, an INFO button (not shown)).

[0153] In S807, the system control unit 50 moves the enlargement position from the area where the enlargement position was set before the left-right switching button was pressed to the other area, and performs enlarged display. At this time, the system control unit 50 moves the enlargement position so that the relative position of the enlargement position in the area where the enlargement position was set before the left-right switching button was pressed is maintained even after moving to the other area. For example, when the LV image of the right area is enlarged, the system control unit 50 calculates the distance from the center of the LV image of the right area to the enlargement position. In response to the user's left-right switching operation, the system control unit 50 applies the calculated distance from the center of the LV image to the enlargement position to the distance from the center of the LV image of the opposite area (here, the left area) and displays it on the display unit 28 as the enlargement position. By using this type of control, if a user wants to check the same position on both the left and right LV images displayed, they can easily switch between the left and right LV images with fewer steps, and it does not take time to shoot.

[0154] In S808, the system control unit 50 determines whether or not the enlargement button 78 has been pressed. If it has been pressed, the process proceeds to S809, and if not, the process returns to S804.

[0155] In S809, the system control unit 50 refers to the system memory 52 and determines whether the magnification of the LV image displayed on the display unit 28 is 15 times. If it is 15 times, the process proceeds to S810; if not, the process proceeds to S811.

[0156] In S810, the system control unit 50 cancels the enlarged state of the LV image and displays the non-enlarged (actual size) LV image on the display unit 28. Display examples at this time are shown in Figures 9(a) and 9(b).

[0157] In S811, the system control unit 50 enlarges and displays the LV image on the display unit 28 at a magnification of 15 times at the display position of the enlargement frame superimposed on the LV image. The magnification of 15 times in this case is based on the magnification of the LV image in a non-enlarged (actual size) state. Display examples are shown in Figures 9(e) and (f).

[0158] In S812, since the determination in S802 is No, the system control unit 50 enlarges and displays the LV image at a magnification of 6 times on the display unit 28 at the display position of the enlargement frame superimposed on the LV image. The magnification of 6 times in this case is a magnification ratio based on the LV image in a non-enlarged (actual size) state.

[0159] In S813, similarly to S804, the system control unit 50 determines whether or not an operation to move the enlargement position has been performed. If an operation to move the enlargement position has been performed, the process proceeds to S814; if not, the process proceeds to S815.

[0160] In S814, the system control unit 50 moves the enlargement position within the display area of ​​the LV image based on the operation to move the enlargement position. In this step, since the determination in S802 is No, it is determined that the lens attached to the digital camera 010 is a single lens or that no lens is attached. In other words, since only one LV image is displayed on the display unit 28, the enlargement position can be moved without considering the left and right areas as in S805.

[0161] In S815, similarly to S808, the system control unit 50 determines whether or not the enlargement button 78 has been pressed. If it has been pressed, the process proceeds to S816, and if not, the process returns to S813.

[0162] In S816, the system control unit 50 determines whether the current magnification ratio of the LV image is 15 by referring to the system memory 52. ​​If it is 15, the process proceeds to S817, and if not, the process proceeds to S818.

[0163] In S817, similarly to S810, the system control unit 50 cancels the enlarged state of the LV image and displays the non-enlarged (actual size) LV image on the display unit .

[0164] In S818, the system control unit 50 enlarges and displays the LV image at a magnification of 15 times on the display unit 28 at the display position of the enlargement frame superimposed on the LV image. The magnification of 15 times in this case is a magnification based on the LV image in a non-enlarged (actual size) state.

[0165] In S819, the system control unit 50 determines whether the first shutter switch 62 is on. If the first shutter switch 62 is on, the process proceeds to S820; if not, the process proceeds to S830. As described above, the first shutter switch 62 being on indicates that the shutter button 61 is half-pressed. In other words, it can be assumed that the user is about to take a picture.

[0166] In S820, similar to S411, the system control unit 50 acquires the type of attached lens via the communication terminals 6 and 10 and determines whether it is a twin lens. If it is a twin lens, the process proceeds to S823; if not, the process proceeds to S821.

[0167] In S821, the system control unit 50 determines whether the focus mode is set to AF mode. If it is set to AF mode, the process proceeds to S822, and if not (if it is set to MF mode), the process proceeds to S823. Switching between AF mode and MF mode can be done using a setting menu screen or a switch provided on the outside of the lens unit 150.

[0168] In S822, the system control unit 50 performs AF processing based on the AF frame position.

[0169] In S823, the system control unit 50 performs other photographing preparation processes such as AE and AWB.

[0170] In S824, the system control unit 50 determines whether or not the second shutter switch 64 is turned on. If the second shutter switch 64 is turned on, that is, if the shutter button 61 is fully pressed, the process proceeds to S825; otherwise, the process proceeds to S829.

[0171] In S825, similarly to S411, the system control unit 50 acquires the type of attached lens via the communication terminals 6 and 10 and determines whether it is a twin lens. If it is a twin lens, the process proceeds to S826; if not, the process proceeds to S827.

[0172] In S826, the system control unit 50 performs a series of image capturing processes up to recording the images captured by the twin lenses, twin lens information, and the like, as an image file on the recording medium 200.

[0173] In S827, the system control unit 50 performs a series of photographing processes up to recording the captured image and normal (single lens) lens information and the like on the recording medium 200 as an image file.

[0174] In S828, the system control unit 50 determines whether or not the first shutter switch 62 continues to be on. If the first shutter switch 62 continues to be on, the process returns to S824; otherwise, the process proceeds to S830.

[0175] In S829, the system control unit 50 determines whether any other operation other than those described above has been detected. If any other operation has been detected, the process proceeds to S830; otherwise, the process proceeds to S831. Specifically, the system control unit 50 determines whether the menu button 81, the play button 79, or the like has been pressed.

[0176] In S830, the system control unit 50 starts executing other processing corresponding to the detected other operation. When the menu button 81 is pressed, a setting menu screen is displayed, and when the play button 79 is pressed, an image stored in the recording medium 200 is displayed on the display unit 28.

[0177] In S831, the system control unit 50 determines whether or not the shooting standby state has ended. For example, if the shooting standby state has ended due to power-off or the like, the control flowchart in Fig. 8 ends; if not, the process returns to S401 in Fig. 4.

[0178] 9(a) to 9(f), the LV image displayed on the display unit 28 when an enlargement instruction is given by the user will be described.

[0179] FIG. 9(a) shows a display example in which the magnification is the same (i.e., no magnification) and the magnification frame is displayed superimposed on the left region, i.e., the LV image (LV900R) captured via the right-eye optical system 301R. The display unit 28 displays the LV900R captured via the right-eye optical system 301R and the LV900L captured via the left-eye optical system 301L. As described above, the LV900R displayed in the left region is captured via the right-eye optical system 301R, and the LV900L displayed in the right region is captured via the left-eye optical system 301L. Display items 901 and 902 are displayed to notify the user that the images are reversed. The display item 901 displays "R" to indicate right, and the display item 902 displays "L" to indicate left. When the enlargement button 78 is pressed once in the state shown in Figure 9(a), the state transitions to that shown in Figure 9(c), and when the left / right switching button (not shown) is pressed once, the enlargement frame superimposed on LV900R moves to the same relative position on LV900L, transitioning to the state shown in Figure 9(b).

[0180] 9(b) shows a display example in which the magnification is 1x (i.e., no magnification) and the magnification frame is displayed superimposed on the right region, i.e., the LV image (LV900L) captured by the left-eye optical system 301L. In FIG. 9(b), the magnification frame 904 is displayed superimposed on the LV900L. Pressing the magnification button 78 once in the state shown in FIG. 9(b) transitions to the state shown in FIG. 9(d), and pressing the left / right switching button once moves the magnification frame superimposed on the LV900L to the same relative position on the LV900R, transitioning to the state shown in FIG. 9(a).

[0181] 9(c) is a display example when the LV900R is enlarged at a magnification of 6. The enlarged image displayed on the display unit 28 has a display item 901 indicating which optical system was used to capture the image, superimposed on the enlarged LV image, LV910R.

[0182] 9(d) is a display example in which the LV900L is enlarged by a magnification of 6. The enlarged image displayed on the display unit 28 has a display item 902 indicating which optical system was used to capture the image, superimposed on the enlarged LV image LV910L.

[0183] 9(e) is a display example in which the LV900R is enlarged and displayed at a magnification of 5. The enlarged image displayed on the display unit 28 is superimposed on the LV920R enlarged by 15 times, and a display item 901 showing the LV image captured by the right-eye optical system 301R is displayed.

[0184] 9(f) is a display example in which the LV900L is enlarged and displayed at a magnification of 5. The enlarged image displayed on the display unit 29 is superimposed on the LV920L enlarged by 15 times, and a display item 902 showing the LV image captured by the left eye optical system 301L is displayed.

[0185] That is, Figures 9(a) and (b) are LV images displayed on the display unit 28 when the magnification is 1x (i.e., no magnification), Figures 9(c) and (d) are LV images displayed when the magnification is 6x, and Figures 9(e) and (f) are LV images displayed on the display unit 28 when the magnification is 15x.

[0186] Each time the enlargement button 78 is pressed, the enlargement magnification of the LV image displayed on the display unit 28 changes in the following order: 1x → 6x → 5x → 1x. Also, when the left / right switching button is pressed, if the enlargement magnification is 1x, the enlargement frame is switched to be superimposed on the other LV image. In other words, if the enlargement frame is superimposed on the LV900R displayed in the left area, the display area is switched so that it is superimposed on the LV900L displayed in the right area. If the enlargement magnification is other than 1x, the enlargement position is switched to the area of ​​the other LV image that is in the same relative position. In this case, the enlargement magnification does not change.

[0187] It has been explained that operations such as switching display modes, moving the enlargement frame or enlargement position, and enlargement are performed using operation buttons with dedicated functions, but each function may also be assigned to a button to which various arbitrary functions can be assigned.

[0188] As described above, when a lens having two optical systems (twin lens) is attached and image capture is performed, the enlargement frame indicating the enlargement position of the LV image is not displayed across the boundary between the two LV images during capture. Two LV images captured through the two optical systems are displayed side by side on the display unit, and the enlargement frame is not displayed or moved across the boundary between the two LV images. This makes it possible to avoid an image including both LV images being enlarged when the user issues an enlargement command, thereby reducing user confusion.

[0189] Furthermore, when the two LV images are displayed at the same size (not enlarged), if the user instructs further movement to the right after the enlargement frame has reached the right edge of the LV image displayed in the left region, the enlargement frame is moved so as to jump over the boundary between the two LV images. That is, the enlargement frame is controlled to move from the right edge of the LV image in the left region to the left edge of the LV image in the right region. This ensures that the range indicated by the enlargement frame is not included in both of the two LV images, as described above, and furthermore, the enlargement frame can be moved smoothly between the two LV images.

[0190] On the other hand, if one of the two LV images is enlarged, even if an instruction to move the enlargement position is given when the edge of the boundary of the currently enlarged image (the right edge if the left region is enlarged, or the left edge if the right region is enlarged) is reached, the enlargement position will not move in the instructed direction. In other words, in a situation where it is difficult for the user to visually recognize the current enlargement position, the enlargement position will not move beyond the region (the boundary of the LV images). This makes it possible to reduce unintentional crossing of the boundary of the LV images and to reduce user confusion.

[0191] Additionally, when a lens with two optical systems (twin lens) is attached, the focus guide and magnification frame are not linked (de-linked). This means that when two LV images are displayed, as with a twin lens, and it is difficult to check the entire LV image in detail without magnification, there is a high possibility that users will want to enlarge the LV image regardless of the focus position to check it in more detail. Therefore, rather than allowing users to enlarge only the position of the focus guide, which has a frame indicating the focus detection area, the focus guide and AF frame are de-linked so that users can enlarge the position of their choice. On the other hand, when a normal lens (single lens) is attached, the focus guide / AF frame and magnification frame are primarily linked, and moving the focus guide / AF frame also moves the position of the magnification frame. When a single lens is attached, only one LV image is displayed, and the LV image is displayed larger on the display than when two LV images are displayed. This makes it easier to check the LV image in more detail at 100% magnification than when a twin lens is attached.

[0192] The various controls described above as being performed by the system control unit 50 may be performed by a single piece of hardware, or the entire device may be controlled by multiple pieces of hardware (e.g., multiple processors or circuits) sharing the processing.

[0193] Furthermore, although the present invention has been described in detail based on preferred embodiments thereof, the present invention is not limited to these specific embodiments, and various forms within the scope of the gist of the present invention are also included in the present invention. Furthermore, each of the above-described embodiments merely represents one embodiment of the present invention, and each embodiment can be combined as appropriate.

[0194] Furthermore, in the above-described embodiment, the present invention has been described as being applied to digital camera 100, but this is not limiting and the present invention can be applied to any imaging control device that can display images captured by two optical systems. In other words, the present invention can be applied to personal computers, PDAs, mobile phone terminals, portable image viewers, printer devices with displays, digital photo frames, music players, game consoles, electronic book readers, home appliances, in-vehicle devices, medical equipment, and the like.

[0195] The present invention is not limited to application to the imaging device itself, but can also be applied to a control device that communicates with an imaging device (including a network camera) via wired or wireless communication and remotely controls the imaging device. Examples of devices that remotely control an imaging device include smartphones, tablet PCs, and desktop PCs. The imaging device can be remotely controlled by issuing commands from the control device to the imaging device to perform various operations and settings based on operations or processes performed on the control device. Furthermore, a live view image captured by the imaging device may be received via wired or wireless communication and displayed on the control device.

[0196] (Other embodiments) The present invention can also be realized by executing the following process. That is, software (programs) that realize the functions of the above-described embodiments are supplied to a system or device via a network or various storage media, and the computer (or CPU, MPU, etc.) of the system or device reads and executes the program code. In this case, the program and the storage media storing the program constitute the present invention.

Claims

1. an acquisition means for acquiring a third image in which a first image captured via a first optical system and a second image captured via a second optical system and having a parallax with respect to the first image are arranged side by side, or a fourth image captured via a single optical system; a control means for controlling the display unit to display an item indicating the focus detection area; a receiving means for receiving a position specification for specifying a position of the item on the display unit based on detection of a user operation; a display control means for controlling the display of the item on the display unit based on the position designation, An electronic device characterized in that the position at which the item is displayed on the display unit is changed in response to the acceptance of the position specification by the acceptance means, depending on whether the third image or the fourth image is displayed on the display unit.

2. The electronic device described in claim 1, characterized in that when the third image is displayed on the display unit, in response to the acceptance of the position specification by the acceptance means, the item is displayed superimposed at a predetermined position on the first image, and when the fourth image is displayed on the display unit, in response to the acceptance of the position specification by the acceptance means, the item is displayed superimposed at the specified position.

3. The electronic device described in claim 1 or 2, characterized in that when the third image is displayed on the display unit, the item is displayed superimposed at a predetermined position on either the first image or the second image in response to acceptance of the position specification by the acceptance means.

4. The electronic device described in claim 1 or 2, characterized in that when the third image is displayed on the display unit, the item is displayed superimposed at a predetermined position on the first image and the second image in response to acceptance of the position specification by the acceptance means.

5. The electronic device described in claim 1 or 2, characterized in that when the third image is displayed on the display unit, even if the receiving means receives a position specification that includes both the first image and the second image, the item is not displayed superimposed at a position that includes both the first image and the second image.

6. 3. The electronic device according to claim 1, wherein the item further indicates a focus level of the focus detection area.

7. 3. The electronic device according to claim 1, wherein the predetermined position is the center.

8. the control means controls to perform an enlargement process on the target region; the accepting means accepts an enlargement position specification for specifying a position of the enlargement frame on the screen based on detection of a user operation; The display control means Controlling to display an enlargement frame indicating the target area on the screen; Controlling the display of the enlargement frame so that it moves on the screen based on the position designation; The electronic device described in claim 1, characterized in that when the third image is displayed on the display unit, the item is displayed without moving in conjunction with the enlargement frame, and when the fourth image is displayed on the display unit, the item is displayed while moving in conjunction with the enlargement frame.

9. The electronic device according to claim 1 or 2, characterized in that, when the third image is displayed on the display unit, the display control means controls to display a magic window indicating a position corresponding to the area initially displayed on the external display device.

10. 10. The electronic device according to claim 9, wherein the magic window is displayed on the display unit so as to be superimposed on both the first image and the second image.

11. An electronic device with a detachable lens unit, an acquisition means for acquiring a third image in which a first image captured through the first optical system and a second image captured through the second optical system, the second image having a parallax with respect to the first image, are arranged side by side when a twin lens unit including a first optical system and a second optical system is attached, and for acquiring a fourth image captured through the single optical system when a monocular lens unit including a single optical system is attached; a control means for controlling the display unit to display an item indicating the focus detection area; a receiving means for receiving a position specification for specifying a position of the item on the display unit based on detection of a user operation; a display control means for controlling the display of the item on the display unit based on the position designation, An electronic device characterized in that the position at which the item is displayed on the display unit is changed in response to the acceptance of the position specification by the acceptance means, depending on whether the twin lens unit or the single lens unit is attached.

12. The electronic device described in claim 11, characterized in that when the twin lens unit is attached, the item is displayed superimposed at a predetermined position on the first image in response to the position specification being accepted by the acceptance means, and when the single lens unit is attached, the item is displayed superimposed at the specified position in response to the position specification being accepted by the acceptance means.

13. The electronic device according to claim 11 or 12, characterized in that when the twin lens unit is attached, the item is displayed superimposed at a predetermined position on either the first image or the second image in response to the acceptance of the position specification by the acceptance means.

14. The electronic device according to claim 11 or 12, characterized in that when the twin lens unit is attached, the item is displayed superimposed at a predetermined position on the first image and the second image in response to the acceptance of the position specification by the acceptance means.

15. The electronic device described in claim 11 or 12, characterized in that when the twin lens unit is attached, even if the receiving means receives a position specification that includes both the first image and the second image, the item is not displayed superimposed at a position that includes both the first image and the second image.

16. 13. The electronic device according to claim 11, wherein the item further indicates a focus level of the focus detection area.

17. 13. The electronic device according to claim 11, wherein the predetermined position is the center.

18. the control means controls to perform an enlargement process on the target region; the accepting means accepts an enlargement position specification for specifying a position of the enlargement frame on the screen based on detection of a user operation; The display control means Controlling to display an enlargement frame indicating the target area on the screen; Controlling the display of the enlargement frame so that it moves on the screen based on the position designation; The electronic device of claim 10, wherein when the twin lens unit is attached, the item is displayed without moving in conjunction with the magnification frame, and when the single lens unit is attached, the item is displayed by moving in conjunction with the magnification frame.

19. The electronic device according to claim 11 or 12, characterized in that the display control means controls the display of a magic window indicating a position corresponding to the area initially displayed on the external display device when the twin lens unit is attached.

20. 20. The electronic device according to claim 19, wherein the magic window is displayed on the display unit so as to be superimposed on both the first image and the second image.

21. an acquisition means for acquiring a third image in which a first image captured via a first optical system and a second image captured via a second optical system and having a parallax with respect to the first image are arranged side by side; a control means for controlling the display unit to display an item indicating the focus detection area; a receiving means for receiving a position specification for specifying a position of the item on the display unit based on detection of a user operation; a display control means for controlling the display of the item on the display unit based on the position designation, An electronic device characterized in that, when the third image is displayed on the display unit, the item is displayed superimposed at a predetermined position on at least one of the first image or the second image in response to the acceptance of the position specification by the acceptance means.

22. An electronic device with a detachable lens unit, an acquisition means for acquiring a third image in which a first image captured through the first optical system and a second image captured through the second optical system and having a parallax with respect to the first image are arranged side by side when a twin lens unit including a first optical system and a second optical system is attached; a control means for controlling the display unit to display an item indicating the focus detection area; a receiving means for receiving a position specification for specifying a position of the item on the display unit based on detection of a user operation; a display control means for controlling the display of the item on the display unit based on the position designation, An electronic device characterized in that, when the twin lens unit is attached, the item is displayed superimposed at a predetermined position on at least one of the first image or the second image in response to the acceptance of the position specification by the acceptance means.

23. an acquiring step of acquiring a third image in which a first image captured through a first optical system and a second image captured through a second optical system and having a parallax with respect to the first image are arranged side by side, or a fourth image captured through a single optical system; a control step of controlling the display unit to display an item indicating the focus detection area; a receiving step of receiving a position specification for specifying a position of the item on the display unit based on detection of a user operation; a display control step of controlling the display of the item on the display unit based on the position specification, A method for controlling an electronic device, characterized in that the position at which the item is displayed on the display unit is changed in response to the acceptance of the position specification in the acceptance step, depending on whether the third image or the fourth image is displayed on the display unit.

24. A method for controlling an electronic device having a detachable lens unit, comprising: an acquisition step of acquiring a third image in which a first image captured through the first optical system and a second image captured through the second optical system, the second image having a parallax with respect to the first image, are arranged side by side when a twin lens unit including a first optical system and a second optical system is attached, and acquiring a fourth image captured through the single optical system when a monocular lens unit including a single optical system is attached; a control step of controlling the display unit to display an item indicating the focus detection area; a receiving step of receiving a position specification for specifying a position of the item on the display unit based on detection of a user operation; a display control step of controlling the display of the item on the display unit based on the position specification, A method for controlling an electronic device, characterized in that the position at which the item is displayed on the display unit is changed in response to the acceptance of the position specification in the acceptance step, depending on whether the twin lens unit or the single lens unit is attached.

25. A program for causing a computer to function as each of the means of the electronic device according to claim 1 or 11.

26. 12. A computer-readable recording medium storing a program for causing a computer to function as each of the means of the electronic device according to claim 1 or 11.

Images