Electronic device, control method for electronic device, and recording medium

Abstract

The present invention provides an electronic device, a control method of the electronic device, and a recording medium. The electronic device includes: an acquisition unit configured to acquire a third image, wherein a first image captured via a first optical system and a second image captured via a second optical system are arranged side by side in the third image, and the second image has a parallax with respect to the first image; and a setting unit configured to set a target region to which a predetermined process is to be applied in the third image based on a user operation. The setting unit is configured to set the target region in such a manner that an item indicating the target region includes any one of the first image and the second image.

Description

Technical Field

[0001] The present invention relates to an electronic device, a control method for an electronic device, and a recording medium. Background Art

[0002] In recent years, digital cameras having a two-lens optical system have been well-known. By arranging a digital camera having a two-lens optical system to capture images in the same direction, a 180-degree angle image (hemispherical image) or a stereoscopic view image can be generated from two images with parallax obtained by each optical system. By arranging a digital camera having two optical systems to capture images in opposite directions, a 360-degree angle image (spherical image) can be generated from the two images obtained by each optical system.

[0003] During the process of capturing two images with parallax using such a digital camera including two optical systems, the user observes two live view images during image capture. In the case of a general digital camera having one optical system, the user enlarges one live view image and displays this enlarged image for detailed observation.

[0004] Japanese Patent Application Laid-Open No. 2013-201527 discusses a digital camera having one optical system that can separately set the positions of a zoom frame and an autofocus (AF) frame within a live view image. In the case where the user issues a zoom instruction, the live view image is enlarged at the position where the zoom frame is displayed on the live view image. Japanese Patent Application Laid-Open No. 2019-12881 discusses displaying a spherical image obtained via two optical systems, and in response to a shooting preparation instruction from the user, enlarging and displaying the live view image in a specific zoom target area.

[0005] However, Japanese Patent Application Laid-Open No. 2013-201527 does not include a detailed discussion of the case of displaying two live view images, and thus there is no detailed discussion of which live view image displays the zoom frame and which live view image is enlarged. According to Japanese Patent Application Laid-Open No. 2019-12881, before the user issues a shooting preparation instruction, the zoom target area, that is, which part of the fisheye image is to be enlarged, is unknown.

[0006] An object of the present invention is to enable a user to visually observe a zoom target position in a state where a plurality of live view images obtained via a plurality of optical systems are displayed. Summary of the Invention

[0007] According to one aspect of the present invention, there is provided an electronic device, the electronic device comprising: an acquisition unit configured to acquire a third image, wherein a first image captured via a first optical system and a second image captured via a second optical system are arranged side by side in the third image, and the second image has a parallax with respect to the first image; a setting unit configured to set, based on a user operation, a target area to which a predetermined process is to be applied in the third image; a first reception unit configured to receive a position designation indicating the position of an item of the target area; a second reception unit configured to receive a zoom instruction to magnify the target area; and a display control unit configured to display the third image and the item on a display unit, wherein the setting unit is configured to set the target area in such a manner that the item indicating the target area includes any one of the first image and the second image, change the position of the item to a designated position in response to the position designation made by the user, and control the magnification of the third image based on the target area indicated by the item when the user issues the zoom instruction.

[0008] Other features of the present invention will become apparent from the following description of exemplary embodiments with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Figure 1A and Figure 1B is a diagram showing the external appearance of a digital camera.

[0010] Figure 2 is a schematic block diagram showing an example of the hardware configuration of a digital camera.

[0011] Figure 3 is a schematic diagram showing an example of the configuration of a lens unit.

[0012] Figure 4 is a flowchart showing a display mode change process performed by a digital camera and a process during a touch-down operation during live view according to an exemplary embodiment.

[0013] Figures 5A to 5F is a diagram showing an example of a live view display on a digital camera equipped with a dual lens unit according to the present exemplary embodiment.

[0014] Figure 6A and Figure 6B is a flowchart showing a zoom frame movement process performed by a digital camera according to the present exemplary embodiment.

[0015] Figure 7A and Figure 7B is a diagram showing the boundary between a left live view image and a right live view image on a digital camera equipped with a dual lens unit according to the present exemplary embodiment.

[0016] Figure 8A and Figure 8B is a flowchart illustrating a zoom process and a shooting operation performed by a digital camera according to an exemplary embodiment.

[0017] Figures 9A to 9F is a diagram illustrating a zoom operation performed by a digital camera attached with a dual lens unit according to an exemplary embodiment. DETAILED DESCRIPTION

[0018] Exemplary embodiments of the present invention will be described below with reference to the accompanying drawings. First, exemplary embodiments will be described by taking an electronic device as a digital camera (imaging device) as an example.

[0019] The digital camera 100 according to the present exemplary embodiment can capture a dual lens image and display the dual lens image on a display unit. The dual lens image is an image having a left image and a right image arranged side by side and having a horizontal parallax between the left image and the right image. The digital camera 100 can apply predetermined image processing to a target area of the image displayed on the display unit. An example of the predetermined image processing is a zoom process. In the following description, the case of the zoom process will be described in detail. The digital camera 100 displays an enlarged image obtained by magnifying the target area in response to a zoom instruction on the display unit. The predetermined image processing is not limited to the zoom process. Examples of the predetermined image processing may include processing for detecting a luminance distribution or a chrominance distribution in the target area and generating a histogram or a waveform monitor, and processing for applying a filtering process such as a contrast enhancement process to the target area. In the present exemplary embodiment, a zoom instruction is issued by a pressing operation on a zoom button 78 which is a physical component that can be pressed. However, a zoom instruction may be issued by a pinch-out operation on a touch panel 70a. The enlarged display can be canceled by a pinch-in operation.

[0020] The digital camera 100 according to the present exemplary embodiment fits an item indicating the target area to the dual lens image to display the item on the dual lens image. Examples of the item include a frame-shaped indicator indicating the target area and a semi-transparent color image superimposed on the target area. The digital camera 100 can change the display position of the item (i.e., the target area indicated by the item) based on a user operation. When displaying the dual lens image, the digital camera 100 displays the item at a position where the target area of the item does not straddle both the left image and the right image. That is, it is determined that the target area does not include both the left image and the right image. In other words, the target area is set to include one of the left image and the right image.

[0021] The digital camera 100 controls the display of items in such a manner that even if a user operation for changing the display position (position of the target area) of an item is performed, the target area indicated by the item does not straddle both the left image and the right image.

[0022] Figure 1A and Figure 1B FIG. shows an external view of a digital camera 100 as an example of an apparatus to which the exemplary embodiment can be applied. Figure 1A is a front perspective view of the digital camera 100. Figure 1B is a rear perspective view of the digital camera 100. As Figure 1B shown, a display unit 28 is disposed on the rear surface of the digital camera 100, and the display unit 28 is for displaying images and various types of information. The touch panel 70a is a touch detection unit capable of detecting a touch operation performed on the display surface (operation surface) of the display unit 28. The external viewfinder display unit 43 is a display unit disposed on the top of the digital camera 100. The external viewfinder display unit 43 displays various setting values of the digital camera 100, and the various setting values include a shutter speed and an aperture value. The display unit 28 may be built in the digital camera 100 or detachably attached to the digital camera 100. In addition, the display unit 28 may be an external device connected to the communication unit 54 of the digital camera 100.

[0023] The shutter button 61 is an operation unit for receiving a shooting instruction. The mode change switch 60 is an operation unit for switching various modes. The terminal cover 40 is a cover for protecting a connection cable connector (not shown) for connecting a connection cable of an external device to the digital camera 100. The main electronic dial 71 included in the operation unit 70 is a rotary operation member. Setting values such as a shutter speed and an aperture value can be changed by rotating the main electronic dial 71. The power switch 72 is an operation member for turning on and off the power of the digital camera 100.

[0024] The sub-electronic dial 73 included in the operation unit 70 is a rotary operation member for moving a selection box and scrolling an image. The direction keys 74 included in the operation unit 70 are direction keys (four-way direction keys) capable of pressing the upper, lower, left, and right portions respectively. The digital camera 100 can be operated based on the pressed portion of the direction keys 74. The setting button 75 included in the operation unit 70 is a button mainly for receiving confirmation of a selected item. The moving image button 76 is a button for receiving an instruction to start and stop moving image shooting (recording).

[0025] The zoom button 78 included in the operation unit 70 is an operation button for turning on and off the zoom mode during live view display in the shooting mode. When the zoom mode is "ON", the live view (LV) image can be enlarged and reduced by operating the main electronic dial 71. In the playback mode, the zoom button 78 functions as a zoom button for enlarging the reproduced image and increasing the zoom ratio. The playback button 79 included in the operation unit 70 is an operation button for switching between the shooting mode and the playback mode. When the playback button 79 is pressed in the shooting mode, the digital camera 100 can enter the playback mode and display the latest image among the images recorded on the recording medium 200 on the display unit 28.

[0026] The menu button 81 is included in the operation unit 70. When the menu button 81 is pressed, a menu screen for setting various settings is displayed on the display unit 28. The user can intuitively perform various settings on the menu screen displayed on the display unit 28 by using the direction keys 74 and the set button 75.

[0027] The multi-controller 82 can be tilted in a 360-degree direction to receive key commands corresponding to different ones of eight directions such as up, down, left, and right. The multi-controller 82 can also be pressed to trigger a specified function. The display mode switching button 83 is an operation member for switching between a plurality of different display modes related to the LV image and information such as shooting information displayed on the display unit 28 or the electronic viewfinder (EVF) 29. The display mode is switched each time the display mode switching button 83 is pressed, whereby an image can be shot in a display mode desired by the user and information related to the reproduced image can be visually observed.

[0028] The communication terminal 10 is a communication terminal for the digital camera 100 to communicate with a lens unit (detachably attached).

[0029] The eyepiece unit 16 is an eyepiece portion of an eyepiece viewfinder (perspective viewfinder; hereinafter simply referred to as a viewfinder). The user can visually observe the video image displayed on the internally provided EVF 29 through the eyepiece unit 16. The eye proximity detection unit 57 is an eye proximity detection sensor for detecting whether the user's eye is close to the eyepiece unit 16. The cover 202 is a cover for a slot that houses the recording medium 200. The grip portion 90 is a grip portion having a shape that is convenient for a user to hold the digital camera 100 with the right hand. The shutter button 61 and the main electronic dial 71 are disposed at positions where they can be operated by the index finger of the right hand in a state where the digital camera 100 is held by holding the grip portion 90 with the little finger, ring finger, and middle finger of the right hand. The sub-electronic dial 73 is disposed at a position where it can be operated by the thumb of the right hand in the same state.

[0030] Figure 2 FIG. is a block diagram showing a configuration example of a digital camera 100 according to the present exemplary embodiment. In Figure 2 , the lens unit 150 is an interchangeable lens unit including a photographing lens. The lens 103 generally consists of a plurality of lenses, but is shown as a single lens here for simplicity. The communication terminal 6 is a communication terminal through which the lens unit 150 communicates with the digital camera 100. The communication terminal 10 is a communication terminal through which the digital camera 100 communicates with the lens unit 150. The lens unit 150 communicates with the system control unit 50 via the communication terminals 6 and 10. The lens system control circuit 4 in the lens unit 150 controls the aperture 1 via the aperture drive circuit 2 and adjusts the focus by shifting the lens 103 via the autofocus (AF) drive circuit 3. In addition, the system control unit 50 identifies the type of the lens unit 150 attached to the digital camera 100 via the communication terminals 6 and 10.

[0031] The shutter 101 is a focal plane shutter that can freely control the exposure time of the imaging unit 22 under the control of the system control unit 50.

[0032] The imaging unit 22 is an image sensor including a charge coupled device (CCD) sensor or a complementary metal oxide semiconductor (CMOS) sensor for converting an optical image into an electrical signal. The imaging unit 22 may include an image plane phase difference sensor that outputs defocus amount information to the system control unit 50. The analog-to-digital (A / D) converter 23 converts an analog signal into a digital signal. The A / D converter 23 is used to convert the analog signal output from the imaging unit 22 into a digital signal.

[0033] The image processing unit 24 performs predetermined size adjustment processing and color conversion processing such as pixel interpolation and reduction on the data from the A / D converter 23 or the data from the memory control unit 15. The image processing unit 24 also performs predetermined calculation processing using the captured image data. The system control unit 50 performs exposure control and distance measurement control based on the calculation results obtained by the image processing unit 24. Based on these controls, through-the-lens (TTL) AF processing, automatic exposure (AE) control, and electronic flash (EF) (flash pre-flash) processing are performed. The image processing unit 24 also performs predetermined calculation processing using the captured image data and performs TTL automatic white balance (AWB) processing based on the calculation results obtained by the image processing unit 24.

[0034] Data output from the A / D converter 23 is written into the memory 32 via the image processing unit 24 and the memory control unit 15 or directly via the memory control unit 15. The memory 32 stores the image data obtained by the imaging unit 22 and digitally converted by the A / D converter 23, as well as the image data to be displayed on the display unit 28 and the EVF 29. The memory 32 has a sufficient storage capacity to store a predetermined number of still images or moving images and audio data for a predetermined duration.

[0035] The memory 32 also serves as an image display memory (video memory). The digital-to-analog (D / A) converter 19 converts the image display data stored in the memory 32 into an analog signal and supplies the analog signal to the display unit 28 and the EVF 29. Thus, the image display data written into the memory 32 is displayed on the display unit 28 and the EVF 29 via the D / A converter 19. The display unit 28 and the EVF 29 perform display on respective display devices, such as a liquid crystal display (LCD) and an organic electroluminescence (EL) display, based on, for example, the analog signal from the D / A converter 19. The digital signal that has been subjected to A / D conversion once by the A / D converter 23 and stored in the memory 32 can be converted into an analog signal by the D / A converter 19 and sequentially transmitted to the display unit 28 or the EVF 29 to provide LV display. The image displayed by LV display hereinafter is referred to as an LV image.

[0036] Various setting values including the shutter speed and the aperture value of the digital camera 100 are displayed on the external viewfinder display unit 43 via the external viewfinder display unit drive circuit 44.

[0037] The non-volatile memory 56 is an electrically erasable recordable memory. For example, an electrically erasable programmable read-only memory (EEPROM) is used as the non-volatile memory 56. The non-volatile memory 56 stores the operation constants and programs of the system control unit 50. The programs adopted herein refer to the programs for executing various processing procedures of the flowchart to be described hereinafter in this exemplary embodiment.

[0038] The system control unit 50 is a control unit including at least one processor or circuit and performs overall control of the digital camera 100. The system control unit 50 implements various processing according to this exemplary embodiment to be described hereinafter by executing the aforementioned programs recorded in the non-volatile memory 56. The system memory 52 is, for example, a random access memory (RAM). The operation constants, variables, and programs read from the non-volatile memory 56 of the system control unit 50 are loaded into the system memory 52. In addition, the system control unit 50 performs display control by controlling the memory 32, the D / A converter 19, and the display unit 28.

[0039] The system timer 53 is a timing unit that measures the time used for various controls and the time of the built-in clock.

[0040] The operation unit 70 is an operating device for inputting various operation instructions into the system control unit 50.

[0041] The mode change switch 60 included in the operation unit 70 is an operating component for switching the operation mode of the system control unit 50 to any one of a still image shooting mode, a moving image shooting mode, and a playback mode. The still image shooting mode includes the following modes: an automatic shooting mode, an automatic scene determination mode, a manual mode, an aperture priority mode (aperture value (Av) mode), a shutter speed priority mode (time value (Tv) mode), and a program AE mode (P mode). The still image shooting mode also includes various scene modes having shooting settings specific to each shooting scene and a custom mode. The user can directly switch to one of these modes using the mode change switch 60. Alternatively, the user can use the mode change switch 60 to switch to a shooting mode list screen once, and then use another operating component to select one of the multiple modes displayed and switch to the selected mode. The moving image shooting mode can similarly include multiple modes.

[0042] When the shutter button 61 on the digital camera 100 is incompletely operated - i.e., half-pressed (shooting preparation instruction), the first shutter switch 62 is turned on to generate a first shutter switch signal SW1. In response to the first shutter switch signal SW1, shooting preparation operations such as AF processing, AE processing, AWB processing, and EF processing are started.

[0043] When the shutter button 61 is completely operated - i.e., fully pressed (shooting instruction), the second shutter switch 64 is turned on to generate a second shutter switch signal SW2. In response to the second shutter switch signal SW2, the system control unit 50 starts a series of shooting processing operations from reading the signal from the imaging unit 22 to writing the captured image as an image file to the recording medium 200.

[0044] The operation unit 70 serves as various operating components (receiving units), which serve as input units for receiving operations from the user. The operation unit 70 includes at least the following operating components: a mode change switch 60, a shutter button 61, a main electronic dial 71, a power switch 72, a sub-electronic dial 73, a direction key 74, a setting button 75, a moving image button 76, a zoom button 78, a playback button 79, a menu button 81, and a multi-controller 82. These operating components are collectively referred to as other operating components 70b, rather than separate modules.

[0045] The power control unit 80 includes a battery detection circuit, a direct current - direct current (DC - DC) converter, and a switching circuit for switching the modules to be powered on, and detects the presence of an attached battery, the battery type, and the remaining battery charge. The power control unit 80 also controls the DC - DC converter based on the detection results and instructions from the system control unit 50, and supplies a predetermined voltage to various components including the recording medium 200 for a predetermined period of time. The power supply unit 30 includes primary batteries such as alkaline batteries and lithium batteries, secondary batteries such as nickel - cadmium (NiCd) batteries, nickel - metal hydride (NiMH) batteries, and lithium - ion (Li) batteries, and / or an alternating current (AC) adapter.

[0046] The recording medium interface (I / F) 18 is an I / F together with a recording medium 200 such as a memory card and a hard disk. The recording medium 200 is a recording medium for recording captured images, and includes a semiconductor memory or a disk.

[0047] The communication unit 54 makes a wireless connection or a wired connection, and transmits and receives video and audio signals. The communication unit 54 can also be connected to a wireless local area network (LAN) and the Internet. The communication unit 54 can also communicate with external equipment using and low power consumption. The communication unit 54 can transmit the images (including LV images) captured by the imaging unit 22 and the images recorded on the recording medium 200, and receive images and various other types of information from external equipment.

[0048] The orientation detection unit 55 detects the orientation of the digital camera 100 relative to the direction of gravity. Based on the orientation detected by the orientation detection unit 55, it can be determined whether the image captured by the imaging unit 22 is an image captured by the digital camera 100 held horizontally or vertically. The system control unit 50 can add orientation information to the image file of the image captured by the imaging unit 22 based on the orientation detected by the orientation detection unit 55, or rotate the image and record the rotated image. An acceleration sensor or a gyro sensor can be used as the orientation detection unit 55. The acceleration sensor or the gyro sensor used as the orientation detection unit 55 can also be used to detect the movement of the digital camera 100 (such as panning, tilting, lifting, and whether the digital camera 100 is stationary).

[0049] The eye proximity detection unit 57 is an eye proximity detection sensor that detects the approach (eye approach) and departure (eye separation) (proximity detection) of the eyes (objects) to / from the eyepiece unit 16 of the viewfinder. Based on the state detected by the eye proximity detection unit 57, the system control unit 50 switches between the display (display state) and non-display (non-display state) of the display unit 28 and the EVF 29. More specifically, at least when the digital camera 100 is in the shooting standby state and the display destination switching setting is set to automatic switching, the system control unit 50 turns on the display unit 28 as the display destination and turns off the EVF 29 during the non-eye proximity state. The system control unit 50 turns on the EVF 29 as the display destination and turns off the display unit 28 during the eye proximity state.

[0050] For example, an infrared proximity sensor can be used as the eye proximity detection unit 57, and can detect an object approaching the eyepiece unit 16 of the viewfinder including the EVF 29. In the case of an object approaching, the infrared rays emitted from the light emitting part (not shown) of the eye proximity detection unit 57 are reflected by the object and received by the light receiving part (not shown) of the infrared proximity sensor. It is also possible to determine how close the object is to the eyepiece unit 16 (eye approach distance) based on the amount of infrared rays received. Therefore, the eye proximity detection unit 57 can perform eye proximity detection to detect the approach distance of the object to the eyepiece unit 16.

[0051] When it is detected that an object approaches the eyepiece unit 16 by less than or equal to a predetermined distance in the non-eye proximity state (non-approaching state), eye approach is detected. When it is detected that an approaching object departs from the eyepiece unit 16 by greater than or equal to a predetermined distance in the eye proximity state (approaching state), eye separation is detected. The threshold for detecting eye approach and the threshold for detecting eye separation can be different. For example, the two thresholds may have hysteresis. After eye approach is detected, the eye proximity state continues until eye separation is detected. After eye separation is detected, the non-eye proximity state continues until eye approach is detected. The infrared proximity sensor is just an example. Other sensors that can detect the approach of an eye or an object that can be detected for eye approach determination can be used as the eye proximity detection unit 57.

[0052] The touch panel 70a and the display unit 28 can be integrally configured. For example, the touch panel 70a is configured such that its light transmittance does not interfere with the display on the display unit 28, and is attached to the display surface of the display unit 28. The input coordinates of the touch panel 70a are associated with the display coordinates on the display screen of the display unit 28. This can provide a graphical user interface (GUI) that enables the user to operate as if directly operating the screen displayed on the display unit 28. The system control unit 50 can detect the following operations or states of the touch panel 70a.

[0053] · No finger or pen touches the touch panel 70a newly. In other words, the touch starts (hereinafter referred to as touch-down).

[0054] · A finger or pen is touching the touch panel 70a (hereinafter referred to as touch-on).

[0055] · A finger or pen moves while touching the touch panel 70a (hereinafter referred to as touch-move).

[0056] · The finger or pen touching the touch panel 70a is released. In other words, the touch ends (hereinafter referred to as touch-up).

[0057] · Nothing touches the touch panel 70a (hereinafter referred to as touch-off).

[0058] When touch-down is detected, touch is detected simultaneously. After touch-down, touch is usually continuously detected until touch-up is detected. Touch-move is also detected while it is detected that something is touching. When touch is detected and the touch position does not move, touch-move is not detected. After touch-up of all fingers or pens touching the touch panel 70a is detected, touch-off is detected.

[0059] These operations and states and the position coordinates of the fingers and pens touching the touch panel 70a are notified to the system control unit 50 via the internal bus. The system control unit 50 determines what operation (touch operation) has been performed on the touch panel 70a based on the notified information.

[0060] During touch-move, based on the change in the position coordinates, the moving direction of the finger or pen moving on the touch panel 70a can be determined according to the vertical component and the horizontal component on the touch panel 70a respectively.

[0061] When touch-move of a predetermined distance or longer is detected, it is determined that a swipe operation has been performed. The operation of quickly moving a finger touching the touch panel 70a by a distance and immediately releasing the finger is called a tap. In other words, a tap is an operation of quickly moving a finger on the touch panel 70a like flicking. When touch-move of a predetermined distance or longer is detected at a predetermined speed or higher and touch-up is immediately detected, it is determined that a tap has been performed (it can be determined that a tap has been performed immediately after a swipe operation).

[0062] In addition, a touch operation in which multiple positions (e.g., two positions) are touched together (for multi-touch) and the touched positions are brought closer to each other is called pinch-in. A touch operation in which the touched positions are separated from each other is called pinch-out. Pinch-in and pinch-out are collectively referred to as a pinch operation (or simply pinch). The touch panel 70a can be a touch panel including any one of various methods such as a resistive method, a capacitive method, a surface acoustic wave method, an infrared method, an electromagnetic induction method, an image recognition method, and an optical sensor method. Some methods detect touches based on contact on the touch panel. Some methods detect touches based on the approach of a finger or a pen to the touch panel. Any type can be used.

[0063] Figure 3 It is a schematic diagram showing an example of the configuration of the lens unit 300. Figure 3 The state in which the lens unit 300 is attached to the digital camera 100 is shown. Among the components of the digital camera 100 shown in Figure 3 , components similar to the components described with reference to Figure 2 are denoted by the same reference numerals. Redundant descriptions of the components will be appropriately omitted.

[0064] The lens unit 300 is an interchangeable lens that is detachably attached to the digital camera 100. The lens unit 300 is a dual-lens unit capable of obtaining left and right optical images with parallax. The lens unit 300 includes two optical systems (imaging lenses), each of which has a wide viewing angle of 180° and can capture an image of a front hemisphere angle. Specifically, the two optical systems of the lens unit 300 can respectively input subject optical images having a field of view (viewing angle) of 180° in the lateral direction (horizontal angle, azimuth angle, or yaw angle) and 180° in the longitudinal direction (vertical angle, elevation angle, and depression angle, or pitch angle).

[0065] The lens unit 300 includes: a right-eye optical system 301R, which includes a plurality of lenses and mirrors; a left-eye optical system 301L, which includes a plurality of lenses and mirrors; and a lens system control circuit 303. The right-eye optical system 301R corresponds to an example of the first optical system. The left-eye optical system 301L corresponds to an example of the second optical system. The right-eye optical system 301R and the left-eye optical system 301L each include a lens 302R and a lens 302L, which are disposed on the subject side, oriented in a similar direction, and have optical axes parallel to each other. Each of the right-eye optical system 301R and the left-eye optical system 301L is a fish-eye lens and forms a circular optical image on the imaging unit 22 (sensor). The optical image (left image) input via the left-eye optical system 301L and the optical image (right image) input via the right-eye optical system 301R are formed on the imaging surface of a single imaging unit that is the imaging unit 22. The imaging unit 22 obtains an image including the optical images of both the right-eye optical system 301R and the left-eye optical system 301L.

[0066] The lens unit 300 according to this exemplary embodiment is a VR180 lens (dual-lens unit) for shooting VR180 images. VR180 is a virtual reality (VR) image format of a dual-lens stereoscopic view. As a VR180 lens, each of the right-eye optical system 301R and the left-eye optical system 301L includes a fish-eye lens capable of shooting a 180-degree angle. As a VR180 lens, a lens capable of covering a wide viewing angle of about 160 degrees, which is narrower than a 180-degree viewing angle, may also be used as long as both the right-eye optical system 301R and the left-eye optical system 301L can shoot video images for VR180 dual-lens VR display. The VR180 lens can form a right image (first image) via the right-eye optical system 301R and a left image (second image) having a parallax with the right image via the left-eye optical system 301L on one or two image sensors of a camera to which the VR180 lens is attached. The digital camera 100 according to this exemplary embodiment has the following configuration: wherein, the right image and the left image are formed on one image sensor (sensor) that is the imaging unit 22 to generate an image (dual-lens image) in which the image corresponding to the right image and the image corresponding to the left image are arranged horizontally. The dual-lens image here includes the image corresponding to the right image, the image corresponding to the left image, and an area (black area) where no optical image is formed.

[0067] The lens unit 300 is attached to the digital camera 100 via the lens mounting unit 304 of the lens unit 300 and the camera mounting unit 305 of the digital camera 100. Accordingly, the system control unit 50 of the digital camera 100 and the lens system control circuit 303 of the lens unit 300 are electrically connected via the communication terminal 10 of the digital camera 100 and the communication terminal 306 of the lens unit 300.

[0068] In the present exemplary embodiment, the right image formed via the right optical system 301R and the left image formed via the left optical system 301L, which has a parallax with the right image, are formed side by side on the imaging unit 22 of the digital camera 100. In other words, two optical images formed by the right optical system 301R and the left optical system 301L are formed on one image sensor. The imaging unit 22 converts the formed subject image (optical signal) into an analog electric signal to obtain image data regarding the dual-lens image. Accordingly, by using the lens unit 300, two images (as a set) having a parallax can be obtained simultaneously from two components (optical systems), i.e., the right optical system 301R and the left optical system 301L. In addition, the user can view a stereoscopic VR image with a 180-degree viewing angle, i.e., a VR180 image, by splitting the obtained image into a left-eye image and a right-eye image and displaying the split images in a VR manner.

[0069] In the case of a conventional ordinary single-lens unit, the optical image incident on the lens unit is symmetrically inverted about the point at the center of the optical axis and input to the image sensor. As in the case of the imaging device of the digital camera 100, an actual (non-inverted) image is generated by performing a process of inverting the reading order of the image sensor or inverting the read image. In the case of a dual-lens unit, the input optical image is vertically symmetrically inverted instead of horizontally symmetrically inverted, i.e., the left image obtained via the left optical system is input to the left side region of the image sensor, and the right image obtained via the right optical system is input to the right side region of the image sensor. When performing a conventional inversion process on such an image, the left and right of the digital camera 100 are opposite to the left and right of the inverted image. Specifically, the left image obtained via the left optical system is displayed on the right side, and the right image obtained via the right optical system is displayed on the left side.

[0070] The VR image used in this document refers to an image capable of VR display, which will be described below. Examples of VR images include omnidirectional images (spherical images) captured by omnidirectional cameras (spherical cameras), and panoramic images with a wider video viewing angle (effective video angle) than the display angle that can be displayed on the display unit at one time. VR images are not limited to still images and may also include moving images and live images (images obtained from a camera almost in real time). The video viewing angle (effective video angle) of a VR image corresponds to a field of view of up to 360° in the horizontal direction and up to 360° in the vertical direction. Even if the viewing angle of an image is less than 360° in the horizontal direction and less than 360° in the vertical direction, the image can be included in VR images as an image with a wider viewing angle than that of an ordinary camera or an image with a wider video viewing angle than the display angle that can be displayed on the display unit at one time. The image captured by the digital camera 100 using the lens unit 300 is a type of VR image. For example, VR display of a VR image can be performed by setting the display mode of a display device (a display device capable of displaying VR images) to "VR view". The user can view a horizontally seamless omnidirectional video image by VR-displaying a VR image with a 360° viewing angle and changing the orientation of the display device in the horizontal direction (horizontal rotation direction).

[0071] The VR display (VR view) used in this document refers to a display method (display mode) for displaying a video image whose field of view corresponds to the orientation of the display device and whose display area of the VR image can be changed. An example of VR display is "single-lens VR display (single-lens VR view)", which displays a single image by transforming the VR image for mapping on a virtual sphere (deformation correction transformation). Another example of VR display is "dual-lens VR display (dual-lens VR view)", which separately transforms the left-eye VR image and the right-eye VR image for mapping on respective virtual spheres, and thus displays images side by side in the left area and the right area. The "dual-lens VR display" using left-eye VR images and right-eye VR images with parallax can achieve a stereoscopic view.

[0072] In any VR display, if a user wears a display device such as a head-mounted display (HMD), for example, a video image with a field of view corresponding to the user's face direction is displayed. For example, in the case where a video image with a field of view centered at 0° in the horizontal direction (a specific orientation, such as north) and 90° in the vertical direction (90° from the vertex, i.e., horizontal) is displayed at a certain point in time in a VR image, when the orientation of the display device is reversed (e.g., the display side turns from south to north), the display area changes to a video image with a field of view centered at 180° in the horizontal direction (the reversed orientation, such as south) and 90° in the vertical direction in the same VR image. In other words, when a user wearing an HMD turns the user's head from north to south (i.e., turns back), the video image displayed on the HMD also changes from a north image to a south image.

[0073] The VR image captured by using the lens unit 300 according to the present exemplary embodiment is a VR180 image with a 180-degree angle in the front and no video image in the 180-degree angle in the rear. If this VR180 image is subjected to VR display and the orientation of the display device is changed to the side without a video image, a blank area is displayed.

[0074] This VR display of a VR image visually makes the user feel as if in the VR image (VR space). The method of displaying a VR image is not limited to the method including changing the orientation of the display device. For example, a touch panel 70a or a direction key 74 can be used based on a user operation to move (scroll) the display area. During VR display (during the display mode "VR view"), in addition to the change of the display area based on the orientation change, the display area can be changed based on a touch movement operation on the touch panel 70a, a drag operation on a mouse, or a press on the direction key 74. A smartphone attached to a VR goggle (head-mounted adapter) is a type of HMD.

[0075] The dual-lens image captured by the digital camera 100 configured as described above via the lens unit 300 is an image including a right image and a left image input to the imaging unit 22 via the right optical system 301R and the left optical system 301L. A user using the digital camera 100 can zoom in and display a part of the LV image or record a part of the image to check details. When zooming in on an image, the center position of the area to be zoomed in on the image can always be set at the center position of the entire image.

[0076] When a part of a dual-lens image is enlarged to check details of the dual-lens image, it is desirable to display a part of one of the right image and the left image. If the center position of the area to be enlarged in the image is always set at the center of the entire image, parts of both the right image and the left image are included in the enlarged image. This makes it difficult for the user to intuitively identify which part of the original image is displayed as the enlarged image. Specifically, in the enlarged image, the left end part of the right image is displayed on the right side, and the right end part of the left image is displayed on the left side, and the enlarged image is an image having a horizontal positional relationship different from the horizontal positional relationship in the image capture field of view.

[0077] will be described Figure 4 the flowchart shown in to describe the processing performed by the digital camera 100, which performs LV zoom processing suitable for image capture using a dual-lens unit similar to the lens unit 300 in the present exemplary embodiment.

[0078] Figure 4 is a flowchart illustrating an example of the processing performed by the digital camera 100 in the imaging mode. Figure 4 The flowchart is implemented by the system control unit 50 loading a program stored in the non-volatile memory 56 into the system memory 52 and executing the program. Figure 4 The flowchart starts when the digital camera 100 is in the imaging standby state after the power is turned on. When Figure 4 the processing of the flowchart (hereinafter may be referred to as the control flowchart) starts, the system control unit 50 initializes the control variables and starts the processing.

[0079] will be referred to Figures 5A to 5F to describe a display example of the display unit 28 during the processing of the Figure 4 control flowchart. The details of the display example will be described after describing the Figure 4 control flowchart. Figures 5A to 5F shown in

[0080] In step S401, the system control unit 50 obtains the last used display mode based on the flag (N) stored in the non-volatile memory 56, and displays one or more LV images and / or information about imaging on the display unit 28 based on the last used display mode. For example, in the case where the processing of the flowchart starts by power-on, the last used display mode corresponds to the mode at the moment when the digital camera 100 was last powered off. In the case where the processing of the flowchart starts by switching from a mode other than the imaging mode (such as the playback mode) to the imaging mode, the last used display mode corresponds to the mode at the moment when the processing was performed in the previous imaging mode.

[0081] In step S402, the system control unit 50 determines whether the display mode switching button 83 is pressed. If the display mode switching button 83 is pressed (Yes in step S402), the process proceeds to step S403. If the display mode switching button 83 is not pressed (No in step S402), the process proceeds to step S410.

[0082] In step S403, the system control unit 50 refers to the system memory 52 and determines whether the flag N indicating the display mode is 5 (N = 5). If the flag N is 5 (Yes in step S403), the process proceeds to step S404. If the flag N is not 5 (No in step S403), the process proceeds to step S405.

[0083] In step S404, the system control unit 50 determines whether the lens unit attached via the communication terminals 6 and 10 is a dual-lens unit. If the attached lens unit is a dual-lens unit (Yes in step S404), the process proceeds to step S406. If the attached lens unit is not a dual-lens unit (i.e., the attached lens unit is an ordinary single-lens unit or no lens unit is attached) (No in step S404), the process proceeds to step S408. The dual-lens unit includes a left lens and a right lens, and each lens is a wide-angle fish-eye lens capable of capturing an image and having a viewing angle of at least 180 degrees on the side where it is disposed facing the subject. The left image and the right image formed in the left optical system 301L and the right optical system 301R can be captured by one or two image sensors.

[0084] In step S405, the system control unit 50 increments the flag N indicating the display mode by 1 (N = N + 1) and stores the flag N in the system memory 52.

[0085] In step S406, the system control unit 50 sets the flag N to 6 (N = 6) and stores the flag N in the system memory 52.

[0086] In step S407, the system control unit 50 displays the LV image and / or information on the display unit 28 in a display mode dedicated to the dual-lens unit. Figure 5F A display example of this process is illustrated. This will be described in detail below Figure 5F 。

[0087] In step S408, the system control unit 50 sets the flag N to 1 (N = 1) and stores the flag N in the system memory 52.

[0088] In step S409, the system control unit 50 displays the LV image and / or information on the display unit 28 in a display mode corresponding to the value of the flag N stored in the system memory 52. Figures 5A to 5E The display examples shown on the display unit 28 are illustrated, each display example corresponding to a different display mode. Since the process can also reach this step S409 when the determination in step S404 is NO, even when the dual lens unit is not attached - that is, when the single lens unit is attached or no lens unit is attached, the LV image and / or information on the display unit 28 are displayed in a display mode corresponding to the value of the flag N (N = 1).

[0089] Reference will be made to Figures 5A to 5F describe the display examples of the LV image and information displayed on the display unit 28. Figures 5A to 5D and Figure 5F illustrates the case where the dual lens unit is attached to the digital camera 100 and two LV images are displayed. In the case where the single lens unit is attached, except for displaying one LV image, a similar display is provided. In the case where the single lens unit is attached, as referred to above Figure 4 described, the display mode will not change to Figure 5F shown in. Each time the user performs a display mode change operation (in this exemplary embodiment, pressing the display mode switching button 83), the information displayed on the display unit 28 is changed. Specifically, the system control unit 50 provides Figure 4 any one of the displays based on the value of the flag N indicating different display modes described above with reference to Figures 5A to 5F . In this exemplary embodiment, the LV image displayed on the display unit 28 is a circular fisheye display. However, an equidistant rectangular conversion process can be performed on the circular fisheye display of the LV image to provide an equidistant rectangular display.

[0090] Figure 5A illustrates the display mode in the case where the flag N = 1 - that is, when the digital camera 100 is powered on and the LV image is displayed on the display unit 28 in the shooting standby state. Two horizontally arranged LV images (hereinafter may be referred to as LV image 500R and LV image 500L) are displayed on the display unit 28 together with the information displays 501a to 501c. Here, the two horizontally arranged LV images are referred to as side-by-side images. The information displays 501a to 501c indicate the minimum shooting information considered to be desired by the user when taking an image. In Figure 5A when the display mode switching button 83 is pressed in the state shown, the display mode changes to Figure 5B shown in.

[0091] Figure 5BThe figure illustrates a display mode for the case where the flag N = 2. In Figure 5B , in addition to the LV images 500R and 500L, information displays 502a and 502b, and information displays 501a to 501c are also shown. Similar to the information displays 501a to 501c, the information displays 502a and 502b indicate various types of imaging information related to imaging (e.g., currently set setting values and the type of the inserted recording medium 200). Since the amount of information increases in addition to the information displays 501a to 501c, the user can visually observe more imaging information. At the same time, the visibility of the LV images may decrease. When the display mode switching button 83 is pressed in the state shown in Figure 5B , the display mode changes to the display mode shown in Figure 5C .

[0092] Figure 5C The figure illustrates a display mode for the case where the flag N = 3. In Figure 5C , in addition to the LV images 500R and 500L, an information display 503 that is a histogram of the currently captured LV image, and information displays 501a to 501c, 502a, and 502b are also shown. The information display 503 is a graph with the horizontal axis being brightness and the vertical axis being the number of pixels. The information display 503 provides a rough indication of the brightness level of the currently captured LV image, the trend of the exposure level, and the gradation of the entire LV image. Since some users may want to check during imaging, the information display 503 is shown. The information display 503 is superimposed on a relatively large area of the LV image 500L, resulting in a decrease in visibility. When the display mode switching button 83 is pressed in the state shown in Figure 5C , the display mode changes to the display mode shown in Figure 5D .

[0093] Figure 5D The figure illustrates a display mode for the case where the flag N = 4. In the display mode of Figure 5D , the information displays 501a to 501c, 502a, 502b, and 503 are all hidden, and only the LV images 500R and 500L are shown. This display enables the user to perform image capture while visually observing only the LV images without being troubled by various types of imaging information. When the display mode switching button 83 is pressed in the state shown in Figure 5D , the display mode changes to the display mode shown in Figure 5E .

[0094] Figure 5E The figure illustrates a display mode for the case where the flag N = 5. In the display mode of Figure 5E , the LV images 500R and 500L are not shown, and only imaging-related information is shown in a table-like format. InFigure 5E When the display mode switching button 83 is pressed in the state shown in, when the dual lens unit is attached, the display mode changes to Figure 5F the mode shown in, and when the single lens unit is attached or the lens unit is not installed, the display mode changes to Figure 5A the mode shown in.

[0095] Figure 5F illustrates the display mode in the case where the flag N = 6 ( Figure 4 step S407 in ). Specifically, in the case where the dual lens unit is attached to the digital camera 100, this display mode is entered. Here, the display unit 28 displays the LV images 500R and 500L, the information displays 505 and 506, and the zoom frame 511, the focus guide 512, and the magic windows 513R and 513L (collectively referred to as the magic window 513 hereinafter) superimposed on the LV images. The information display 505 or the "R" indicating right indicates that the LV image 500R is the LV image (right image) captured by the right optical system 301R. The information display 506 or the "L" indicating left indicates that the LV image 500L is the LV image (left image) captured by the left optical system 301L.

[0096] In an optical system such as the optical system of the digital camera 100, the image captured by the image sensor (imaging unit 22) is vertically inverted. The vertically inverted image is vertically inverted by 180° and displayed on the display unit 28 or the EVF 29. Considering this structure, the case of image capturing using a lens unit (dual lens unit) including the left optical system 301L and the right optical system 301R shown in Figure 3 will be described. As described above, if the two LV images captured via the left optical system 301L and the right optical system 301R and input to the imaging unit 22 are displayed on the display unit 28 without being inverted, a vertically inverted LV image will be displayed, which will impair usability. Therefore, like the case of attaching a single lens unit, the two LV images input to the imaging unit 22 are inverted.

[0097] However, when reverse processing is performed, the two LV images are displayed on the display unit 28 in such a manner that the LV image obtained via the right optical system 301R (right image) is displayed in the left region and the LV image obtained via the left optical system 301L (left image) is displayed in the right region. Specifically, in the present exemplary embodiment, since two LV images are captured using one image sensor (imaging unit 22), the processing load for identifying the boundary between the two LV images on the image sensor and swapping the left and right LV images is high in the system control unit 50. Therefore, the LV image input to the imaging unit 22 is vertically inverted by 180° and displayed on the display unit 28 without swapping the left and right images.

[0098] When two LV images are displayed on the display unit 28, the user generally assumes that the LV image displayed in the left region is the image captured by the left optical system 301L, and the LV image displayed in the right region is the image captured by the right optical system 301R. In other words, without the information displays 505 and 506, the user may be mistaken about the fact that the left and right LV images are horizontally reversed, and may be confused during imaging unless the user is aware of the horizontal reversal. Therefore, the display of the information displays 505 and 506 enables the user to clearly and visually identify which LV image is captured by the left optical system 301L and which LV image is captured by the right optical system 301R.

[0099] The zoom frame 511 superimposed on the LV image 500L is a frame display indicating the area to be magnified in the LV image 500L in response to a zoom instruction issued by the user (to be described in step S801 of Figure 8A . The focus guide 512 includes a frame indicating the focus detection area and an indicator showing the degree of focus on the subject at the position overlapping the frame using marker or color information. In the present exemplary embodiment, the degree of focus is represented by three markers displayed above or below the focus detection area. Figure 5F The focus guide 512 in shows the subject in an out-of-focus state and in a back-focus state (the focus position is behind the subject and the subject is out of focus) at the position where the frame is displayed. When the subject is out of focus, the focus guide 512 is displayed in white. Once the in-focus state is achieved, the three markers become two markers, and the focus guide 512 is displayed in green.

[0100] The magic window 513 is an indicator displayed on the display unit 28 and indicates the area initially displayed before the user moves the viewing point. The magic window 513 indicates the area initially displayed before the user moves the viewing point when generating a 180-degree image (hemispherical image) from the LV images 500R and 500L and reproducing the 180-degree image on a browser or an HMD. Since the magic window 513 is displayed on the LV images 500R and 500L, the area to be initially displayed during playback can be visually observed during imaging - that is, the initial area viewed by the viewer. Therefore, the user can more effectively capture an image of a desired subject in a desired composition.

[0101] The magic window 513 is an indicator for generating a 180-degree image - that is, a special indicator considered to be particularly useful for the user when taking images using the dual-lens unit attached to the digital camera 100. Therefore, it is not displayed when a single-lens unit is attached. Figure 5F the display mode shown in. Since the magic window 513 is displayed at a fixed position, after the user views the area of the magic window 513, it is not necessary to continuously display the magic window 513 during subsequent imaging operations.

[0102] In the present exemplary embodiment, the zoom frame 511 and the focus guide 512 are superimposed on one of the LV images 500R and 500L. The magic window 513 is superimposed on each of the LV images 500R and 500L. The zoom frame 511 indicates the position to be magnified and thus is expected to be displayed separately. In contrast, the focus guide 512 can be displayed on each of the two LV images rather than on one of them.

[0103] Next, the processing in the case of a touch-down operation on the touch panel 70a will be described. The system control unit 50 of the digital camera 100, in response to a touch-down operation on the touch panel 70a during image display, displays items related to focus control and items indicating the zoom area in the image. In the case where the lens unit attached to the digital camera 100 is not a dual-lens unit (but a conventional single-lens unit), the system control unit 50 displays a focus guide indicating the degree of focus or an AF frame indicating the AF target area at the position corresponding to the touch-down. In the case where the lens unit attached to the digital camera 100 is a dual-lens unit, the system control unit 50, in response to the touch-down operation, displays a focus guide (return to center) indicating the degree of focus at the center of either the area where the left image is displayed or the area where the right image is displayed. The system control unit 50 also displays a zoom frame indicating the zoom area at the position corresponding to the touch-down. In the case where the lens unit attached to the digital camera 100 is a dual-lens unit, the system control unit 50 displays the zoom frame at a position that does not include both the left image and the right image.

[0104] In step S410, the system control unit 50 determines whether a touch-down operation is performed on the touch panel 70a. In the case where a touch-down operation is performed (Yes in step S410), the system control unit 50 stores the coordinates (xt, yt) indicating the position (touch position) of the press operation, and the process proceeds to step S411. In the case where a touch-down operation is not performed (No in step S410), the process proceeds to Figure 6A step S601.

[0105] In step S411, similar to step S404, the system control unit 50 determines whether the lens unit attached via the communication terminals 6 and 10 is a dual-lens unit. In the case where the attached lens unit is a dual-lens unit (Yes in step S411), the process proceeds to step S412. In the case where the attached lens unit is not a dual-lens unit (No in step S411), the process proceeds to step S421.

[0106] In step S412, the system control unit 50 determines whether the touch position (touch-down position) of the touch-down operation performed on the touch panel 70a in step S410 falls within the right region (region 701R) of the dual-lens image. Figure 7A and Figure 7B are schematic diagrams showing exemplary displays of the dual-lens image. In the case where the touch position falls within the right region (region 701R) (Yes in step S412), the process proceeds to step S413. In the case where the touch position falls within the left region (region 701L) (No in step S412), the process proceeds to step S417. Line 705 is the boundary line between the LV images (LV 700R and LV 700L) captured by the right optical system 301R and the left optical system 301L, respectively. In the present exemplary embodiment, line 705 is the midline dividing the imaging unit 22 into two regions, i.e., the left region and the right region.

[0107] In step S413, the system control unit 50 displays a focus guide at the center of the right region (returns the display position to the center). In the case where the focus guide has been superimposed on the LV image in the left region or the right region, the focus guide is moved to the center of the right region (the center of the LV image captured by the left optical system 301L and displayed in the right region). Here, Figure 5FThe focus guide 512 in [description] is a display example. The focus guide includes a frame indicating the focus detection area and a plurality of marks indicating the degree of focus in the focus detection area by using the relationship between the respective display positions of the marks. Based on the relationship between the display positions of the marks, the user can visually observe whether the subject at the display position of the focus detection area is in focus, how much the subject is out of focus, and on which side (forward or backward) the subject in the focus detection area is out of focus when the subject is out of focus. The display mode of the focus guide is not limited to the above configuration. For example, the focus guide can use colors to indicate the degree of focus.

[0108] In step S414, the system control unit 50 determines whether the touch position of the touch operation on the touch panel 70a in step S410 is near the boundary. Specifically, the system control unit 50 determines whether the touch position falls within the area between the line 705 shown in [description] and the line at a predetermined distance to the right of the line 705. When the touch position falls within the area (Yes in step S414), the process proceeds to step S415. When the touch position does not fall within the area (No in step S414), the process proceeds to step S416. Here, the predetermined distance is half of the horizontal length of the zoom frame. The predetermined distance can be freely set. The position on the touch panel 70a is represented by the xy coordinate system. Let the x coordinate of the line at a predetermined distance to the right of the line 705 be represented by the coordinate Rmin. In other words, when the x component of the center coordinate of the zoom frame is the coordinate Rmin, the left side of the zoom frame contacts (overlaps) the line 705. When the x component of the center coordinate of the zoom frame is less than the coordinate Rmin - that is, when it falls within the area 702R, the zoom frame straddles the boundary between the left area and the right area. Figure 7A and Figure 7B In step S415, the system control unit 50 displays the zoom frame with its center at the coordinates (Rmin, yt). By such control, even when the user performs a touch operation near the line 705, the zoom frame is displayed in a state where it does not straddle the line 705 and includes only the image in the right area.

[0109] In step S416, the system control unit 50 displays the zoom frame with its center at the coordinates (xt, yt) of the touch position.

[0110] In step S417, the system control unit 50 displays the focus guide at the center of the left area (the center of the LV image displayed in the left area captured by the right optical system 301R). When the focus guide has been superimposed on the LV image, the system control unit 50 moves the focus guide to the center of the left area.

[0111]

[0112] ​In step S418, the system control unit 50 determines whether the touch position of the touch operation performed on the touch panel 70a in step S410 falls within the region between the line 705 shown in Figure 7A and Figure 7B and the line at a predetermined distance to the left of the line 705. When the touch position falls within the region (Yes in step S418), the process proceeds to step S419. When the touch position does not fall within the region (No in step S418), the process proceeds to step S420. As described in step S414, the predetermined distance is half of the horizontal length of the zoom frame. The predetermined distance can be freely set by the user. Here, the x coordinate of the line at a predetermined distance to the left of the line 705 is represented by the coordinate Lmax. In other words, when the x component of the center coordinate of the zoom frame is the coordinate Lmax, the right side of the zoom frame contacts (overlaps) the line 705. When the x component of the center coordinate of the zoom frame is greater than the coordinate Lmax - that is, when it falls within the region 702L, the zoom frame straddles the boundary between the left region and the right region.

[0113] In step S419, the system control unit 50 causes the center of the zoom frame to be located at the coordinates (Lmax, yt) to display the zoom frame.

[0114] In step S420, the system control unit 50 causes the center of the zoom frame to be located at the coordinates (x, yt) of the touch position to display the zoom frame.

[0115] Through the above control, even when the user designates the position of the zoom frame by performing a touch operation on the region near the line 705, it is possible to prevent the focus frame from being displayed in both the left region and the right region. If the focus frame is displayed in both the left region and the right region and the user performs a zoom operation (presses the zoom button 78), as described below, the boundary between the left LV image and the right LV image is enlarged, which may confuse the user. Therefore, according to the present exemplary embodiment, it is possible to prevent the focus frame from being displayed in both the left region and the right region.

[0116] Next, the control in response to a touch operation when the lens attached to the digital camera 100 is not a dual-lens unit (but a single-lens unit) will be described.

[0117] In step S421, the system control unit 50 refers to the non-volatile memory 56 and determines whether the focus mode is set to the AF mode or the manual focus (MF) mode. When the focus mode is set to the MF mode (No in step S421), the process proceeds to step S422. When the focus mode is set to the AF mode (Yes in step S421), the process proceeds to step S423. When the focus mode is the MF mode and the focus guide display is set to "ON", the system control unit 50 displays a focus guide to assist focusing by MF operation.

[0118] In step S422, the system control unit 50 moves the focus guide to the touch position specified by the user in step S410.

[0119] In step S423, the system control unit 50 displays an AF frame indicating the in-focus position at the touch position specified by the user in step S410.

[0120] In step S424, the system control unit 50 displays a zoom frame at the touch position of the touch-down operation performed in step S410.

[0121] In other words, when the lens unit attached to the digital camera 100 is not a dual lens unit (but a single lens unit), the zoom frame and the focus guide are displayed at the touch position of the user regardless of the setting of the focus mode. The zoom frame is displayed in a manner associated with the focus detection area indicated by the AF frame and the focus guide. On the contrary, when a dual lens unit is attached, the display position of the zoom frame is not associated with the focus detection area indicated by the focus guide.

[0122] In the present exemplary embodiment, when a dual lens unit is attached, the display position of the focus guide is fixed to the center of the display area of the left LV image or the right LV image. If the display positions of the focus guide and the zoom frame move synchronously with each other, the zoom area is limited to the central area of the LV image, resulting in poor usability. In addition, when a dual lens unit is attached, two LV images are displayed on the display unit 28. Therefore, the size of each LV image is less than or equal to half of the size of the LV image when a single lens unit is attached. Therefore, compared with the case of installing a single lens unit, the user may zoom in on the LV image and check the LV image in more detail more often. Therefore, the zoom frame (i.e., the zoom area of the LV image) is not associated with the focus guide so that the user can freely check the desired position.

[0123] The focus guide can be configured not to be fixed to the center. Even in such a case, when the dual-lens unit is attached, the focus guide and the zoom frame do not move synchronously with each other. A user who fine-tunes the focus using the focus guide may also want to zoom in on a position other than the focus position to observe more details. For example, in a case where the user wants to zoom in on the inner area of the aforementioned magic window or an area near the periphery of the LV image displayed in a circular fisheye and observe the magnified area, not associating the position of the focus guide with the position of the zoom frame provides better operability for the user.

[0124] Figure 6A And Figure 6B is a control flowchart of the display control of the digital camera 100 in a case where an operation unit capable of issuing a direction instruction according to the present exemplary embodiment is operated.

[0125] During the display of the dual-lens image and items, the system control unit 50 of the digital camera 100 moves the position of an item such as a zoom frame (specifying the position of the item) in the dual-lens image in response to a direction instruction. In a case where the lens unit attached to the digital camera 100 is not a dual-lens unit (but a conventional single-lens unit), the system control unit 50 moves the focus guide or the AF frame and the zoom frame based on the direction instruction.

[0126] In a case where the lens unit attached to the digital camera 100 is a dual-lens unit, the system control unit 50 moves the zoom frame based on the direction instruction. Here, the system control unit 50 does not move the focus guide. Further, the zoom frame is displayed in the right region of the display unit 28 in a manner that does not include both the left image and the right image. In response to an instruction to move the zoom frame, which is displayed near the boundary, to the left, the system control unit 50 moves the display position of the zoom frame to the left region. The zoom frame is displayed in the left region of the display unit 28 in a manner that does not include both the left image and the right image. In response to an instruction to move the zoom frame, which is displayed near the boundary, to the right, the system control unit 50 moves the display position of the zoom frame to the right region.

[0127] In step S601, the system control unit 50 determines whether a direction instruction has been issued using the multi-controller (MC) 82 or the direction key 74 of the operation unit 70. In a case where a direction instruction has been issued (Yes in step S601), the process proceeds to step S602. In a case where no direction instruction has been issued (No in step S601), the process proceeds to step S617.

[0128] In step S602, similar to step S411, the system control unit 50 obtains the type of the lens unit attached via communication terminals 6 and 10, and determines whether the lens unit is a dual-lens unit. If the attached lens unit is a dual-lens unit (Yes in step S602), the process proceeds to step S607. If the attached lens unit is not a dual-lens unit (No in step S602), the process proceeds to step S603.

[0129] In step S603, similar to step S421, the system control unit 50 determines whether the current set focus mode of the digital camera 100 is the AF mode or the MF mode. If the current focus mode is the AF mode (Yes in step S603), the process proceeds to step S604. If the current focus mode is the MF mode (No in step S603), the process proceeds to step S605. When the current set focus mode is the MF mode and the focus guide display for assisting MF focusing is set to "ON", the system control unit 50 superimposes the focus guide on the LV image displayed on the display unit 28.

[0130] In step S604, the system control unit 50 moves the AF frame displayed on the display unit 28 in the direction indicated in step S601.

[0131] In step S605, the system control unit 50 moves the focus guide displayed on the display unit 28 in the direction indicated in step S601. When moving the entire focus guide during this process, the frame indicating the focus detection area can be moved instead of moving the entire focus guide. If the focus guide display setting is set to "OFF" by user settings, step S605 is skipped.

[0132] In step S606, the system control unit 50 moves the zoom frame displayed on the display unit 28 in synchronization with the position of the AF frame or the frame indicating the focus detection area of the focus guide moved in step S604 or S605.

[0133] In step S607, the system control unit 50 determines whether the direction instruction issued using the MC 82 or the direction key 74 and determined in step S601 is to the right. If the direction instruction is to the right (Yes in step S607), the process proceeds to step S608. If not (No in step S607), the process proceeds to step S611.

[0134] In step S608, the system control unit 50 determines whether the x coordinate of the center of the zoom frame before the direction instruction is issued in step S601 is the coordinate Lmax. When the x coordinate of the center is the coordinate Lmax (Yes in step S608), the process proceeds to step S609. When the x coordinate of the center is not the coordinate Lmax (No in step S608), the process proceeds to step S610. If the x coordinate of the center of the zoom frame before the direction instruction is issued is Lmax, the right side of the zoom frame contacts the line 705 before the direction instruction is input.

[0135] In step S609, the system control unit 50 moves the zoom frame to a position where the center of the focus frame is the coordinate (Rmin, y coordinate before the direction instruction). In other words, when the zoom frame is displayed in the left area such that the right side of the zoom frame contacts the line 705 and an instruction to move the zoom frame further to the right is input, the zoom frame is moved to the right area. This control prevents the zoom frame from being displayed in both the left area and the right area.

[0136] In this step, since the determination in step S602 is Yes, the dual lens unit is attached to the digital camera 100. Accordingly, two LV images are displayed on the display unit 28 and are displayed in the corresponding left half and right half of the display unit 28. When moving the zoom frame, if the display position of the zoom frame is controlled and allowed to include both the left area and the right area by crossing the line 705 shown in Figure 7A and Figure 7B when the user issues a zoom instruction, an enlarged image including both the left LV image and the right LV image is displayed, which may confuse the user. Accordingly, when moving the zoom frame and when the left or right side of the zoom frame reaches the boundary between the left area and the right area indicated by the line 705, the entire zoom frame is displayed in one of the left area and the right area so that the zoom frame does not cross the line 705 (does not include both the left area and the right area).

[0137] In step S610, the system control unit 50 moves the display position of the zoom frame to the right. Here, the amount of movement in response to one direction instruction of the display position is one pixel of the display unit 28. When the right side of the zoom frame reaches the right side of the area 701R (the right end of the display unit 28) and a rightward movement instruction (direction instruction) is issued, the system control unit 50 does not move the zoom frame.

[0138] In step S611, the system control unit 50 determines whether the direction instruction issued using the MC 82 or the direction key 74 and determined in step S601 is to the left. When the direction instruction is to the left (Yes in step S611), the process proceeds to step S612. If not (No in step S611), the process proceeds to S615.

[0139] In step S612, the system control unit 50 determines whether the x coordinate of the center of the zoom frame before the direction instruction is issued in step S601 is the coordinate Rmin. When the x coordinate of the center is the coordinate Rmin (Yes in step S612), the process proceeds to step S613. When the x coordinate of the center is not the coordinate Rmin (No in step S611), the process proceeds to step S614. When the x coordinate of the center of the zoom frame before the direction instruction is issued is the coordinate Rmin, the left side of the zoom frame contacts the line 705 before the direction instruction is input.

[0140] In step S613, the system control unit 50 moves the zoom frame to a position where the center of the zoom frame is the coordinate (Lmax, the y coordinate before the direction instruction). In other words, when the zoom frame is displayed in the right area such that the left side of the zoom frame contacts the line 705, in response to the input of an instruction to move the zoom frame further to the left, the zoom frame is moved to the left area. This control prevents the zoom frame from being displayed in both the left area and the right area.

[0141] In step S614, the system control unit 50 moves the display position of the zoom frame to the left. Here, the amount of movement of the display position in response to one direction instruction is one pixel of the display unit 28. When the left side of the zoom frame reaches the left side of the area 701L (the left end of the display unit 28) and a leftward movement instruction is issued, the system control unit 50 does not move the zoom frame.

[0142] In step S615, the system control unit 50 determines whether the direction instruction issued using the MC 82 or the direction key 74 and determined in step S601 is up or down. When the direction instruction is up or down (Yes in step S615), the process proceeds to step S616. When the direction instruction is neither up nor down (No in step S615), the process proceeds to S617.

[0143] In step S616, the system control unit 50 moves the display position of the zoom frame in the indicated vertical direction. Here, the amount of movement of the display position in response to one direction instruction is one pixel of the display unit 28.

[0144] In the case where the system control unit 50 determines in step S602 that the dual lens unit is to be attached to the digital camera 100, the zoom frame is moved in response to a movement instruction (direction instruction), but the focus guide is not moved from its currently displayed position. That is, the movement based on the direction instruction in steps S609, S610, S613, S614, and S616 is only the movement of the zoom frame, and the focus guide remains in place (fixed to the center of the LV image in the area where the focus guide is displayed).

[0145] The processing procedure for the movement control of items such as the zoom frame and the focus guide in the case where a direction instruction is input using the MC 82 or the direction keys 74 has been described.

[0146] Next, the control in the case where an operation for restoring the display positions of items such as the zoom frame and the focus guide to their predetermined positions is performed will be described. The system control unit 50 displays items such as the zoom frame and the focus guide at a predetermined position in response to a predetermined operation (pressing the MC 82 or the setting button 75). In the case where a dual lens image is being displayed, the system control unit 50 displays the item at the center of the right area or the left area of the displayed item before the predetermined operation in response to the predetermined operation. On the other hand, in the case where a dual lens image is not being displayed, the system control unit 50 displays the item at the center of the screen in response to the predetermined operation. Therefore, the display position of the item can be appropriately controlled based on the determination of whether the displayed image is a dual lens image.

[0147] In step S617, the system control unit 50 determines whether the center of the MC 82 (instead of an up, down, left, or right movement operation) is pressed or the setting button 75 is pressed. In the case where the center of the MC 82 or the setting button 75 is pressed (in step S617, "yes"), the process proceeds to step S618. In the case where neither the center of the MC 82 nor the setting button 75 is pressed (in step S617, "no"), the process proceeds to Figure 8A step S801. The pressing of the center of the MC 82 or the setting button 75 in this step can be determined as a center movement instruction for moving the currently displayed zoom frame to the center of the LV image in the area where the zoom frame is displayed (center return).

[0148] In step S618, similar to step S411, the system control unit 50 obtains the type of the lens unit attached via the communication terminals 6 and 10, and determines whether the attached lens unit is a dual lens unit. In the case where the attached lens unit is a dual lens unit (in step S618, "yes"), the process proceeds to step S623. In the case where the attached lens unit is not a dual lens unit (in step S618, "no"), the process proceeds to step S619.

[0149] In step S619, similar to step S421, the system control unit 50 determines whether the current focus mode setting of the digital camera 100 is the AF mode or the MF mode. When the current focus mode is set to the AF mode (Yes in step S619), the process proceeds to step S620. When the current focus mode is set to the MF mode (No in step S619), the process proceeds to step S621.

[0150] In step S620, the system control unit 50 moves the AF frame to the center of the LV image displayed on the display unit 28.

[0151] In step S621, the system control unit 50 moves the focus guide to the center of the LV image displayed on the display unit 28.

[0152] In step S622, the system control unit 50 moves the zoom frame to the center of the LV image displayed on the display unit 28 in synchronization with the position of the AF frame or the focus detection area of the focus guide.

[0153] In step S623, the system control unit 50 determines whether the zoom frame is displayed on the LV image in the right area. In other words, the system control unit 50 determines whether the zoom frame is displayed in the area 701R shown in Figure 7B . When the system control unit 50 determines that the zoom frame is displayed in the area 701R (Yes in step S623), the process proceeds to step S625. When the system control unit 50 determines that the zoom frame is not displayed in the area 701R (No in step S623), the process proceeds to step S624.

[0154] In step S624, the system control unit 50 moves the display position of the zoom frame to the center of the LV image displayed in the left area. Specifically, the system control unit 50 moves the zoom frame to the center of the LV image displayed in the area 701L shown in Figure 7B .

[0155] In step S625, the system control unit 50 moves the display position of the zoom frame to the center of the LV image displayed in the right area. Specifically, the system control unit 50 moves the zoom frame to the center of the LV image displayed in the area 701R shown in Figure 7B .

[0156] The processing procedure of the control in the case of performing an operation for restoring the display positions of items such as the zoom frame and the focus guide to their predetermined positions has been described.

[0157] Next, the zoom processing and the zoom magnification change processing to be performed when the zoom button 78 is pressed will be described.

[0158] Figure 8A and Figure 8B is a control flowchart for operations of magnifying and displaying an LV image shown on the display unit 28 and a photographing operation according to this exemplary embodiment. It will be described with reference to Figures 9A to 9F to describe the display example of the display unit 28 when executing the control flowchart of Figure 8A and Figure 8B . After describing the control flowcharts of Figure 8A and Figure 8B , the details of the display example shown in Figures 9A to 9F will be described below.

[0159] In step S801, the system control unit 50 determines whether the zoom button 78 is pressed. If the zoom button 78 is pressed (Yes in step S801), the process proceeds to step S802. If the zoom button 78 is not pressed (No in step S801), the process proceeds to step S819. In this exemplary embodiment, a zoom instruction is issued by pressing the zoom button 78, and the zoom button 78 is a physical component configured to be pressed. However, a zoom instruction can also be issued by a pinching-in operation on the touch panel 70a, and the enlarged display can be canceled by a pinching-out operation on the touch panel 70a.

[0160] In step S802, similar to step S411, the system control unit 50 obtains the type of the lens unit attached via the communication terminals 6 and 10, and determines whether the attached lens unit is a dual-lens unit. If the system control unit 50 determines that the attached lens unit is a dual-lens unit (Yes in step S802), the process proceeds to step S803. If the system control unit 50 determines that the attached lens unit is not a dual-lens unit (No in step S802), the process proceeds to step S812.

[0161] In step S803, the system control unit 50 magnifies the LV image at the position of the display zoom frame by 6 times and displays the magnified LV image on the display unit 28. The size of the zoom frame displayed before the zoom process is preset so that when the zoom process is performed at a zoom magnification of 6 times, the entire magnified image is displayed on the display unit 28. Based on the state where the LV image displayed on the display unit 28 is not magnified (x1 zoom), the zoom magnification of 6 times in this process is determined. Figure 9C and Figure 9D illustrate the enlarged display example in this process.

[0162] In step S804, the system control unit 50 determines whether an operation of moving the zoom position (magnification area) has been performed. If an operation of moving the zoom position has been performed (Yes in step S804), the process proceeds to step S805. If an operation of moving the zoom position has not been performed (No in step S804), the process proceeds to step S806. As described in the control flowcharts with reference to Figure 6A and Figure 6B , the operation of moving the zoom position is performed by using the direction instructions issued by the 82 or the direction keys 74. The operation can also be performed by operating the touch panel 70a.

[0163] In step S805, based on the operation of moving the zoom position in step S804, the system control unit 50 moves the zoom position within the current magnification area in the left and right display areas of the LV image displayed on the display unit 28. In other words, even when the target area of the zoom process contacts the line 705 in either the left area or the right area and a moving operation is performed to make the center of the zoom frame closer to the line 705, the system control unit 50 determines that the moving operation is invalid and does not move the zoom position.

[0164] As described in steps S607 to S614, since in the state where the LV image is at x1 zoom, the user can visually observe the zoom frame and the movement of the zoom frame displayed on the display unit 28, even under the control of moving the zoom frame from one display area to another, the user will not lose the track of the zoom frame. On the contrary, when the zoom position moves from one area to another when the enlarged image is displayed, it is difficult for the user to intuitively understand which position of the enlarged image is being displayed.

[0165] Taking the example where the user wants to observe the left end of the LV image in the right area (the left side of the zoom frame that contacts the line 705) for a more detailed description. When the user is observing the enlarged display of the left end part of the LV image in the right area, if the user inadvertently performs an operation of moving the zoom frame and the part to be enlarged and displayed is switched to the right end part of the LV image in the left area, the user may be confused. Therefore, in the state of displaying the enlarged image, when the user issues an instruction to move the zoom position and the zoom position is at the end of the LV image, the system control unit 50 does not move the zoom position across the left area and the right area.

[0166] In step S806, the system control unit 50 determines whether a left-right switching operation has been performed. If a left-right switching operation has been performed (Yes in step S806), the process proceeds to step S807. If no left-right switching operation has been performed (No in step S806), the process proceeds to step S808. The left-right switching operation refers to an operation of switching from one of a left image and a right image of two horizontally arranged images to the other. Specifically, the left-right switching operation refers to pressing a button having a left-right switching function (for example, an information button (not shown)).

[0167] In step S807, the system control unit 50 moves the zoom position from the area where the zoom position was set before pressing the button having the left-right switching function to another area, and provides a magnified display. In this process, the zoom position is moved in such a way that the relative position of the zoom position in the area where the zoom position was set before pressing the button having the left-right switching function remains unchanged after moving to another area. For example, when the LV image in the right area is magnified, the system control unit 50 calculates the distance from the center of the LV image in the right area to the zoom position. In response to the left-right switching operation performed by the user, the system control unit 50 applies the calculated distance from the center of the LV image to the zoom position to the distance from the center of the LV image in another area (here, the left area) to determine the zoom position and display the magnified image on the display unit 28.

[0168] Under such control, a user who wants to check the same position of the two LV images displayed in the left area and the right area can easily switch between the left LV image and the right LV image with fewer operations. This reduces the imaging inspection time.

[0169] In step S808, the system control unit 50 determines whether the zoom button 78 has been pressed.

[0170] If the zoom button 78 has been pressed (Yes in step S808), the process proceeds to step S809. If the zoom button 78 has not been pressed (No in step S808), the process proceeds to step S804.

[0171] In step S809, the system control unit 50 refers to the system memory 52 and determines whether the magnification of the LV image displayed on the display unit 28 is 15 times. If the zoom magnification is 15 times (Yes in step S809), the process proceeds to step S810. If the zoom magnification is not 15 times (No in step S809), the process proceeds to step S811.

[0172] In step S810, the system control unit 50 cancels the enlarged state of the LV image and displays the non-enlarged (x1 zoom) LV image on the display unit 28. Figure 9A and Figure 9B A display example here is illustrated.

[0173] In step S811, the system control unit 50 enlarges the LV image at the display position of the zoom frame superimposed on the LV image to a zoom magnification of 15 times and displays the enlarged image. Based on the non-enlarged state (x1 zoom) of the LV image displayed on the display unit 28, the 15-fold zoom magnification in this process is determined. Figure 9E and Figure 9F A display example here is illustrated.

[0174] In step S812, the system control unit 50 enlarges the LV image at the display position of the zoom frame superimposed on the LV image to a zoom magnification of 6 times and displays the enlarged image on the display unit 28. Based on the non-enlarged state (x1 zoom) of the LV image displayed on the display unit 28, the 6-fold zoom magnification in this process is determined.

[0175] In step S813, similar to step S804, the system control unit 50 determines whether an operation of moving the zoom position has been performed. If an operation of moving the zoom position has been performed (Yes in step S813), the process proceeds to step S814. If an operation of moving the zoom position has not been performed (No in step S813), the process proceeds to step S815.

[0176] In step S814, the system control unit 50 moves the zoom position within the display area of the LV image based on the operation of moving the zoom position. In this step, since the determination in step S802 is No, the lens unit attached to the digital camera 100 is a single-lens unit. In other words, since only one LV image is displayed on the display unit 28, the zoom position can be moved without considering the determination of whether the area is left or right as in step S805.

[0177] In step S815, similar to step S808, the system control unit 50 determines whether the zoom button 78 has been pressed. If the zoom button 78 has been pressed (Yes in step S815), the process proceeds to step S816. If the zoom button 78 has not been pressed (No in step S815), the process returns to step S813.

[0178] In step S816, the system control unit 50 refers to the system memory 52 and determines whether the current zoom magnification of the LV image is 15 times. When the current zoom magnification is 15 times (Yes in step S816), the process proceeds to step S817. When the current zoom magnification is not 15 times (No in step S816), the process proceeds to step S818.

[0179] In step S817, similar to step S810, the system control unit 50 cancels the enlarged state of the LV image and displays the non-enlarged (xl zoom) LV image on the display unit 28.

[0180] In step S818, the system control unit 50 enlarges the LV image at the display position of the zoom frame superimposed on the LV image to a zoom magnification of 15 times and displays the enlarged image on the display unit 28. Based on the state where the LV image displayed on the display unit 28 is not enlarged (x1 zoom), the zoom magnification of 15 times is determined in this process.

[0181] In step S819, the system control unit 50 determines whether the first shutter switch 62 is turned on. When the first shutter switch 62 is turned on (Yes in step S819), the process proceeds to step S820. When the first shutter switch 62 is not turned on (No in step S819), the process proceeds to step S829. The first shutter switch 62 being turned on means that the shutter button 61 is half-pressed as described above. In other words, it can be determined that the user is about to take an image.

[0182] In step S820, similar to step S411, the system control unit 50 obtains the type of the lens unit attached via the communication terminals 6 and 10 and determines whether the attached lens unit is a dual-lens unit. When the system control unit 50 determines that the attached lens unit is a dual-lens unit (Yes in step S820), the process proceeds to step S823. When the system control unit 50 determines that the attached lens unit is not a dual-lens unit (No in step S820), the process proceeds to step S821.

[0183] In step S821, the system control unit 50 determines whether the focus mode is set to the AF mode. When the focus mode is set to the AF mode (Yes in step S821), the process proceeds to step S822. When the focus mode is not set to the AF mode (the focus mode is set to the MF mode) (No in step S821), the process proceeds to step S823. The AF mode and the MF mode are switched via the setting menu screen or by using a switch provided outside the lens unit 150.

[0184] In step S822, the system control unit 50 performs AF processing based on the position of the AF frame.

[0185] In step S823, the system control unit 50 performs other imaging preparation processes including AE and AWB processing.

[0186] In step S824, the system control unit 50 determines whether the second shutter switch 64 is turned on. When the second shutter switch 64 is turned on - that is, when the shutter button 61 is fully pressed (in step S824, "Yes"), the process proceeds to step S825. When the second shutter switch 64 is not turned on (in step S824, "No"), the process proceeds to step S828.

[0187] In step S825, similar to step S411, the system control unit 50 obtains the type of the lens unit attached via the communication terminals 6 and 10, and determines whether the attached lens unit is a dual lens unit. When the system control unit 50 determines that the attached lens unit is a dual lens unit (in step S825, "Yes"), the process proceeds to step S826. When the system control unit 50 determines that the attached lens unit is not a dual lens unit (in step S825, "No"), the process proceeds to step S827.

[0188] In step S826, the system control unit 50 performs a series of imaging processes until the image captured by the dual lens unit and the dual lens information are recorded as an image file on the recording medium 200.

[0189] In step S827, the system control unit 50 performs a series of imaging processes until the captured image and the normal (single) lens information are recorded as an image file on the recording medium 200.

[0190] In step S828, the system control unit 50 determines whether the first shutter switch 62 remains turned on. When the system control unit 50 determines that the first shutter switch 62 remains turned on (in step S828, "Yes"), the process returns to step S824. If it does not remain turned on (in step S828, "No"), the process proceeds to S829.

[0191] In step S829, the system control unit 50 determines whether any operation other than the aforementioned operations is detected. When any other operation is detected (in step S829, "Yes"), the process proceeds to step S830. When no other operation is detected (in step S829, "No"), the process proceeds to step S831. Specifically, the system control unit 50 determines whether the menu button 81 or the play button 79 is pressed.

[0192] In step S830, the system control unit 50 starts processing corresponding to the detected operation. When the menu button 81 is pressed, the system control unit 50 displays a setup menu screen. When the playback button 79 is pressed, the system control unit 50 displays the images stored in the recording medium 200.

[0193] In step S831, the system control unit 50 determines whether the imaging standby state has ended. For example, when the imaging standby state ends due to a power failure (yes in step S831), Figure 8A and Figure 8B the control flowchart ends. When the system control unit 50 determines that the imaging standby state has not ended (no in step S831), the process returns to Figure 4 step S401.

[0194] Reference will be made to Figures 9A to 9F describe the LV image displayed on the display unit 28 when the user issues a zoom instruction.

[0195] Figure 9A The figure shows a display example where the magnification is xl (i.e., no zoom) and the zoom frame 903 is superimposed on the left area (i.e., the LV image (LV 900R) captured via the right optical system 301R). The display unit 28 displays LV 900R captured via the right optical system 301R and LV 900L captured via the left optical system 301L. As described above, LV 900R displayed in the left area is the LV image captured via the right optical system 301R, and LV 900L displayed in the right area is the LV image captured via the left optical system 301L.

[0196] The display items 901 and 902 are displayed to notify the user of horizontal inversion. The display item 901 displays "R", indicating right. The display item 902 displays "L", indicating left. When Figure 9A in the state shown in Figure 9C the zoom button 78 is pressed once, the state changes to Figure 9B the state shown in

[0197] Figure 9B The figure shows a display example where the zoom magnification is xl (i.e., no zoom) and the zoom frame 904 is superimposed on the right area (i.e., the LV image (LV 900L) captured by the left optical system 301L). In Figure 9B the zoom frame 904 is superimposed on LV 900L. InFigure 9B When the zoom button 78 is pressed once in the state shown in Figure 9D the state shown in Figure 9A is entered. When the left / right switching button is pressed once, the state changes to

[0198] Figure 9C where the zoom frame 904 superimposed on LV900L moves to a position in LV 900R that is similar to the zoom frame 903.

[0199] Figure 9D An example of a display showing LV 900R magnified to a 6x zoom ratio is shown. The display item 901 indicating which optical system captured the magnified image displayed on the display unit 28 is superimposed on LV 910R, which is the magnified LV image. In addition, the zoom frame 913 is superimposed on the 6x magnified image.

[0200] Figure 9E An example of a display showing LV 900L magnified to a 6x zoom ratio is shown. The display item 902 indicating which optical system captured the magnified image displayed on the display unit 28 is superimposed on LV 910L, which is the magnified LV image. In addition, the zoom frame 914 is superimposed on the 6x magnified image.

[0200] Figure 9E An example of a display showing LV 900R magnified to a 15x zoom ratio and displayed as LV 920R is shown.

[0201] The display item 901 indicating the LV image captured by the right optical system 301R is superimposed on LV 920R, which is the 15x magnified image, and is displayed on the display unit 28.

[0202] Figure 9F An example of a display showing LV 900L magnified to a 15x zoom ratio and displayed as LV 920L is shown.

[0203] The display item 902 indicating the LV image captured by the left optical system 301L is superimposed on LV 920L, which is the 15x magnified image, and is displayed on the display unit 28.

[0204] In other words, Figure 9A and Figure 9B show an LV image with a zoom ratio of x1 (i.e., no zoom) displayed on the display unit 28, Figure 9C and Figure 9D show an LV image with a zoom ratio of x6 displayed on the display unit 28, and Figure 9E and Figure 9F show an LV image with a zoom ratio of x15 displayed on the display unit 28.

[0205] Each time the zoom button 78 is pressed, the zoom magnification of the LV image displayed on the display unit 28 is changed in the order of x1, x6, x15, and x1. When the left / right switching button is pressed and the zoom magnification is x1, the display area is switched so that the zoom frame is superimposed on another LV image. Specifically, when the zoom frame is superimposed on the LV 900R displayed in the left area, the display area is switched so that the zoom frame is superimposed on the LV 900L displayed in the right area. When the zoom magnification is different from x1, the zoom position is switched to a position that is more similar in the other LV image area. Here, the zoom magnification remains unchanged.

[0206] In the above description, operations for issuing an instruction to switch the display mode, an instruction to move the zoom frame or the zoom position, and a zoom instruction are performed by using operation buttons having dedicated functions. As another option, functions can be assigned to one or more buttons that can freely assign various functions.

[0207] As described above, when an image is captured using a lens unit including two attached optical systems (dual lens unit), it is prevented that the zoom frame indicating the zoom position of the LV image is displayed on the boundary between the two LV images during imaging. The two LV images captured via the two optical systems are displayed side by side on the display unit 28, and the zoom frame is not displayed on the boundary between the two LV images or moved across the boundary between the two LV images. This can prevent an image including the two LV images from being enlarged and displayed when the user issues a zoom instruction, thereby reducing user confusion.

[0208] In the case where the two LV images are displayed at xl zoom (not magnified), in response to a further rightward movement instruction issued by the user in a state where the zoom frame has reached the right end of the LV image displayed in the left area, the zoom frame is moved to skip the boundary between the two LV images.

[0209] More specifically, the zoom frame is controlled to move from the right end of the LV image in the left area to the left end of the LV image in the right image. This can prevent the area indicated by the zoom frame from including the two LV images and can smoothly move the zoom frame between the two LV images.

[0210] On the other hand, in the case where either of the two LV images is magnified, even if a zoom position movement instruction is further given to the zoom frame that has reached the boundary side end of the current magnified image (the right end in the case where the left area is magnified or the left end in the case where the right area is magnified), the zoom frame does not move in the indicated direction. In other words, in a situation where it is difficult for the user to visually observe the current zoom position, the zoom position does not move outside the area (the boundary between the LV images). This can prevent accidentally crossing the boundary between the LV images and can reduce user confusion.

[0211] When a lens unit (dual lens unit) including two optical systems is attached, the focus guide and the zoom frame are out of sync with each other (asynchronous). When two LV images are displayed as in the case of attaching the dual lens unit and it is difficult to observe the details of the entire LV image without magnifying the LV image, the user may want to magnify the LV image and examine the LV image in more detail regardless of the focus position. Therefore, the focus guide and the zoom frame are out of sync with each other, so that the user can magnify not only the position of the focus guide including the frame indicating the focus detection position but also the desired position. On the other hand, when a normal lens unit (single lens unit) is attached, the focus guide or the AF frame and the zoom frame are substantially in sync with each other, so that the position of the zoom frame also moves as the focus guide or the auto-focus frame moves. Since in the case of attaching the single lens unit, only one LV image is displayed on the display unit 28 in a larger size compared to when two LV images are displayed, the user can easily observe the details of the LV image with x1 zoom compared to the LV image in the case of attaching the dual lens unit.

[0212] The foregoing various controls performed by the system control unit 50 can be carried out by a single piece of hardware. Multiple pieces of hardware (e.g., multiple processors or circuits) can share the processing to perform the overall control of the entire digital camera 100.

[0213] Although the exemplary embodiments of the present invention have been described in detail, the present invention is not limited to the specific exemplary embodiments, and various variations within the scope not departing from the gist of the present invention are also included in the present invention. In addition, the foregoing exemplary embodiments are merely one exemplary embodiment of the present invention, and various exemplary embodiments can be appropriately combined.

[0214] The foregoing exemplary embodiments have been described by using the example applied to the digital camera 100. However, this example is not restrictive, and the exemplary embodiments of the present invention can be applied to any electronic device capable of displaying an image captured using two optical systems. More specifically, the exemplary embodiments of the present invention can be applied to a personal computer, a personal digital assistant (PDA), a mobile phone terminal, a portable image viewer, a printer device including a display, a digital photo frame, a music player, a game machine, an e-book reader, a household appliance, a vehicle-mounted device, and a medical device.

[0215] Exemplary embodiments of the present invention are not limited to the imaging device main body, and are also applicable to an electronic device that communicates with a camera device (such as an IP camera) via wired or wireless communication and remotely controls the camera device. Examples of equipment for remotely controlling the camera device include a smart phone, a tablet personal computer (PC), and a desktop PC. The camera device can be remotely controlled by the electronic device notifying the camera device of commands for various operations and settings based on operations performed on a control device or processing performed by the electronic device. The electronic device is capable of receiving and displaying an LV image captured by the camera device via wired or wireless communication.

[0216] Other embodiments

[0217] Embodiments of the present invention can also be implemented by a method in which software (program) for performing the functions of the above-described embodiments is provided to a system or device via a network or various storage media, and the computer or central processing unit (CPU) or microprocessing unit (MPU) of the system or device reads and executes the program.

[0218] According to an exemplary embodiment of the present invention, a user can visually observe a zoom position in a state where a plurality of LV images obtained via a plurality of optical systems are displayed.

[0219] Although the present invention has been described with reference to exemplary embodiments, it should be understood that the present invention is not limited to the disclosed exemplary embodiments. The scope of the following claims should be given the broadest interpretation to cover all such modifications and equivalent structures and functions.

Claims

1. An electronic device, the electronic device comprising: An acquisition unit configured to acquire a third image, wherein a first image captured via a first optical system and a second image captured via a second optical system are arranged side by side in the third image, and the second image has a parallax with respect to the first image; A control unit configured to perform a predetermined process on a target area in the third image; A display control unit configured to perform display control to display the third image on a display unit and superimpose an item indicating the target area on the third image; and A reception unit configured to receive, based on detection of a user operation, a position specification for specifying a position of the item on the third image; wherein the display control unit performs display control to move and superimpose the item on the third image based on the position specification, wherein, when the position specified by the position specification is a position where the item straddles the first image and the second image, the item is moved to a position where the target area indicated by the item does not include both the first image and the second image, and is superimposed on the third image, and the predetermined process is performed on the target area corresponding to the position of the item superimposed on the third image.

2. The electronic device according to claim 1, the electronic device further comprising: A touch detection unit configured to detect a touch operation performed on a display surface of the display unit; and A setting unit configured to, when a touch position of the touch operation performed on the touch detection unit is within a predetermined area of a boundary between the first image and the second image, control the setting of the target area such that the target area includes one of the first image and the second image where the touch position is located and the boundary.

3. The electronic device according to claim 2, wherein, The predetermined area is an area having a horizontal dimension that is half of the horizontal dimension of the item.

4. The electronic device according to claim 1, wherein, The electronic device further comprises: A setting unit configured to, in a state where the third image is being displayed and one side of the item touches the boundary between the first image and the second image, when a position specification of the item is made at a position where the target area indicated by the item includes both the first image and the second image, instead of setting the item at the position where the target area indicated by the item includes both the first image and the second image, control is performed to change the position of the item from one of the first image and the second image where the item was set before the position specification to the other image.

5. The electronic device according to claim 1, the electronic device further comprising: A left - right switching unit configured to switch the target area indicated by the item from the first image to the second image; and A setting unit configured to, when the user issues an instruction for the left - right switching unit, switch the target area from a position in the first image to a corresponding position in the second image.

6. The electronic device according to claim 1, wherein, The electronic device further includes: a setting unit configured to, in a state where the third image is enlarged and one side of the item touches the boundary between the first image and the second image, when the position designation is performed at a position where the target area indicated by the item includes positions of both the first image and the second image, not set the item at the position where the target area indicated by the item includes positions of both the first image and the second image, but perform control not to change the position of the item from one image in which the item is set before the position designation to the other image among the first image and the second image.

7. The electronic device according to claim 1, wherein the electronic device further includes a photographing unit configured to photograph the third image by forming an optical image input via the first optical system and an optical image input via the second optical system on one photographing surface. Among them, The first image is an image corresponding to the optical image input via the first optical system, and wherein the second image is an image corresponding to the optical image input via the second optical system.

8. The electronic device according to claim 1, wherein, The electronic device further includes: a setting unit configured to, in response to a zoom instruction, set the zoom magnification of the target area to at least one of no zoom, 6-fold zoom, and 15-fold zoom.

9. The electronic device according to claim 1, wherein the electronic device further includes: a center return instruction receiving unit configured to receive a center return instruction for returning the item to the center of the live view image; and a setting unit configured to, in response to the center return instruction, perform control to change the position of the item to the center of one of the first image and the second image on which the item is displayed.

10. A control method for an electronic device, the control method including: an obtaining step of obtaining a third image, wherein a first image photographed via a first optical system and a second image photographed via a second optical system are arranged side by side in the third image, and the second image has a parallax with respect to the first image; a control step of performing a predetermined process on a target area in the third image; a display control step of performing display control to display the third image on a display unit and superimpose an item indicating the target area on the third image; and a receiving step of receiving, based on detecting a user operation, a position designation for designating a position of the item on the third image; wherein display control is performed to move and superimpose the item on the third image based on the position designation, wherein, when the position designated by the position designation is a position where the item straddles the first image and the second image, the item is moved to a position where the target area indicated by the item does not include positions of both the first image and the second image and is superimposed on the third image, and the predetermined process is performed on the target area corresponding to the position of the item superimposed on the third image.

11. A computer-readable recording medium storing a program for causing an electronic device to execute the method according to claim 10.

Images