Electronic devices, methods for controlling electronic devices, programs, and storage media

Abstract

To provide a technique that can suitably display indicators for one image in which two areas of images picked up by using two optical systems are arranged side by side.SOLUTION: An electronic apparatus of the present invention has acquisition means that acquires a picked-up image, and display control means that performs control to display an indicator superimposed on the acquired image. When an image in which a first area of an image picked up through a first optical system and a second area of an image picked up through a second optical system are arranged side by side is acquired, the display control means performs control to display a first indicator superimposed on the first area of the image and display a second indicator superimposed on the second area of the image: in response to a user's operation to move one indicator, performs control to move the one indicator; and in conjunction with the movement of the one indicator, performs control to move the other indicator.SELECTED DRAWING: Figure 5

Description

Technical Field

[0001] The present invention relates to an electronic device, a control method for an electronic device, a program, and a storage medium.

Background Art

[0002] A technique is known in which two images with parallax (two wide-angle images) are acquired using two optical systems and the two images are displayed in a stereoscopic viewable manner. A binocular camera for photographing two images with parallax has two optical systems facing the same direction and can photograph two images with parallax at once. Techniques related to binocular cameras are disclosed in, for example, Patent Document 1.

[0003] In a digital camera with a detachable lens unit, a single-lens unit and a binocular lens unit may be exchanged and used. When a single-lens unit is attached to form a single-lens camera, for example, one live image captured using one optical system is displayed. When a binocular lens unit is attached to form a binocular camera, for example, one live image in which two live image regions (two image regions with parallax) captured using two optical systems respectively are arranged side by side is displayed.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0005] However, in a conventional binocular camera (including the case where a binocular lens unit is attached to a digital camera), an indicator cannot be suitably displayed for one image in which two image regions captured using two optical systems respectively are arranged side by side.

[0006] The present invention aims to provide a technique for suitably displaying an indicator on a single image in which two image regions, each captured using a separate optical system, are arranged side by side. [Means for solving the problem]

[0007] The electronic device of the present invention includes an acquisition means for acquiring an image captured by an image sensor, an operation means for receiving user operations, and a display control means for controlling the image acquired by the acquisition means to display the image and for controlling the display of an indicator superimposed on the image. The display control means is The acquisition means arranges a first image region captured via the first optical system and a second image region captured via the second optical system side by side. First When an image is acquired That was, Control to display the first indicator superimposed on the first image area, control to display the second indicator superimposed on the second image area, control to move one of the first indicators or the second indicator in response to the user moving one of the first indicators or the second indicator, and control to move the other of the first indicators or the second indicator in conjunction with the movement of one of the first indicators or the second indicator. If the acquisition means acquires a second image different from the first image, which is formed by arranging the first image region and the second image region, the system controls the display of the first indicator superimposed on the second image, and when the user moves the first indicator, the system controls the movement of the first indicator, and when the user moves the second indicator, the system controls the movement of the second indicator, and when the user moves the second indicator, the system controls the movement of the second indicator, and when the user moves the second indicator, the system controls the movement of the first It is characterized by doing so. [Effects of the Invention]

[0008] According to the present invention, two image regions captured using two optical systems are arranged side by side. An indicator can be appropriately displayed for each image. [Brief explanation of the drawing]

[0009] [Figure 1] This is an external view of the camera. [Figure 2] This is a block diagram showing the camera configuration. [Figure 3]It is a schematic diagram showing the configuration of the lens unit. [Figure 4] It is a schematic diagram showing a part of the light-receiving surface of the image sensor. [Figure 5] It is a schematic diagram showing the display form of the indicator. [Figure 6] It is a diagram for explaining the indicator operation according to Embodiment 1. [Figure 7] It is a diagram for explaining the indicator operation according to Embodiment 1. [Figure 8] It is a flowchart showing the indicator display process according to Embodiment 1. [Figure 9] It is a schematic diagram showing the relationship between the left and right imaging positions. [Figure 10] It is a diagram for explaining the indicator operation according to Embodiment 2. [Figure 11] It is a flowchart showing the indicator display process according to Embodiment 2. [Figure 12] It is a diagram for explaining the indicator operation according to Embodiment 3. [Figure 13] It is a flowchart showing the indicator display process according to Embodiment 3.

Embodiments for Carrying Out the Invention

[0010] Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following embodiments, an example in which the present invention is applied to a digital camera (lens interchangeable camera) with a detachable lens unit will be described.

[0011] 〔Embodiment 1〕 <Hardware Configuration> FIGS. 1(A) and 1(B) are external views showing the appearance of a digital camera (camera) 100 according to Embodiment 1. FIG. 1(A) is a perspective view of the camera 100 seen from the front side, and FIG. 1(B) is a perspective view of the camera 100 seen from the back side.

[0012] Camera 100 has a shutter button 101, a power switch 102, a mode selector switch 103, a main electronic dial 104, a sub electronic dial 105, a video button 106, and an external viewfinder display 107 on its top surface. The shutter button 101 is an operating element for giving a shooting preparation instruction or a shooting instruction. The power switch 102 is an operating element for switching the power of camera 100 on and off. The mode selector switch 103 is an operating element for switching between various modes. The main electronic dial 104 is a rotary operating element for changing settings such as shutter speed and aperture. The sub electronic dial 105 is a rotary operating element for moving the selection frame (cursor) and advancing images. The video button 106 is an operating element for giving instructions to start and stop video recording. The external viewfinder display 107 displays various settings such as shutter speed and aperture.

[0013] Camera 100 has a display unit 108, a touch panel 109, directional keys 110, a SET button 111, an AE lock button 112, a zoom button 113, a playback button 114, a menu button 115, an eyepiece 116, an eyepiece detection unit 118, and a touch bar 119 on its back. The display unit 108 displays images and various information. The touch panel 109 is an operating member that detects touch operations on the display surface (touch operation surface) of the display unit 108. The directional keys 110 is an operating member consisting of keys that can be pressed up, down, left, and right (four directional keys). Processing can be performed according to the position where the directional keys 110 are pressed. The SET button 111 is an operating member that is mainly pressed when confirming a selection item. The AE lock button 112 is an operating member that is pressed when fixing the exposure state in shooting standby mode. The zoom button 113 is an operating member that switches the zoom mode on and off in the live view display (LV display) of the shooting mode. If magnification mode is on, operate the main electronic dial 104. By doing so, the live view image (LV image) is enlarged or reduced. Also, the zoom-in button 113 is used to enlarge the playback image or increase the magnification rate in the playback mode. The playback button 114 is an operation member for switching between the shooting mode and the playback mode. By pressing the playback button 114 in the shooting mode, the user can shift to the playback mode and display the latest image among the images recorded on the recording medium 227, which will be described later, on the display unit 108.

[0014] The menu button 115 is an operation member that is pressed to display a menu screen on which various settings can be made on the display unit 108. The user can intuitively make various settings using the menu screen displayed on the display unit 108, the direction keys 110, and the SET button 111. The eyepiece part 116 is a part where the user looks through the eyepiece finder (a peephole-type finder) 117. The user can visually recognize the video displayed on the EVF 217 (Electronic View Finder), which will be described later, inside the camera 100 through the eyepiece part 116. The eyepiece detection unit 118 is a sensor that detects whether the user is looking through the eyepiece part 116 (eyepiece finder 117).

[0015] The touch bar 119 is a line-shaped touch operation component (line touch sensor) capable of accepting touch operations. The touch bar 119 is positioned so that it can be touched by the right thumb when the grip portion 120 is held with the right hand (with the little finger, ring finger, and middle finger) so that the shutter button 101 can be pressed with the right index finger. In other words, the touch bar 119 can be operated when the user is looking through the eyepiece 116 with their eyepiece in the eyepiece viewfinder 117 and is ready to press the shutter button 101 at any time (shooting posture). The touch bar 119 can accept tap operations (touching and releasing without moving the touch position within a predetermined period), left and right sliding operations (touching and then moving the touch position while keeping the touch on the surface), etc. The touch bar 119 is a different operation component from the touch panel 109 and does not have a display function. The Touch Bar 119 functions, for example, as a multifunction bar (M-Fn bar) to which various functions can be assigned.

[0016] The camera 100 also includes a grip section 120, a thumb rest section 121, a terminal cover 122, a lid 123, a communication terminal 124, etc. The grip section 120 is a holding section shaped to be easily gripped by the user with their right hand when holding the camera 100. With the camera 100 held by gripping the grip section 120 with the little finger, ring finger, and middle finger of the right hand, the shutter button 101 and the main electronic dial 104 are positioned to be operated by the index finger of the right hand. Similarly, in the same position, the sub electronic dial 105 and the touch bar 119 are positioned to be operated by the thumb of the right hand. The thumb rest section 121 (thumb waiting position) is a grip section located on the back of the camera 100, in a place where it is easy to rest the thumb of the right hand that is holding the grip section 120 when no other operating members are being operated. The thumb rest section 121 is made of a rubber material or the like to enhance the holding force (grip feel). The terminal cover 122 protects connectors such as connection cables that connect the camera 100 to external equipment (external devices). The cover 123 protects the recording medium 227 and the slot for storing the recording medium 227, which will be described later, by closing the slot. The communication terminal 124 is a terminal for communicating with the lens unit (lens unit 200 or lens unit 300, which will be described later) that can be attached to or detached from the camera 100.

[0017] <Camera internal hardware configuration> Figure 2 is a block diagram showing the configuration of camera 100. Components identical to those in Figures 1(A) and 1(B) are denoted by the same reference numerals, and their descriptions are omitted as appropriate. In Figure 2, a lens unit 200 is attached to camera 100.

[0018] First, let's explain the lens unit 200. The lens unit 200 is attached to camera 10 It is a type of interchangeable lens unit that can be attached to and detached from 0. Lens unit 200 is a single-lens unit (monocular lens unit) and is an example of a normal lens unit. Lens unit 200 includes an aperture 201, a lens 202, an aperture drive circuit 203, an AF (autofocus) drive circuit 204, a lens system control circuit 205, a communication terminal 206, etc.

[0019] The aperture 201 is configured to have an adjustable aperture diameter. The lens 202 is composed of multiple lenses. The aperture drive circuit 203 adjusts the amount of light by controlling the aperture diameter of the aperture 201. The AF drive circuit 204 drives the lens 202 to focus. The lens system control circuit 205 controls the aperture drive circuit 203, the AF drive circuit 204, etc., based on instructions from the system control unit 50, which will be described later. The lens system control circuit 205 controls the aperture 201 via the aperture drive circuit 203 and focuses by changing the position of the lens 202 via the AF drive circuit 204. The lens system control circuit 205 can communicate with the camera 100. Specifically, communication takes place via the communication terminal 206 of the lens unit 200 and the communication terminal 124 of the camera 100. The communication terminal 206 is a terminal for the lens unit 200 to communicate with the camera 100.

[0020] Next, the camera 100 will be described. The camera 100 includes a shutter 210, an imaging unit 211, an A / D converter 212, a memory control unit 213, an image processing unit 214, a memory 215, a D / A converter 216, an EVF 217, a display unit 108, and a system control unit 50.

[0021] The shutter 210 is a focal-plane shutter that can freely control the exposure time of the imaging unit 211 based on instructions from the system control unit 50. The imaging unit 211 is an image sensor composed of a CCD or CMOS element, etc., which converts an optical image into an electrical signal. The imaging unit 211 may have an image plane phase difference sensor that outputs defocus amount information to the system control unit 50. The A / D converter 212 converts the analog signal output from the imaging unit 211 into a digital signal. The image processing unit 214 performs predetermined processing (pixel interpolation, resizing such as reduction, color conversion, etc.) on the data from the A / D converter 212 or the data from the memory control unit 213. The image processing unit 214 also performs predetermined calculation processing using the captured image data, and the system control unit 50 performs exposure control and distance measurement control based on the obtained calculation results. Through this processing, TTL (through-the-lens) AF processing, AE (automatic exposure) processing, EF (flash pre-flash) processing, etc. are performed. Furthermore, the image processing unit 214 performs predetermined calculations using the captured image data, and the system control unit 50 performs TTL-type AWB (auto white balance) processing based on the obtained calculation results.

[0022] Image data from the A / D converter 212 is written to the memory 215 via the image processing unit 214 and the memory control unit 213. Alternatively, image data from the A / D converter 212 is written to the memory 215 via the memory control unit 213 without going through the image processing unit 214. The memory 215 stores image data obtained by the imaging unit 211 and converted into digital data by the A / D converter 212, as well as image data for display on the display unit 108 and EVF 217. The memory 215 has sufficient storage capacity to store a predetermined number of still images, a predetermined amount of video footage, and audio. The memory 215 also serves as a memory for image display (video memory).

[0023] The D / A converter 216 converts the display image data stored in the memory 215 into an analog signal and supplies it to the display unit 108 and EVF 217. Therefore, the display image data written to the memory 215 is displayed on the display unit 108 and EVF 217 via the D / A converter 216. The display unit 108 and EVF 217 perform display according to the analog signal from the D / A converter 216. The display unit 108 and EVF 217 are displays such as LCDs and OLEDs. The A / D conversion is performed by the A / D converter 212 and stored in the memory 215. The generated digital signal is converted into an analog signal by the D / A converter 216 and then sequentially transmitted to the display unit 108 and EVF 217 for display, thereby enabling live view display.

[0024] The system control unit 50 is a control unit consisting of at least one processor and / or at least one circuit. That is, the system control unit 50 may be a processor, a circuit, or a combination of a processor and a circuit. The system control unit 50 controls the entire camera 100. The system control unit 50 implements each process of the flowchart described later by executing a program recorded in the non-volatile memory 219. The system control unit 50 also performs display control by controlling the memory 215, D / A converter 216, display unit 108, EVF 217, etc.

[0025] The camera 100 also includes a system memory 218, a non-volatile memory 219, a system timer 220, a communication unit 221, a posture detection unit 222, and an eyepiece detection unit 118.

[0026] For example, RAM is used as the system memory 218. The system memory 218 stores constants and variables for the operation of the system control unit 50, programs read from the non-volatile memory 219, etc. The non-volatile memory 219 is an electrically erasable and recordable memory, and for example, EEPROM is used as the non-volatile memory 219. The non-volatile memory 219 stores constants and programs for the operation of the system control unit 50, etc. The program here refers to a program for executing the flowchart described later. The system timer 220 is a timing unit that measures the time used for various controls and the time of the built-in clock. The communication unit 221 transmits and receives video signals and audio signals to and from external devices connected by wireless or wired cables. The communication unit 221 can also connect to wireless LAN (Local Area Network) and the internet. In addition, the communication unit 221 can communicate with external devices using Bluetooth® and Bluetooth Low Energy. The communication unit 221 can transmit images (including live images) captured by the imaging unit 211 and images recorded on the recording medium 227, and can receive images and other various information from external devices. The attitude detection unit 222 detects the attitude (tilt) of the camera 100 with respect to the direction of gravity. Based on the attitude detected by the attitude detection unit 222, it can detect the tilt angle of the camera 100 in the horizontal (left-right) or vertical (up-down; front-back) direction. Also, based on the attitude detected by the attitude detection unit 222, it can determine whether the image taken by the imaging unit 211 was taken with the camera 100 held horizontally or vertically. The system control unit 50 can add orientation information corresponding to the attitude detected by the attitude detection unit 222 to the image file of the image taken by the imaging unit 211, or rotate the image according to the detected attitude. It is also possible to detect the movement of the camera 100 (pan, tilt, lift, whether it is stationary or not, etc.) using the attitude detection unit 222. The attitude detection unit 222 can use, for example, an acceleration sensor or a gyroscope.

[0027] The eyepiece detection unit 118 can detect the approach of any object to the eyepiece unit 116 (eyepiece finder 117). For example, an infrared proximity sensor can be used for the eyepiece detection unit 118. When an object approaches, infrared light emitted from the light emitter of the eyepiece detection unit 118 is reflected by the object and received by the light receiver of the infrared proximity sensor. The distance from the eyepiece unit 116 to the object can be determined by the amount of infrared light received. In this way, the eyepiece detection unit 118 performs eyepiece detection to detect the proximity distance of an object to the eyepiece unit 116. The eyepiece detection unit 118 is an eyepiece detection sensor that detects the approach (eye-catching) and departure (eye-moving) of an eye (object) to the eyepiece unit 116. When an object is detected approaching the eyepiece unit 116 within a predetermined distance from a non-eyepiece state (non-approach state), it is detected that the eye has been caught in the eye. On the other hand, if the object that was detected as approaching moves beyond a predetermined distance from the eye-contact state (close-up state), it is detected as having been moved away from the eye. The threshold for detecting eye contact and the threshold for detecting eye separation are different, for example, by providing hysteresis. It is also acceptable to do so. Furthermore, after detecting eye contact, the eye will remain in eye contact state until eye separation is detected. After detecting eye separation, the eye will remain in non-eye contact state until eye contact is detected. The system control unit 50 switches the display (display state) / non-display (non-display state) of the display unit 108 and EVF 217 according to the state detected by the eye contact detection unit 118. Specifically, at least in the shooting standby state and when the display destination switching setting is set to automatic switching, the display destination is set to the display unit 108 and the display is turned on, and the EVF 217 is turned off when the eye is not in eye contact. Also, when the eye is in eye contact, the display destination is set to the EVF 217 and the display is turned on, and the display unit 108 is turned off. Note that the eye contact detection unit 118 is not limited to an infrared proximity sensor, and other sensors that can detect a state that can be considered as eye contact may be used for the eye contact detection unit 118.

[0028] The camera 100 also includes an external viewfinder display unit 107, an external viewfinder display drive circuit 223, a power control unit 224, a power supply unit 225, a recording medium interface 226, an operation unit 228, and the like.

[0029] The external viewfinder display unit 107 is driven by the external viewfinder display drive circuit 223 and displays various settings of the camera 100, such as shutter speed and aperture. The power control unit 224 consists of a battery detection circuit, a DC-DC converter, a switch circuit for switching which blocks are energized, and detects whether a battery is installed, the type of battery, and the remaining battery level. The power control unit 224 also controls the DC-DC converter based on the detection results and instructions from the system control unit 50, supplying the necessary voltage to each part, including the recording medium 227, for the required period. The power supply unit 225 includes primary batteries such as alkaline batteries and lithium batteries, secondary batteries such as NiCd batteries, NiMH batteries and Li batteries, and an AC adapter. The recording medium I / F 226 is an interface with the recording medium 227, such as a memory card or hard disk. The recording medium 227 is a memory card or the like for recording captured images and consists of semiconductor memory or a magnetic disk. The recording medium 227 may be detachable from the camera 100 or may be built into the camera 100.

[0030] The operation unit 228 is an input unit that receives user input (user operation) and is used to input various instructions to the system control unit 50. The operation unit 228 includes the shutter button 101, power switch 102, mode switch 103, touch panel 109, and other operation units 229. Other operation units 229 include the main electronic dial 104, sub electronic dial 105, video button 106, directional keys 110, SET button 111, AE lock button 112, zoom button 113, playback button 114, menu button 115, touch bar 119, and the like.

[0031] The shutter button 101 has a first shutter switch 230 and a second shutter switch 231. The first shutter switch 230 turns on during the operation of the shutter button 101, so-called half-press (shooting preparation instruction), and outputs a first shutter switch signal SW1. The system control unit 50 starts shooting preparation processing such as AF processing, AE processing, AWB processing, and EF processing in response to the first shutter switch signal SW1. The second shutter switch 231 turns on when the operation of the shutter button 101 is completed, so-called full-press (shooting instruction), and outputs a second shutter switch signal SW2. The system control unit 50 starts a series of shooting processes, from reading the signal from the imaging unit 211 to generating an image file containing the captured image and writing it to the recording medium 227, in response to the second shutter switch signal SW2.

[0032] The mode switch 103 switches the operating mode of the system control unit 50 to one of the following: still image shooting mode, video shooting mode, playback mode, etc. The modes included in still image shooting mode are auto shooting mode, auto scene detection mode, manual mode, aperture priority mode (Av mode), shutter speed priority mode (Tv mode), and program AE mode (P mode). In addition, there are various scene modes and custom modes for shooting settings specific to different shooting scenes. There are modes such as [code]. The user can directly switch to any of the above-mentioned shooting modes using the mode switch 103. Alternatively, the user can switch to the shooting mode list screen using the mode switch 103, and then selectively switch to any of the displayed modes using the operation unit 228. Similarly, the video shooting mode may also include multiple modes.

[0033] The touch panel 109 is a touch sensor that detects various touch operations on the display surface of the display unit 108 (the operating surface of the touch panel 109). The touch panel 109 and the display unit 108 can be configured as an integrated unit. For example, the touch panel 109 is mounted on the upper layer of the display surface of the display unit 108 so that its light transmittance does not interfere with the display of the display unit 108. Then, the input coordinates on the touch panel 109 are associated with the display coordinates on the display surface of the display unit 108. In this way, a GUI (Graphical User Interface) can be configured that makes it appear as if the user can directly operate the screen displayed on the display unit 108. The touch panel 109 can use any of the various methods, such as resistive, capacitive, surface acoustic wave, infrared, electromagnetic induction, image recognition, and optical sensor methods. Depending on the method, there are methods that detect a touch when there is contact with the touch panel 109, and methods that detect a touch when a finger or pen approaches the touch panel 109, but either method is acceptable.

[0034] The system control unit 50 can detect the following operations or states on the touch panel 109. - A finger or pen that was not previously touching the touch panel 109 now touches the touch panel 109, i.e., the start of a touch (hereinafter referred to as Touch-Down). • The state in which the touch panel 109 is being touched with a finger or pen (hereinafter referred to as Touch-On). • The touch panel 109 is being moved while a finger or pen is touching it (hereinafter referred to as Touch-Move). The finger or pen that was touching the touch panel 109 is lifted (released), meaning the touch action ends (hereinafter referred to as "Touch-Up"). • The state in which nothing is being touched on the touch panel 109 (hereinafter referred to as Touch-Off).

[0035] When a touchdown is detected, a touch-on is also detected simultaneously. After a touchdown, touch-ons are usually detected continuously unless a touch-up is detected. Touch-ons are also detected simultaneously if a touch-move is detected. Even if a touch-on is detected, a touch-move will not be detected if the touch position has not moved. After all fingers or pens that were touching have been detected as having touched up, a touch-off occurs.

[0036] These operations and states, as well as the position coordinates of the finger or pen touching the touch panel 109, are notified to the system control unit 50 via the internal bus. Based on the notified information, the system control unit 50 determines what kind of operation (touch operation) was performed on the touch panel 109. For touch moves, the direction of movement of the finger or pen moving on the touch panel 109 can also be determined for each vertical and horizontal component on the touch panel 109 based on the change in position coordinates. If it is detected that a touch move of a predetermined distance or more has been performed, it is determined that a slide operation has been performed. An operation in which a finger is touched on the touch panel 109 and then quickly moved a certain distance and then released is called a flick. In other words, a flick is an operation in which the finger is quickly traced across the touch panel 109 as if flicking it. If it is detected that a touch move of a predetermined distance or more has been performed at a predetermined speed or faster, and a touch-up is then detected, it is determined that a flick operation has been performed. A click is detected (it can be determined that a flick occurred following a slide operation). Furthermore, touching multiple locations (for example, two points) together (multitouch) and bringing the touch positions closer together is called a pinch-in, and touching them further apart is called a pinch-out. Pinch-out and pinch-in are collectively referred to as a pinch operation (or simply a pinch).

[0037] <Lens Unit Configuration> Figure 3 is a schematic diagram showing the configuration of the lens unit 300. Figure 3 shows the lens unit 300 attached to the camera 100. By attaching the lens unit 300, the camera 100 can capture a single image (still image or video) containing two image regions with a predetermined parallax. Note that, among the components of the camera 100 shown in Figure 3, the same reference numerals as those described in Figure 2 are used, and the descriptions of those components are omitted as appropriate.

[0038] The lens unit 300 is a type of interchangeable lens unit that can be attached to and removed from the camera 100. The lens unit 300 is a twin-lens unit capable of capturing parallax right and left images. The lens unit 300 has two optical systems, and each of the two optical systems can capture a wide field of view of approximately 180 degrees. Specifically, each of the two optical systems of the lens unit 300 can capture a subject with a field of view (angle of view) of 180 degrees in the left-right direction (horizontal angle, azimuth angle, yaw angle) and 180 degrees in the up-down direction (vertical angle, elevation / depression angle, pitch angle). In other words, each of the two optical systems can capture an area of ​​the front hemisphere.

[0039] The lens unit 300 includes a right-eye optical system 301R having multiple lenses and a reflective mirror, a left-eye optical system 301L having multiple lenses and a reflective mirror, and a lens system control circuit 303. The right-eye optical system 301R has a lens 302R positioned on the subject side, and the left-eye optical system 301L has a lens 302L positioned on the subject side. Lenses 302R and 302L face the same direction, and their optical axes are approximately parallel.

[0040] The lens unit 300 is a two-lens lens unit (VR180 lens unit) for obtaining VR180 images, which are one of the VR (Virtual Reality) image formats that enable binocular stereoscopic viewing. The lens unit 300 has a fisheye lens capable of capturing a range of approximately 180 degrees in both the right eye optical system 301R and the left eye optical system 301L. However, the range that can be captured by the lenses of the right eye optical system 301R and the left eye optical system 301L may be narrower than 180 degrees, around 160 degrees. The lens unit 300 can image the right image formed via the right eye optical system 301R and the left image formed via the left eye optical system 301L onto a single image sensor of the camera to which the lens unit 300 is attached.

[0041] The lens unit 300 is attached to the camera 100 via the lens mount portion 304 and the camera mount portion 305 of the camera 100. In this way, the system control unit 50 of the camera 100 and the lens system control circuit 303 of the lens unit 300 are electrically connected via the communication terminal 124 of the camera 100 and the communication terminal 306 of the lens unit 300.

[0042] In Figure 3, the right image formed via the right eye optical system 301R and the left image formed via the left eye optical system 301L are imaged side by side on the imaging unit 211 of the camera 100. That is, two optical images are imaged in two different regions of a single image sensor (imaging sensor) by the right eye optical system 301R and the left eye optical system 301L. The imaging unit 211 converts the imaged subject (optical signal) into an analog electrical signal. By using the lens unit 300 in this way, parallax is generated from two locations (optical systems): the right eye optical system 301R and the left eye optical system 301L. It is possible to acquire a single image containing two image regions. By splitting the acquired image into an image for the left eye and an image for the right eye and displaying them in VR, the user can view a stereoscopic VR image with a range of approximately 180 degrees. In other words, the user can view a VR180 image in 3D.

[0043] In Embodiment 1, the configuration of the right eye optical system 301R and the configuration of the left eye optical system 301L are assumed to be the same. This simplifies the calculations described later. However, the configuration of the right eye optical system 301R and the configuration of the left eye optical system 301L may be different.

[0044] When taking a picture, the user can adjust the focus of the right or left image by driving the focusing optical system 307R and 307L, which are the focusing units, while viewing the image obtained by the imaging unit 211 on the display unit 108 (or EVF 217). By driving the focusing optical system 307R, the user can adjust the focus of the right image, and by driving the focusing optical system 307L, the user can adjust the focus of the left image. The focusing optical system 307R and 307L can be driven by a binocular focusing ring mechanism that drives both simultaneously. Alternatively, the focusing optical system 307R and 307L can also be driven by a monocular focusing ring mechanism that drives only one of them. For example, in photography with a deep depth of field, focus adjustment is performed only by the binocular focusing ring mechanism. In shooting with a shallow depth of field, after focusing is performed by the binocular focusing ring mechanism, further focusing is performed by the monocular focusing ring mechanism to obtain a more in-focus image. Focusing may be performed by operating an operating ring (not shown) provided on the exterior of the lens unit 300, or by operating the camera 100. When operating the camera 100, an instruction is sent from the system control unit 50 of the camera 100 to the lens system control circuit 303 of the lens unit 300. The lens system control circuit 303 then electronically drives the focusing optical system 307R and the focusing optical system 307L.

[0045] Furthermore, when taking a picture, the user can adjust the exposure of the right and left images by driving the variable aperture 308R of the right eye optical system 301R and the variable aperture 308L of the left eye optical system 301L. By driving the variable aperture 308R, the user can adjust the exposure of the right image, and by driving the variable aperture 308L, the user can adjust the exposure of the left image. The variable apertures 308R and 308L can be driven by a binocular aperture adjustment mechanism that drives both simultaneously. Alternatively, the variable apertures 308R and 308L can also be driven by a monocular aperture adjustment mechanism that drives only one of them.

[0046] <Phase detection of surface phase difference> In the imaging unit 211, in order to enable on-sensor phase-detection autofocus, each of the multiple pixel units arranged in an array holds two photodiodes, which are photoelectric conversion units (light-receiving units), for each microlens. This allows each pixel unit to receive the light beam by dividing the exit pupil of the lens unit 300.

[0047] Figures 4(A) and 4(B) are schematic diagrams showing a portion of the light-receiving surface of an image sensor. Figure 4(A) shows a portion of the light-receiving surface of an image sensor as a reference example, and Figure 4(B) shows a portion of the light-receiving surface of the imaging unit 211. In Figure 4(A), red (R), blue (B), and green (Gb,Gr) color filters are arranged in a Bayer array. In Figure 4(B), the arrangement of the color filters is the same as in Figure 4(A), and each pixel holds two photodiodes for one microlens.

[0048] The image sensor having the configuration shown in Figure 4(B) is capable of outputting two signals (A image signal and B image signal) for phase difference detection from each pixel. The system can also output an imaging signal (A image signal + B image signal) which is the sum of the Od signals. This summed signal is equivalent to the output of the image sensor shown in Figure 4(A).

[0049] A distance measuring unit (not shown) performs distance measurement calculations using the output signals from the imaging unit 211 and outputs the results to the system control unit 50. For example, the distance measuring unit performs correlation calculations on the two image signals and calculates information such as the amount of defocus and various reliability values. The distance measuring unit calculates the amount of defocus on the image plane based on the difference between the A image signal and the B image signal. Whether the defocus amount is positive or negative determines whether it is front-focused or back-focused. The absolute value of the defocus amount indicates the degree to which focus is achieved, and if the defocus amount is 0, it is in focus. The distance measuring unit outputs information on whether it is front-focused or back-focused to the system control unit 50, etc., based on the positive or negative sign of the defocus amount calculated for the distance measuring position (distance measuring area, focus detection position, focus detection area). The distance measuring unit also outputs focus degree information, which is the degree of focus (degree of focus deviation), to the system control unit 50, etc., based on the absolute value of the defocus amount. Information indicating whether the image is in front focus or back focus is output when the amount of defocus exceeds a predetermined value, and information indicating focus is output when the absolute value of the amount of defocus is within the predetermined value. The degree of focus information is output by converting the amount of defocus into the amount of rotation (operation amount) of the binocular or monocular focusing ring mechanism required to achieve focus.

[0050] In Embodiment 1, the imaging unit 211 outputs a total of three signals: an imaging signal and two image signals for phase difference detection. However, it is not limited to this configuration. For example, the imaging unit 211 may output only two of the three signals. In this case, the remaining signal is calculated using the two signals from the imaging unit 211.

[0051] Furthermore, while Embodiment 1 assumes that each pixel section holds two photodiodes for one microlens, it is not limited to this. Each pixel section may hold three or more photodiodes for one microlens. Also, the imaging unit 211 may have multiple pixel sections with different aperture positions for the light-receiving section relative to the microlens. As long as two signals for phase difference detection, such as the A image signal and the B image signal, can be obtained, the configuration of the imaging unit 211 is not particularly limited.

[0052] <Indicator function> The display format of the indicator (guide item, display item) according to Embodiment 1 will be explained using Figures 5(A) to 5(E). The indicator includes, for example, a focus guide (a frame that assists in adjusting focus) and a face frame.

[0053] In Embodiment 1, the focus guide is displayed superimposed on the live image (live image area). The focus guide indicates the focus state (degree of focus) at the display position of the focus guide (the area indicated by the focus frame described later). For example, the focus state at the display position of the focus guide is indicated based on the amount of defocus acquired for that display position. More specifically, the focus state is indicated using the amount of defocus calculated based on the output values ​​from one or more pixels within the range corresponding to the display position of the focus guide, among a plurality of pixels on the imaging unit 211 from which the amount of defocus can be acquired. Pixels from which the amount of defocus can be acquired can also be considered as pixels capable of image plane phase difference detection. In this way, the focus guide indicates information regarding the focus of the subject that appears at the display position of the focus guide among the subjects that appear in the live image.

[0054] Figure 5(A) shows the first display mode of the indicator. The indicator in Figure 5(A) is a focus guide (main guide described later) and includes a focus frame 500 and display parts 501 and 502. Figure 5(A) shows the subject indicated by the focus frame 500 in focus. This indicates a state in which focus is detected. When focus is detected, the outer display part 501 and the inner display part 502 are displayed in the same direction relative to the focus frame 500. In Figure 5(A), the display parts 501 and 502 are stopped at the top of the focus frame 500. These display parts 501 and 502 indicate that focus is detected on the subject indicated by the focus frame 500. The display parts 501 and 502 may be displayed in a different color (e.g., green) than the color of the display parts in other states (e.g., white or gray). Display part 501 is a single display part that integrates two display parts 507 and 508, which will be described later. Display part 502 is a single display part that integrates two display parts 504 and 505, which will be described later.

[0055] Figure 5(B) shows the second display mode of the indicator, and Figure 5(C) shows the third display mode of the indicator. The indicator in Figures 5(B) and 5(C) is the focus guide. Figures 5(B) and 5(C) indicate a state where the subject indicated by the focus frame 500 is not in focus, but the reliability of the focus detection result is high. In this case, the focus guide shows the focal position and the amount of defocus. The display of the focal position and the amount of defocus can also be interpreted as indicating the direction and amount of adjustment for adjusting the focal position in order to focus on the subject indicated by the focus frame 500.

[0056] Figure 5(B) shows a front-focused state where the focus is on a side closer than the subject. In Figure 5(B), the outer display part 503 is stopped at the top of the focus frame 500, similar to the display part 501 in Figure 5(A), but the display part 502 in Figure 5(A) is displayed separately as display parts 504 and 505. Display parts 504 and 505 move along the circumference surrounding the focus frame 500 and are positioned symmetrically with respect to the position of display part 502 in Figure 5(A). The separation of display part 502 into display parts 504 and 505 indicates front focus, and the distance between display part 504 and display part 505 indicates the amount of defocus. The larger the magnitude (absolute value) of the amount of defocus, the further display parts 504 and 505 are from the position (reference position) of display part 503, and the longer the distance between display parts 504 and 505. Display parts 504 and 505 are displayed in white, for example.

[0057] Figure 5(C) shows a back-focused state where the focus is on the infinity side of the subject. In Figure 5(C), the inner display part 506 is stopped at the top of the focus frame 500, similar to the display part 502 in Figure 5(A), but the display part 501 in Figure 5(A) is displayed separately as display parts 507 and 508. Display parts 507 and 508 move along the circumference surrounding the focus frame 500 and are positioned symmetrically with respect to the position of display part 501 in Figure 5(A). The separation of display part 501 into display parts 507 and 508 indicates back focus, and the distance between display parts 507 and 508 indicates the amount of defocus. The larger the magnitude (absolute value) of the amount of defocus, the further display parts 507 and 508 are from the position (reference position) of display part 506, and the longer the distance between display parts 507 and 508. Display parts 507 and 508 are displayed in white, for example.

[0058] Thus, in Figures 5(B) and 5(C), the focal position and the direction of focal position adjustment are indicated by whether display part 501 or display part 502 in Figure 5(A) is separated into two parts. Furthermore, the amount of defocus and the amount of focal position adjustment are indicated by the distance between the two separated display parts.

[0059] Figure 5(D) shows the fourth display mode of the indicator. The indicator in Figure 5(D) is a focus guide and includes the focus frame 500 and display parts 509-511. Figure 5(D) shows a state of significant blur with low reliability of focus detection results. Display parts 509-511 are displayed in a different manner than the display parts in other states. In Figure 5(D), the display Parts 509-511 are displayed in a different color (e.g., gray) than the display parts in other states (e.g., white or green). Also, the positions of display parts 509-511 relative to the focus frame 500 are fixed at predetermined positions. Furthermore, display parts 509-511 are displayed in a different shape (e.g., square) than the display parts in other states (e.g., triangle). Due to these display parts 509-511, neither the focal position nor the amount of defocus is indicated, indicating that focus detection is not possible (the reliability of the focus detection result is low).

[0060] Figure 5(E) shows the fifth display mode of the indicator. The indicator in Figure 5(E) includes a face frame 512 (face detection frame). Face detection is a process that analyzes an image (such as a live image) captured by the imaging unit 211 and detects the face of a specific subject (e.g., a person) from the image. For example, the input image obtained by the image processing unit 214 is filtered using an edge detection filter or a noise reduction filter. Then, pattern matching is performed on the filtered image to extract a group of candidate parts such as pupils, nose, mouth, and ears. From the group of candidates, feature quantities such as detection confidence, distance between parts, and pair information (pupils, ears) are calculated, and the region corresponding to a face is identified based on these feature quantities. The pattern matching and filtering programs are stored in the non-volatile memory 219 in advance, and these programs are loaded into the system memory 218 as needed and executed by the system control unit 50. A dedicated circuit for face detection may also be provided. The face frame 512 is displayed superimposed on the live image to indicate a face.

[0061] Note that the indicator display format is not limited to the display formats shown in Figures 5(A) to 5(E). Furthermore, although an example of determining the focus state (degree of focus) from the defocus amount calculated based on the signal obtained from the imaging unit 211 (image plane phase difference signal) has been described, the method of determining the focus state is not limited to this. The focus state may also be determined based on the output value from a focus detection sensor (phase difference sensor, etc.) located in a different location from the imaging plane, or based on the contrast value of the captured image.

[0062] Multiple focus guides may be displayed for a single live image (live image area). For example, a focus guide for the target of focus adjustment (main guide) and a focus guide for the non-target of focus adjustment (sub-guide) may be displayed for a live image. The main guide includes, as described above, a focus frame (main frame; focus frame 500) and display parts that indicate the focus status (display parts 501, 502, 504, 505, 507, 508, 509~511). The sub-guide is a different type of focus guide from the main guide, and includes a focus frame (sub-frame), but does not include display parts that indicate the focus status. The main frame and sub-frame may be switchable by touch operation (e.g., tap) on the touch panel 109 or operation on the directional keys 110. The presence or absence of the sub-frame may be switched on the menu screen.

[0063] Similarly, multiple face frames 512 in Figure 5(E) may be displayed for a single live image (live image area). In this case, among the multiple face frames 512, display parts 513 and 514 are displayed for the face frame 512 to be processed (main frame), distinguishing the main frame from the face frame 512 (sub-frame) that is not being processed. An indicator including the face frame 512 (main frame) and display parts 513 and 514 can also be considered a different type of indicator from an indicator that includes the face frame 512 (sub-frame) but does not include the display parts 513 and 514. Further display parts indicating the focus status may be displayed for the main frame. The main frame and sub-frame may be switchable by touch operation (e.g., tap) on the touch panel 109 or operation on the directional keys 110. The presence or absence of the sub-frame may be switched by the user on a menu screen.

[0064] <Indicator Operation> The indicator operation according to Embodiment 1 and the corresponding operation will be explained using Figures 6(A) to 6(C). Figure 6(A) shows the live image 600 displayed on the display unit 108 (or EVF 217) when the lens unit 200 (single-lens unit) is attached to the camera 100. In Figure 6(A), the focus frame 601 and the display parts 611 and 612 indicating the focus status are superimposed on the live image 600. Various information such as imaging parameters, number of recorded images, and battery level may be superimposed and displayed on the periphery of the live image 600.

[0065] Let's assume that the lens is changed from the state shown in Figure 6(A), and the lens unit 300 (two-lens unit) is attached to the camera 100. Then, as shown in Figure 6(B), the live image 600 will display the image area captured via the left eye optical system 301L (live image area) and the image area captured via the right eye optical system 301R (live image area) side by side. In Embodiment 1, when the indicator display processing 800, which will be described later, is executed, the focus frame 602 is superimposed on the right live image area and the focus frame 603 is superimposed on the left live image area, as shown in Figure 6(B). As will be described in detail later, the focus frame 602 and the focus frame 603 are displayed corresponding to each other. Also, an indicator part showing the focus state is displayed for each of the focus frames 602 and 603. Then, as shown in Figure 6(C), when the focus frame 602 is moved by a touch operation on the touch panel 109 (for example, touch move), the focus frame 603 also moves in conjunction with it.

[0066] Another approach would be for the user to individually set focus frames for the left and right live image areas and move those focus frames individually. However, individually setting focus frames for the left and right live image areas and moving multiple focus frames individually is cumbersome for the user and increases the operation time. According to the method described in Embodiment 1, focus frames are automatically displayed for both the left and right live image areas. The user can then move multiple focus frames simultaneously (in a single operation). Therefore, the user's effort is reduced and the operation time can be shortened.

[0067] As mentioned above, multiple focus guides may be displayed for a single live image (live image area). Such cases will be explained using Figures 7(A) to 7(C). Figure 7(A) shows a live image 700 displayed on the display unit 108 (or EVF 217) when the lens unit 200 (single-lens unit) is attached to the camera 100. In Figure 7(A), a main frame 701 and a sub-frame 702 are superimposed on the live image 700 as focus frames. Display parts 711 and 712 indicating the focus status are displayed on the main frame 701. The main frame and sub-frame can be switched. For example, by touching the main frame or sub-frame, the main frame can be switched to the sub-frame, and vice versa. The main frame and sub-frame can also be switched by operating the directional keys 110. This makes it possible to quickly switch between AF operations at multiple locations.

[0068] Let's assume that the lens is changed from the state shown in Figure 7(A), and the lens unit 300 (two-lens unit) is attached to the camera 100. Then, as shown in Figure 7(B), the live image 700 will display the image area captured via the left eye optical system 301L (live image area) and the image area captured via the right eye optical system 301R (live image area) side by side. In Embodiment 1, the indicator display processing 800, which will be described later, is then executed. As a result, as shown in Figure 7(B), the main frame 721 and sub-frame 722 are displayed superimposed on the right live image area, and the main frame 731 and sub-frame 732 are displayed superimposed on the left live image area. As will be described in detail later, the main frame 721 and main frame 731 correspond to each other. The subframes 722 and 732 are displayed in a manner that corresponds to each other. In addition, a display part indicating the focus status is displayed for each of the main frames 721 and 731. As shown in Figure 7(C), when the main frame 721 is moved by a touch operation on the touch panel 109 (for example, touch move), the main frame 731 also moves in conjunction with it. Similarly, when the subframe 722 is moved, the subframe 732 also moves in conjunction with it. This reduces the effort required from the user and shortens the operation time.

[0069] Furthermore, the appearance of the indicator (such as color or line type) may be changed depending on whether or not an operation related to the indicator is being performed. For example, when the drive of the monocular focusing ring mechanism of the right eye optical system 301R is detected, the color of the indicator displayed in the right live image area may be controlled (changed) to a specific color. Similarly, when the drive of the binocular focusing ring mechanism is detected, the color of the indicator displayed in the left live image area may be controlled (changed) to a specific color. This makes it easier for the user to understand the focus adjustment they are making and to perform focus adjustments. The indicator whose color is controlled may be only the main indicator (main guide), or it may be both the main and sub indicators (main guide and sub guide).

[0070] Furthermore, when the drive of the monocular focusing ring mechanism of the left eye optical system 301L is detected, the color of the indicator displayed in the left live image area may be controlled (changed) to a specific color. In this case as well, when the drive of the monocular focusing ring mechanism of the right eye optical system 301R is detected, the color of the indicator displayed in the right live image area may be controlled (changed) to a specific color. And when the drive of the binocular focusing ring mechanism is detected, the color of the indicators displayed in both the left and right live image areas may be controlled (changed) to a specific color. Doing so will make it easier for the user to understand the focus adjustment they are making, and will make focusing easier.

[0071] <Indicator display processing> Figure 8(A) is a flowchart showing the operation of the camera 100 (indicator display operation, indicator display processing 800) in shooting modes such as still image shooting mode and video shooting mode. This operation is realized by the system control unit 50 loading a program recorded in the non-volatile memory 219 into the system memory 218 and executing it. For example, when the camera 100 is started in shooting mode or when the mode of the camera 100 is switched to shooting mode, the operation shown in Figure 8(A) begins. In the following, it is assumed that the display unit 108 displays the information, but the EVF 217 may also display the information.

[0072] In step S801, the system control unit 50 determines the lens information received at the communication terminal 206 and determines (determines) the mounting status of the lens unit on the camera 100. If it is determined that a single-lens unit (lens unit 200) is mounted on the camera 100, or that no lens unit is mounted on the camera 100, the process proceeds to step S809. Otherwise (if it is determined that a twin-lens unit (lens unit 300) is mounted on the camera 100), the process proceeds to step S802.

[0073] In step S809, the system control unit 50 performs indicator display processing for the single-lens unit. For example, the focus frame 601 in Figure 6(A) and the main frame 701 and sub-frame 702 in Figure 7(A) are displayed superimposed on the live image obtained using the single-lens unit. For the main frame, an indicator part showing the focus status is also displayed. If the lens unit is not attached to the camera 100, the live image is not displayed, and therefore the indicators (focus frame and indicator parts) are not displayed either.

[0074] As mentioned above, the live image obtained using the two-lens unit is two images arranged side by side. It includes two live image areas. In step S802, the system control unit 50 displays indicators in the right live image area. For example, the focus frame 602 in Figure 6(B) and the main frame 721 and sub-frame 722 in Figure 7(B) are displayed superimposed on the right live image area. For the main frame, an indicator part showing the focus status is also displayed.

[0075] In step S803, the system control unit 50 displays indicators in the left live image area. For example, the focus frame 603 in Figure 6(B) and the main frame 731 and sub-frame 732 in Figure 7(B) are displayed superimposed in the left live image area. For the main frame, an indicator part showing the focus status is also displayed. Indicators are displayed in the left live image area to correspond to the indicators displayed in the right live image area. The method for determining the display position of the indicators displayed in the left live image area will be described later.

[0076] While it was stated that indicators are displayed in the right-hand live image area and correspondingly in the left-hand live image area, this is not the only option. For example, indicators may be displayed in the left-hand live image area and correspondingly in the right-hand live image area.

[0077] In step S804, the system control unit 50 waits for instructions from the user and calculates the amount of movement of the indicator in the right live image area or the left live image area according to the user's instructions (for example, a touch move on the touch panel 109). For example, when a touch move is performed by touching the indicator with a finger, the amount of movement of the finger (touch position) in the touch move is calculated as the amount of movement of the touched indicator.

[0078] In step S805, the system control unit 50 performs a linkage amount calculation process. In the linkage amount calculation process, it calculates the amount of linkage required to move the indicator in the other live image area on the right or left in conjunction with the movement of the indicator in one of the live image areas on the right or left (the indicator whose movement amount was calculated in step S804). The linkage amount calculation process will be described later using Figures 8(B) and 8(C). The indicator whose movement amount was calculated in step S804 can also be considered as an indicator specified by the user.

[0079] In step S806, the system control unit 50 determines the indicator to be linked (the indicator to be moved in conjunction with the other indicators). It selects the indicator on the opposite side that corresponds to the indicator whose movement amount was calculated in step S804 (the indicator specified by the user). For example, if the user specifies an indicator in the right live image area, and the movement amount of the indicator in the right live image area is calculated in step S804, the indicator in the left live image area is selected as the linked indicator. Similarly, if the user specifies an indicator in the left live image area, and the movement amount of the indicator in the left live image area is calculated in step S804, the indicator in the right live image area is selected as the linked indicator. If the indicator in the right live image area is selected as the linked indicator, the system proceeds to step S807. Otherwise (if the indicator in the left live image area is selected as the linked indicator), the system proceeds to step S808.

[0080] In step S807, the system control unit 50 moves the indicator in the right live image area by the amount of movement calculated in step S805. In step S808, the system control unit 50 moves the indicator in the left live image area by the amount of movement calculated in step S805.

[0081] <Indicator correlation calculation process> This section explains the process for calculating the indicator's correlation amount (step S805 in Figure 8(A)). Figure 8(B) is a flowchart of the linked amount calculation process 820. Here, we explain an example where the user moves the indicator in the left live image area (left indicator), and the indicator in the right live image area (right indicator) moves in conjunction with it, but the reverse is also possible.

[0082] In step S821, the system control unit 50 moves the left indicator by the amount of movement (movement vector) calculated in step S804 and obtains the display position of the left indicator after the movement. As the coordinates of the display position, for example, coordinates are obtained with the center of the left live image area as the origin.

[0083] In step S822, the system control unit 50 acquires various information necessary to calculate the display position of the right indicator after its movement. For example, the system control unit 50 converts the display position of the left indicator (position on the live image) to the imaging position (position on the imaging unit 211 (on the image sensor)). As the coordinates of the imaging position, for example, coordinates X_L are obtained with the optical axis position of the left eye optical system 301L as the origin. The system control unit 50 also acquires the (common) focal length f of the left eye optical system 301L and the right eye optical system 301R. The system control unit 50 also acquires the distance G (subject distance) from the subject indicated by the left indicator to the left eye optical system 301L or the right eye optical system 301R, and the distance L (optical axis distance L) between the optical axis of the right eye optical system 301R and the optical axis of the left eye optical system 301L. The focal length f and optical axis distance L are predetermined, and the subject distance G is measured by the distance measuring unit of the imaging unit 211.

[0084] In step S823, the system control unit 50 calculates the display position of the right indicator after movement and calculates the amount of movement (vector amount) from the display position before movement to the display position after movement as the linked amount.

[0085] Figure 9 shows the relationship between the imaging position P1 of the subject when using the left eye optical system 301L and the imaging position P2 of the subject when using the right eye optical system 301R. Figure 9 shows the focal length f, subject distance G, and optical axis distance L. The coordinates of imaging position P1' when the optical axis position of the right eye optical system 301R is taken as the origin are the same as the coordinates of imaging position P1 when the optical axis position of the left eye optical system 301L is taken as the origin. In this case, since triangle T1 and triangle T2 are similar, if the distance from imaging position P1' to imaging position P2 is D, then the following equation 1 holds. G=(L×f) / D (Formula 1)

[0086] If X_R is the coordinate of the imaging position corresponding to the display position after the movement of the right indicator (coordinates with the optical axis position of the right eye optical system 301R as the origin), then the difference between coordinate X_R and coordinate X_L (X_R-X_L) corresponds to the distance D described above. Therefore, the system control unit 50 can calculate the coordinate X_R using the following equation 2. Then, the system control unit 50 can determine the display position after the movement of the right indicator from the calculated coordinate X_R. As the coordinate of the display position, for example, coordinates with the center of the right live image area as the origin can be obtained. X_R=X_L+(L×f) / G (Formula 2)

[0087] The linkage amount calculation process 820 allows for more accurate correspondence between the left and right indicators (left indicator and right indicator). For example, a subject captured by the left indicator can be more reliably captured by the right indicator. If the coordinate X_R is calculated to be outside the right live image area, the color of the left and right indicators may be changed, or a pop-up warning may be displayed on the display unit 108. In step S803 of Figure 8(A), the display position of the left indicator can also be determined in the same way as described above.

[0088] Let's explain another example of the linkage amount calculation process (step S805 in Figure 8(A)). Figure 8(C) is a flowchart of the linkage amount calculation process 840. In step S803 in Figure 8(A), for example, the display position of the left indicator is determined so that the coordinates of the right indicator, with the center of the right live image region as the origin, coincide with the coordinates of the left indicator, with the center of the left live image region as the origin. This process can also be understood as the process of determining the display position of the left indicator so that the relative position of the right indicator with respect to the right live image region coincides with the relative position of the left indicator with respect to the left live image region. In that case, if the right indicator is displayed at the center of the right live image region in step S802, then in step S803, the left indicator will be displayed at the center of the left live image region.

[0089] In step S841, the system control unit 50 acquires information about the relative positional relationship between the left and right indicators (relative position information). For example, relative position information is generated from the display position of the left indicator and the display position of the right indicator. The generated relative position information may be stored in the system memory 218 and read from the system memory 218 for use in the next processing. Relative position information is, for example, a vector quantity pointing from one left or right indicator to the other left or right indicator.

[0090] In step S842, the system control unit 50 determines whether the indicator whose movement amount was calculated in step S804 of Figure 8(A) (the indicator specified by the user) is the right indicator or the left indicator. If it is determined to be the left indicator, the process proceeds to step S843; if it is determined to be the right indicator, the process proceeds to step S845.

[0091] In step S843, the system control unit 50 moves the left indicator by the amount of movement (vector amount) calculated in step S804. In step S844, the system control unit 50 determines the amount of movement calculated in step S804 as the linked amount in order to move the right indicator by the amount of movement calculated in step S804 as well. The display position of the right indicator after linked movement may be calculated from the display position of the left indicator after the movement in step S843 and the relative position information acquired in step S841. The amount of movement (vector amount) from the current display position of the right indicator to the calculated display position may then be calculated as the linked amount.

[0092] In step S845, the system control unit 50 moves the right indicator by the amount of movement (vector amount) calculated in step S804. In step S846, the system control unit 50 updates the relative position information stored in the system memory 218 based on the display position of the right indicator after the movement in step S845.

[0093] According to the linkage amount calculation process 840, even if the imaging unit 211 does not have a distance measuring unit, or if the distance measuring accuracy of the distance measuring unit is poor, it is possible to efficiently set the linkage amount of the indicator. If the coordinate X_R is calculated to be outside the right live image area, the color of the left indicator or the right indicator may be changed, or a pop-up warning may be displayed on the display unit 108.

[0094] Even if the imaging unit 211 does not have a distance measuring unit, or if the distance measuring accuracy of the distance measuring unit is poor, the display position of the indicator may be determined by using a predetermined distance as the subject distance G and performing a calculation as shown in Equation 2. The predetermined distance is, for example, a shooting distance that allows for stereoscopic viewing suitable for VR display (for example, stereoscopic viewing with high three-dimensionality and little blurring).

[0095] When performing the linkage amount calculation process 840, the relative positions of the left and right indicators are maintained, and the right indicator moves in conjunction with the movement of the left indicator. When the right indicator is moved, the left indicator does not move in conjunction. This makes it possible, for example, to move both the left and right indicators and then fine-tune the position of the right indicator. Alternatively, the left indicator may move in conjunction with the right indicator. In that case, the left indicator may or may not move in conjunction with the left indicator.

[0096] [Embodiment 2] Embodiment 2 of the present invention will now be described. Embodiment 2 describes an example in which a face frame is used as the indicator. The configuration of the camera 100, lens unit 200, and lens unit 300 is the same as in Embodiment 1.

[0097] <Indicator Operation> The indicator operation according to Embodiment 2 and the corresponding operation will be explained using Figures 10(A) and 10(B). Figure 10(A) shows a comparative example. The live image 1000 in Figure 10(A) is a live image obtained using a twin-lens unit. Various information such as imaging parameters, number of recorded images, and battery level may be superimposed and displayed on the periphery of the live image 1000. In the left live image area, a face frame 1001 and display parts 1011 and 1012 indicating the focus status are displayed. In the left live image area, the face is in the center, so the distortion of the face is small and the face can be detected. On the other hand, in the right live image area, the face is shifted to the periphery (the periphery of the right live image area) due to parallax, so the distortion of the face is large and the face cannot be detected.

[0098] Figure 10(B) shows an example of the display in Embodiment 2. When the indicator display process 1100, which will be described later, is executed, the face frame 1021 and the display parts 1031 to 1033 indicating the focus status are also displayed in the live image area on the right. In the example in Figure 10(A), the user can check the focus status in the live image area on the right if they can set a focus frame in the live image area on the right. However, in Embodiment 2, the user can check the focus status in the live image area on the right because the face frame (focus frame) is automatically displayed in the live image area on the right without having to perform the operation of setting a focus frame in the live image area on the right.

[0099] <Indicator display processing> The indicator display process according to Embodiment 2 will be explained using Figure 11. Figure 11 is a flowchart of the indicator display process 1100 according to Embodiment 2. The operation in Figure 11 is realized when the system control unit 50 loads the program recorded in the non-volatile memory 219 into the system memory 218 and executes it. For example, when the camera 100 is started in shooting mode, or when the mode of the camera 100 is switched to shooting mode, the operation in Figure 11 begins. In the following, it will be assumed that the display is performed on the display unit 108, but the following display may be performed on the EVF 217.

[0100] In step S1101, the system control unit 50 determines whether or not to perform face detection. Whether or not to perform face detection can be set in advance, for example. If it is determined that face detection should be performed, the process proceeds to step S801; otherwise (if it is determined that face detection should not be performed), the indicator display process 1100 is terminated. In step S801, if it is determined that a single-lens unit (lens unit 200) is attached to the camera 100, or that no lens unit is attached to the camera 100, the process proceeds to step S809, as in Embodiment 1. Otherwise (if it is determined that a twin-lens unit (lens unit 300) is attached to the camera 100), the process proceeds to step S1102.

[0101] In step S1102, the system control unit 50 determines whether the first association has been completed. The first association is the process of setting the face frame associated with the left face detection frame (a face frame indicating a face detected from the left live image area) to the right live image area. If it is determined that the first association has been completed, that is, that the first association has been performed for all left face detection frames, the system proceeds to step S1108; otherwise (if it is determined that the first association has not been completed), the system proceeds to step S1103.

[0102] In step S1103, the system control unit 50 obtains the display position of the left face detection frame to which the right face frame (face frame in the right live image area) is not associated.

[0103] In step S1104, the system control unit 50 calculates (estimates) the display position of the right face frame corresponding to the left face detection frame whose display position was obtained in step S1103, using the same method as the interlocking amount calculation process 820 in Figure 8(B).

[0104] In step S1105, the system control unit 50 determines whether or not there is a right face frame at the display position calculated in step S1104 (which may include its vicinity). This process can also be understood as determining whether or not a face has been detected at the display position calculated in step S1104. If it is determined that there is a right face frame (a face has been detected), the process proceeds to step S1107; otherwise (if it is determined that there is no right face frame (a face has not been detected)), the process proceeds to step S1106.

[0105] In step S1106, the system control unit 50 sets the right face frame at the display position calculated in step S1104. For example, even if a face is not detected at the display position calculated in step S1104, the system control unit updates the list that manages the face detection results for the right live image region so that it is considered that a face has been detected.

[0106] In step S1107, the system control unit 50 associates the left face detection frame, whose display position was obtained in step S1103, with the right face frame, whose display position was calculated in step S1104.

[0107] In step S1108, the system control unit 50 determines whether the second association has been completed. The second association is the process of setting the face frame associated with the right face detection frame (a face frame indicating a face detected from the right live image area) to the left live image area. The second association is performed on right face detection frames that are not associated with a left face detection frame. If it is determined that the second association has been completed, that is, that the second association has been performed on all right face detection frames that are not associated with a left face detection frame, the indicator display process 1100 is terminated. Otherwise (if it is determined that the second association has not been completed), the process proceeds to step S1109.

[0108] In step S1109, the system control unit 50 obtains the display position of the right face detection frame to which the left face frame (face frame in the left live image area) is not associated.

[0109] In step S1110, the system control unit 50 calculates the display position of the left face frame corresponding to the right face detection frame whose display position was obtained in step S1109, using the same method as the interlocking amount calculation process 820 in Figure 8(B).

[0110] In step S1111, the system control unit 50 determines whether or not there is a left face frame at the display position calculated in step S1110 (which may include its vicinity). This process can be understood as determining whether or not a face is detected at the display position calculated in step S1110. It is also possible to do the following: If it is determined that there is a left face frame (a face has been detected), proceed to step S1113; otherwise (if it is determined that there is no left face frame (a face has not been detected)), proceed to step S1112.

[0111] In step S1112, the system control unit 50 sets the left face frame at the display position calculated in step S1110. For example, even if a face is not detected at the display position calculated in step S1110, the system control unit updates the list that manages the results of face detection for the left live image region so that it is considered that a face has been detected.

[0112] In step S1113, the system control unit 50 associates the right face detection frame whose display position was obtained in step S1109 with the right face frame of the display position calculated in step S1110.

[0113] According to Embodiment 2, if a right face frame exists at the display position of the right face frame corresponding to the left face detection frame, the existing right face frame is recognized as the right face frame corresponding to the left face detection frame. If a right face frame does not exist at the display position of the right face frame corresponding to the left face detection frame, the system is controlled to display the right face frame at that position. Similarly, if a left face frame exists at the display position of the left face frame corresponding to the right face detection frame, the existing left face frame is recognized as the left face frame corresponding to the right face detection frame. If a left face frame does not exist at the display position of the left face frame corresponding to the right face detection frame, the system is controlled to display the left face frame at that position. In this way, even if a face frame is used for the indicator, or even if the indicator is a face frame, the indicator can be displayed suitably with reduced effort for the user.

[0114] Furthermore, various modifications can be made according to the user's preferred operability. For example, when a single-lens unit is attached, the autofocus processing target can be switched between multiple face frames using the directional keys 110. When a dual-lens unit is attached, as shown in Figure 10(C), the operation of the directional keys 110 may link the switching of the processing target in the left live image area and the switching of the processing target in the right live image area. Alternatively, the operation of the directional keys 110 may only switch either the processing target in the left live image area or the processing target in the right live image area. In that case, the live image area whose processing target is switched by the operation of the directional keys 110 may be switched by a touch operation on the touch panel 109 (for example, tapping on the live image area whose processing target is to be switched). In addition, the association of face frames may be indicated by the color, line type, subscript, etc.

[0115] [Embodiment 3] Embodiment 3 of the present invention will now be described. In Embodiment 3, the indicator that is displayed in conjunction is a sub-indicator (sub-guide). It is possible to set whether or not to display the sub-indicator, but even if the setting is to not display the sub-indicator, the sub-indicator will be displayed in conjunction. The configuration of the camera 100, lens unit 200, and lens unit 300 is the same as in Embodiment 1.

[0116] <Indicator Operation> The indicator operation according to Embodiment 3 and the corresponding operation will be explained using Figures 12(A) to 12(C). Figure 12(A) shows the live image 1200 displayed on the display unit 108 (or EVF 217) when the lens unit 200 (single-lens unit) is attached to the camera 100. In Figure 12(A), the main frame 1201 is superimposed on the live image 1200 as a focus frame. Display parts 1211 and 1212 indicating the focus status are displayed on the main frame 1201. The sub-frame is not displayed because the setting to not display the sub-indicator is disabled. For example, the user You can switch whether or not to display the sub-indicator on the menu screen depending on the shooting scene. If the setting to display the sub-indicator is enabled, the sub-frame will also be displayed. The main frame and sub-frame can be swapped using touch or key operations.

[0117] Let's assume that the lens is changed from the state shown in Figure 12(A), and the lens unit 300 (two-lens unit) is attached to the camera 100. Then, as shown in Figure 12(B), the live image 1200 will display the image area captured via the left eye optical system 301L (live image area) and the image area captured via the right eye optical system 301R (live image area) side by side. In Embodiment 3, the indicator display processing 1300, which will be described later, is then executed. As a result, as shown in Figure 12(B), even if the setting is not to display the sub-indicator, the main frame 1221 is superimposed on the right live image area, and the sub-frame 1231 is superimposed on the left live image area. The main frame 1221 and the sub-frame 1231 are displayed corresponding to each other. In addition, an indicator part showing the focus status is displayed relative to the main frame 1221. As shown in Figure 12(C), when the main frame 1221 is moved by a touch operation on the touch panel 109 (for example, touch move), the sub-frame 1231 also moves in conjunction with it. Furthermore, the main frame and sub-frame can be swapped using main / sub swapping operations such as touch operations or key operations. This reduces the effort required from the user and shortens the operation time.

[0118] Furthermore, when displaying live images obtained using a single-lens unit, one main indicator and one or more sub-indicators can be displayed. When displaying live images obtained using a dual-lens unit, only one main indicator is displayed, so the processing used when using a single-lens unit can be utilized, and the increase in the capacity of the non-volatile memory 219 can be suppressed. By displaying the focus status indicator part in only one of the live image areas, the processing load can be reduced. If it is desired to check the focus status of both the left and right live image areas simultaneously, the main indicator (main frame and focus status indicator part) can be displayed in both the left and right live image areas, as shown in Figure 6(B).

[0119] <Indicator display processing> The indicator display process according to Embodiment 3 will be explained using Figure 13. Figure 13 is a flowchart of the indicator display process 1300 according to Embodiment 3. The operation in Figure 13 is realized when the system control unit 50 loads the program recorded in the non-volatile memory 219 into the system memory 218 and executes it. For example, when the camera 100 is started in shooting mode, or when the mode of the camera 100 is switched to shooting mode, the operation in Figure 13 begins. In the following, it will be assumed that the display is performed on the display unit 108, but the following display may be performed on the EVF 217. Also, in Figure 13, the same processes as in Figure 8 (Embodiment 1) are denoted by the same reference numerals as in Figure 8, and their explanations are omitted.

[0120] In step S1301, the system control unit 50 sets the sub-indicator to display. This forces the setting to display the sub-indicator, even if it was set not to display before the twin-lens unit was installed. At this time, the setting value before the change may be retained, and the setting may be restored to the previous value after the twin-lens unit is removed. Alternatively, the setting may be left unchanged, and the sub-indicator may be forced to display.

[0121] In step S1302, the system control unit 50 displays the main indicator in the right live image area. In step S1303, the system control unit 50 displays the sub-indicator in the left live image area.

[0122] While it was stated that the main indicator is displayed in the right-hand live image area and the sub-indicators are displayed in the left-hand live image area in a corresponding manner, this is not the only option. For example, the main indicator could be displayed in the left-hand live image area and the sub-indicators in the right-hand live image area in a corresponding manner.

[0123] Although the present invention has been described in detail above based on its preferred embodiments, the present invention is not limited to these specific embodiments, and various forms that do not depart from the spirit of the invention are also included in the present invention. Furthermore, each of the embodiments described above is merely one embodiment of the present invention, and it is possible to combine each embodiment as appropriate.

[0124] For example, while we have described an example where the indicator includes a focus guide frame and a face frame, the indicator may also include frames that assist in exposure adjustment, such as an automatic exposure frame that defines the range for automatic exposure adjustment. Furthermore, the various controls described above as being performed by the system control unit 50 may be performed by a single piece of hardware, or multiple pieces of hardware (for example, multiple processors or circuits) may share the processing to control the entire device.

[0125] Furthermore, the present invention is not limited to cameras (imaging devices), but can be applied to any electronic device that can be controlled to overlay an indicator onto an captured image. For example, the present invention can be applied to PDAs, mobile phone terminals and portable image viewers, printers, digital photo frames, music players, game consoles, e-book readers, etc. The present invention can also be applied to video players, display devices (including projection devices), tablet terminals, smartphones, AI speakers, home appliances and in-vehicle devices, etc. The present invention can also be applied to multi-lens smartphones that have multiple optical systems of different types, such as standard lenses, wide-angle lenses, and zoom lenses. Even in such cases, if the focal lengths (zoom magnification) of the two optical systems used are matched (made common) and shooting is performed, a stereoscopic image can be obtained.

[0126] <Other Embodiments> The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions. [Explanation of Symbols]

[0127] 100: Digital camera 50: System control unit

Claims

1. An acquisition means for acquiring an image captured by an image sensor, An operating means that accepts user input, A display control means controls the image acquired by the acquisition means to be displayed, and controls the display to overlay an indicator on the image. It has, The display control means is When the acquisition means acquires a first image in which a first image region captured via the first optical system and a second image region captured via the second optical system are arranged side by side, The system is controlled to overlay the first indicator onto the first image region, The system is controlled to overlay the second indicator onto the second image region, In response to the user performing an operation to move one of the first indicator and the second indicator, the system controls the movement of one of the first indicator and the second indicator. The movement of one of the first indicator and the second indicator is controlled to move the other of the first indicator and the second indicator in conjunction with the movement of the other of the first indicator and the second indicator. If the acquisition means acquires a second image different from the first image, in which the first image region and the second image region are arranged side by side, The system is controlled to overlay the first indicator onto the second image. The system is controlled to overlay the second indicator onto the second image, In response to the user performing an operation to move the first indicator, the system controls the movement of the first indicator, and controls the system to prevent the movement of the second indicator in conjunction with the movement of the first indicator. In response to the user performing an operation to move the second indicator, the system controls the movement of the second indicator, and controls the system to prevent the first indicator from moving in conjunction with the movement of the second indicator. An electronic device characterized by the following features.

2. The first image, in which the first image region and the second image region are arranged side by side, is the first light This is an image captured using a lens unit that includes the lens system and the second optical system. The electronic device according to feature 1.

3. Acquisition means for acquiring an image captured by an image sensor, An operating means that accepts user input, A display control means controls the image acquired by the acquisition means to be displayed, and controls the display to overlay an indicator on the image. It has, When the acquisition means acquires an image in which a first image region captured via the first optical system and a second image region captured via the second optical system are side by side, The display control means is The system is controlled to overlay the first indicator onto the first image region, The system is controlled to overlay the second indicator onto the second image region, In response to the user performing an operation to move one of the first indicator and the second indicator, the system controls the movement of one of the first indicator and the second indicator. The movement of one of the first indicator and the second indicator is controlled to move the other of the first indicator and the second indicator in conjunction with the movement of the other of the first indicator and the second indicator. The first position of the first indicator on the image sensor is determined from the display position of the first indicator. The second position of the second indicator on the image sensor is determined from the first position of the first indicator on the image sensor, the common focal length of the first optical system and the second optical system, the distance from the subject indicated by the first indicator to the first optical system or the second optical system, and the distance between the optical axis of the first optical system and the optical axis of the second optical system. The display position of the second indicator is determined from the second position. An electronic device characterized by the following features.

4. Acquisition means for acquiring an image captured by an image sensor, An operating means that accepts user input, A display control means controls the image acquired by the acquisition means to be displayed, and controls the display to overlay an indicator on the image. It has, When the acquisition means acquires an image in which a first image region captured via the first optical system and a second image region captured via the second optical system are side by side, The display control means is The system is controlled to overlay the first indicator onto the first image region, The system is controlled to overlay the second indicator onto the second image region, In response to the user performing an operation to move one of the first indicator and the second indicator, the system controls the movement of one of the first indicator and the second indicator. The movement of one of the first indicator and the second indicator is controlled to move the other of the first indicator and the second indicator in conjunction with the movement of the other of the first indicator and the second indicator. The first and second indicators include a frame that assists in focusing. An electronic device characterized by the following features.

5. At least one of the first indicator and the second indicator indicates the focus state. The electronic device according to feature 4.

6. Acquisition means for acquiring an image captured by an image sensor, An operating means that accepts user input, A display control means controls the image acquired by the acquisition means to be displayed, and controls the display to overlay an indicator on the image. It has, When the acquisition means acquires an image in which a first image region captured via the first optical system and a second image region captured via the second optical system are side by side, The display control means is The system is controlled to overlay the first indicator onto the first image region, The system is controlled to overlay the second indicator onto the second image region, In response to the user performing an operation to move one of the first indicator and the second indicator, the system controls the movement of one of the first indicator and the second indicator. The movement of one of the first indicator and the second indicator is controlled to move the other of the first indicator and the second indicator in conjunction with the movement of the other of the first indicator and the second indicator. The first indicator and the second indicator include a face frame, The display control means is The first position of the first indicator on the image sensor is determined from the display position of the first indicator. The second position of the second indicator on the image sensor is determined from the first position of the first indicator on the image sensor, the common focal length of the first optical system and the second optical system, the distance from the subject indicated by the first indicator to the first optical system or the second optical system, and the distance between the optical axis of the first optical system and the optical axis of the second optical system. The display position of the second indicator is determined from the second position, If a face frame exists at the display position of the second indicator, the face frame is recognized as the second indicator. If a face frame does not exist at the display position of the second indicator, the system is controlled to display the second indicator at that position. An electronic device characterized by the following features.

7. Acquisition means for acquiring an image captured by an image sensor, An operating means that accepts user input, A display control means controls the image acquired by the acquisition means to be displayed, and controls the display to overlay an indicator on the image. It has, When the acquisition means acquires an image in which a first image region captured via the first optical system and a second image region captured via the second optical system are side by side, The display control means is The system is controlled to overlay the first indicator onto the first image region, The system is controlled to overlay the second indicator onto the second image region, In response to the user performing an operation to move one of the first indicator and the second indicator, the system controls the movement of one of the first indicator and the second indicator. The movement of one of the first indicator and the second indicator is controlled to move the other of the first indicator and the second indicator in conjunction with the movement of the other of the first indicator and the second indicator. The first indicator and the second indicator include a frame that assists in exposure adjustment. An electronic device characterized by the following features.

8. Acquisition means for acquiring an image captured by an image sensor, An operating means that accepts user input, A display control means controls the display of the image acquired by the acquisition means, and controls the display of a first type indicator and a second type indicator superimposed on the image, A setting means for setting whether or not to display the second type of indicator, It has, The display control means is If the acquisition means acquires an image different from the image obtained by aligning the first image region captured via the first optical system and the second image region captured via the second optical system, The system controls the image acquired by the acquisition means to overlay and display the first type of indicator. The system controls the display of the second type of indicator overlaid on the image, according to the setting for whether or not to display the second type of indicator. When the acquisition means acquires the image in which the first image region and the second image region are arranged side by side, Even if the setting is configured not to display the second type of indicator, the system is controlled to overlay the first type of indicator onto the first image area and to overlay the second type of indicator onto the second image area. In response to the user performing an operation to move one of the first type of indicator and the second type of indicator, control is made to move one of the first type of indicator and the second type of indicator. The movement of one of the first type of indicator and the second type of indicator is controlled to move the other of the first type of indicator and the second type of indicator in conjunction with the movement of the other of the first type of indicator and the second type of indicator. An electronic device characterized by the following features.

9. An acquisition step to acquire an image captured by an image sensor, An operation step that accepts user input, A display control step which controls the system to display the image acquired in the acquisition step and to overlay an indicator on the image. It has, In the aforementioned display control step, In the acquisition step, if a first image is acquired in which a first image region captured through the first optical system and a second image region captured through the second optical system are arranged side by side, The system is controlled to overlay the first indicator onto the first image region, The system is controlled to overlay the second indicator onto the second image region, In response to the user performing an operation to move one of the first indicator and the second indicator, the system controls the movement of one of the first indicator and the second indicator. The movement of one of the first indicator and the second indicator is controlled to move the other of the first indicator and the second indicator in conjunction with the movement of the other of the first indicator and the second indicator. In the acquisition step described above, if a second image different from the first image, in which the first image region and the second image region are arranged side by side, The system is controlled to overlay the first indicator onto the second image. The system is controlled to overlay the second indicator onto the second image, In response to the user performing an operation to move the first indicator, the system controls the movement of the first indicator, and controls the system to prevent the movement of the second indicator in conjunction with the movement of the first indicator. In response to the user performing an operation to move the second indicator, the system controls the movement of the second indicator, and controls the system to prevent the first indicator from moving in conjunction with the movement of the second indicator. A method for controlling electronic equipment characterized by the following features.

10. A program for causing a computer to function as one of the means of an electronic device according to any one of claims 1 to 8.

11. A computer-readable storage medium storing a program for causing a computer to function as one of the means of an electronic device according to any one of claims 1 to 8.

Images