Image pickup apparatus, control method thereof, storage medium, and computer program product

Abstract

The invention relates to an image pickup apparatus, a control method thereof, a storage medium, and a computer program product. The image pickup apparatus includes at least one image sensor, a focus detector, a control unit configured to perform focus control of each of a first optical system and a second optical system based on a focus state, and an input unit configured to cause a user to input a first target position in an image pickup range through the first optical system. The control unit is configured to perform focus control of the first optical system in accordance with a focus state at a first target position, set a second target position corresponding to the first target position in an imaging range through the second optical system, perform focus control of the second optical system in accordance with a focus state at the second target position, and notifying a user of completion of the focusing control of each of the first optical system and the second optical system.

Description

Technical Field

[0001] The present disclosure relates to an imaging device configured to perform stereoscopic imaging. Background Art

[0002] As an imaging lens configured to provide stereoscopic imaging, Japanese Patent Laid-Open Nos. 2012-003022 and 2012-113281 disclose two optical systems arranged in parallel, wherein imaging circles of the two optical systems are formed on a single image sensor. By capturing an object image formed by the two optical systems to generate two captured images with parallax, a user can view images with a stereoscopic effect by observing them with his right eye and left eye.

[0003] When taking an image using such an imaging lens, the two optical systems each focus on the same subject. Japanese Patent Laid-Open No. 2009-175498 discloses a pair of binoculars configured to adjust the diopter of a left optical system and a right optical system by moving one of the optical systems and to perform simultaneous focusing by moving the two optical systems, wherein the pair of binoculars includes a single operating member configured to switch between these functions.

[0004] However, in a configuration in which the diopter adjustment function and the focus adjustment function are switched by operating a single operation member as disclosed in Japanese Patent Laid-Open No. 2009-175498, the operation is complicated and it is difficult to perform quick and accurate focusing.

[0005] In addition, the autofocus (AF) of the two optical systems on the same object can set the target position of AF corresponding to the object position within the imaging range of each optical system based on the parallax of the optical system. In addition, the user can be appropriately notified of the completion of AF of the two optical systems. Summary of the invention

[0006] An imaging device according to one aspect of the present disclosure includes: at least one image sensor configured to capture two subject images formed by a first optical system and a second optical system arranged in parallel; a focus detector configured to detect a focus state using a signal output from the image sensor; a control unit configured to perform focus control of each of the first optical system and the second optical system based on the focus state; and an input unit configured to allow a user to input a first target position in an imaging range passing through the first optical system. The control unit is configured to: perform focus control of the first optical system according to the focus state at the first target position, set a second target position corresponding to the first target position in an imaging range passing through the second optical system, perform focus control of the second optical system according to the focus state at the second target position, and notify the user of completion of focus control of each of the first optical system and the second optical system. A control method corresponding to the above imaging device also constitutes another aspect of the present disclosure. A storage medium storing a program for causing a computer to execute the above control method also constitutes another aspect of the present disclosure.

[0007] Further features of various embodiments of the present disclosure will become apparent from the following description of the embodiments with reference to the accompanying drawings. BRIEF DESCRIPTION OF THE DRAWINGS

[0008] Figure 1 is a cross-sectional view of a stereoscopic imaging lens for an imaging apparatus according to the present embodiment.

[0009] Figure 2 The arrangement of the stereo camera lens and the imaging circle on the image sensor is shown.

[0010] Figure 3 : is a block diagram showing the configuration of an image pickup apparatus according to Example 1 to which a stereo image pickup lens is mounted.

[0011] Figure 4 Display of a parallax image is shown.

[0012] Figure 5 is a flowchart illustrating the AF processing according to Example 1.

[0013] Figure 6 : is a block diagram showing the configuration of an image pickup apparatus according to Example 2 to which a stereo image pickup lens is mounted.

[0014] Figure 7 is a flowchart illustrating AF processing according to Example 3.

[0015] Figure 8 is a flowchart illustrating AF processing according to Example 4.

[0016] Fig. 9 is a flowchart illustrating MF processing according to Example 5. DETAILED DESCRIPTION

[0017] Hereinafter, the term "unit" may refer to a software context, a hardware context, or a combination of software and hardware contexts. In the software context, the term "unit" refers to functionality, applications, software modules, functions, routines, instruction sets, or programs that can be executed by a programmable processor such as a microprocessor, a central processing unit (CPU), or a specially designed programmable device or controller. The memory contains instructions or programs that cause the CPU to perform operations corresponding to the unit or function when executed by the CPU. In the hardware context, the term "unit" refers to a hardware element, circuit, assembly, physical structure, system, module, or subsystem. According to a specific embodiment, the term "unit" may include mechanical, optical, or electronic components, or any combination thereof. The term "unit" may include active (e.g., transistors) or passive (e.g., capacitors) components. The term "unit" may include a semiconductor device having a substrate and other material layers containing various conductivity concentrations. The term "unit" may include a CPU or a programmable processor that can execute a program stored in a memory to perform a specified function. The term "unit" may include a logic element (e.g., AND, OR) implemented by a transistor circuit or any other switching circuit. In the combination of software and hardware contexts, the term "unit" or "circuit" refers to any combination of software and hardware contexts as described above. In addition, the term "element", "assembly", "component" or "device" may also refer to a "circuit" that is integrated or not integrated with packaging materials.

[0018] Referring now to the drawings, a description will be given of embodiments according to the present disclosure.

[0019] The imaging apparatus according to the present embodiment is attachable to and detachable from an imaging lens for stereoscopic imaging, the imaging lens having a first optical system and a second optical system arranged in parallel at a predetermined distance (base line length). The imaging lens can be integrated with the imaging apparatus.

[0020] The first optical system and the second optical system form a subject image (imaging circle) as two optical images on a single image sensor provided in the camera. The camera captures the two subject images using an image sensor and generates the two captured images with parallax (a pair of parallax images). The captured image of the right eye generated by capturing an image by one of the first optical system and the second optical system and the captured image of the left eye generated by capturing an image by the other optical system are displayed to the right eye and left eye of the user via a display device such as a three-dimensional display or VR goggles. The parallax between the captured images of the right eye and the left eye allows the user to view an image with a stereoscopic effect.

[0021] Figure 1 The configuration of the imaging lens 200 viewed from above is shown. The imaging lens 200 includes a right-eye optical system 201R as a first optical system and a left-eye optical system 201L as a second optical system. The right-eye optical system 201R and the left-eye optical system 201L are each fixed to a lens top base 240 by screws or the like. The left-eye optical system 201L may be the first optical system, and the right-eye optical system 201R may be the second optical system.

[0022] In the following description, reference numerals in the description of the right-eye optical system 201R will be suffixed with R, and reference numerals in the description of the left-eye optical system 201L will be suffixed with L. For reference numerals in the description common to both the right-eye optical system 201R and the left-eye optical system 201L, R and L will be omitted.

[0023] The right-eye optical system 201R and the left-eye optical system 201L each have an effective viewing angle of 120° or greater. In each optical system, from the object side to the image side, a first optical axis OA1, a second optical axis OA2 perpendicular to the first optical axis OA1 (bent 90°), and a third optical axis OA3 perpendicular to the second optical axis OA2 (parallel to the first optical axis OA1) are set. A first lens unit 211 having a lens surface 211A convex to the object side is arranged along the first optical axis OA1, and a second lens unit 221 is arranged along the second optical axis OA2. A third lens unit 231 is arranged along the third optical axis OA3. Each optical system has a first prism 220 that reflects a light beam from the first lens unit 211 and guides it to the second lens unit 221, and a second prism 230 that reflects a light beam from the second lens unit 221 and guides it to the third lens unit 231.

[0024] In the following description, an optical axis direction refers to a direction extending from the object side to the image side, such as a first optical axis OA1 and a third optical axis OA3 .

[0025] Figure 2 The relationship between the positions of the first optical axis OA1 and the third optical axis OA3 of the right-eye optical system 201R and the left-eye optical system 201L viewed from the object side and the positions of the imaging circles ICR and ICL on the image sensor 120 in the imaging apparatus is shown.

[0026] In the right area of ​​the image sensor 120 ( Figure 2 In the left area of ​​the image sensor 120 ( Figure 2In the area on the right side of the left eye optical system 201L, the left eye imaging circle ICL is formed within its effective viewing angle. The diameter ΦD2 of each imaging circle and the distance between the centers of the imaging circles ICR and ICL (i.e., the distance between the third optical axis OA3) are set so that the imaging circles ICR and ICL do not overlap each other.

[0027] Each optical system may be configured as a full-circle fisheye lens, and a subject image having a viewing angle range exceeding 180° may be formed as a circular image on the image sensor 120 .

[0028] The distance between the first optical axis OA1R of the right-eye optical system 201R and the first optical axis OA1L of the left-eye optical system 201L is the baseline length L1, and as the baseline length L1 increases, the stereoscopic effect given to the user by a pair of parallax images becomes stronger. For example, the size of the image sensor 120 is 24 mm vertically × 36 mm horizontally, the diameter of the imaging circle is Φ17 mm, the distance L2 between the third optical axis OA3 is 18 mm, and the length of the second optical axis OA2 is 21 mm. In the case where the respective optical systems are arranged so that the second optical axis OA2 extends in the lateral (left-right) direction, Figure 1 The baseline length L1 shown in FIG. 5 is 60 mm, which is approximately equal to the interpupillary width of an adult.

[0029] It is believed that the viewing angle at which a person viewing a pair of parallax images can obtain a stereoscopic effect is about 120°, but since a viewing angle of 120° tends to leave an uncomfortable feeling, the viewing angle is generally widened to about 180°. In the present embodiment, since the effective viewing angle exceeds 180°, the diameter ΦD3 of the imaging circle within the range of the viewing angle of 180° has the relationship: ΦD2>ΦD3.

[0030] Example 1

[0031] Figure 3 The configuration of a stereo camera system including an imaging lens 200 and an imaging apparatus 100 having an image sensor 120 is shown. The imaging lens 200 is attached to the imaging apparatus 100 via a mount not shown and is detachable from the imaging apparatus 100. The imaging lens 200 includes a lens control unit 209, a first lens driving unit 501, a second lens driving unit 502, a manual focus (MF) ring (focus operating member) 601, an encoder 602, and an AF / MF switch 700. The imaging apparatus 100 includes an image sensor 120, an A / D converter 130, an image processing unit 140, a display unit 150, an operation unit 160, a memory 170, an AF detector 180, and a camera control unit 190.

[0032] The lens control unit 209 and the camera control unit 190 each include a computer such as a CPU and can communicate with each other.

[0033] In the imaging lens 200, the first lens driving unit 501 and the second lens driving unit 502 are actuators such as stepping motors or voice coil motors for independently performing focus driving of the right eye optical system 201R and the left eye optical system 201L. The first lens driving unit 501 and the second lens driving unit 502 are controlled by a lens control unit 209 for receiving a focus command from the camera control unit 190 via communication. Thus, the right eye optical system 201R and the left eye optical system 201L perform independent AF. In AF, the entire optical system may be moved in the optical axis direction, or the focus lenses in the respective optical systems may be moved in the optical axis direction.

[0034] A single MF ring 601 is provided for both the right-eye optical system 201R and the left-eye optical system 201L, and is rotated by the user. The encoder 602 detects the rotation amount of the MF ring 601. The lens control unit 209 controls the first lens driving unit 501 and the second lens driving unit 502 according to the rotation amount of the MF ring 601 detected by the encoder 602. Thus, MF is performed on the right-eye optical system 201R and the left-eye optical system 201L. The specific control in MF will be described later according to Example 5. The user operation of the AF / MF switch 700 can switch between the AF mode in which AF is performed in the imaging lens 200 and the MF mode in which MF is performed.

[0035] In the image pickup apparatus 100, the image sensor 120 includes a photoelectric conversion element such as a CMOS sensor, and converts an object image formed by the right-eye optical system 201R and the left-eye optical system 201L into an analog electric signal. The A / D converter 130 converts the analog electric signal output from the image sensor 120 into a digital electric signal. The image processing unit 140 performs various image processing on the digital electric signal output from the A / D converter 130 to generate a pair of parallax images as image data.

[0036] The display unit 150 displays the pair of parallax images and various information related to image capturing. An electronic viewfinder or a liquid crystal panel is used as the display unit 150 .

[0037] The operation unit 160 has a user interface function that can be operated by a user who issues instructions to the camera apparatus 100. In the case where the display unit 150 has a touch panel, the touch panel is also included in the operation unit 160. The operation unit 160 in this example has an AF point input component (input part) 161 and an AF indication component 162. The AF point input component 161 can be operated by the user to select (input) an AF point within the camera range, where the AF point is a target position where the user wants to obtain a focus state through AF, and the camera range is a viewing angle range captured by the right eye optical system 201R. The AF point input component 161 may include a touch panel, a joystick, etc. The AF indication component 162 can be operated by the user to indicate the start of AF at the selected AF point. The AF indication component 162 may include a touch panel, a button, etc.

[0038] The memory 170 stores various data such as image data output from the image processing unit 140. The memory 170 also stores programs used by the camera control unit 190 to operate. The memory 170 includes a ROM, a RAM, a HDD, and the like.

[0039] The AF detector 180 detects the focus state for the subject (distance) located at the AF point using the signal output from the image sensor 120. In this example, the image sensor 120 has pixels that perform so-called pupil division, and the AF detector 180 detects the phase difference between a pair of image signals output from the pixels, and outputs an AF evaluation value (defocus amount) indicating the focus state corresponding to the phase difference. The camera control unit 190 performs focus control (image plane phase difference AF) based on the AF evaluation value.

[0040] The AF detector 180 can generate and output an AF evaluation value (contrast evaluation value) corresponding to the focus state based on the brightness component of the output signal from the image sensor 120. In this case, the camera control unit 190 performs focus control (contrast AF) so that the AF evaluation value becomes maximum.

[0041] The camera control unit 190 controls the entire camera system composed of the image pickup apparatus 100 and the image pickup lens 200. The camera control unit 190 selects a lens driving unit (501 or 502) to be controlled and a driving amount based on position information about a selected AF point triggered by an AF start instruction via the AF instruction member 162 and a focus state detected by the AF detector 180.

[0042] Figure 4An example of a pair of parallax images displayed on the display unit 150 is shown. In the right area of ​​the display unit 150, a captured image of the right eye (first captured image: hereinafter referred to as the right eye image) corresponding to the right eye imaging circle ICR formed by the right eye optical system 201R is displayed. In the left area of ​​the display unit 150, a captured image of the left eye (second captured image: hereinafter referred to as the left eye image) corresponding to the left eye imaging circle ICL formed by the left eye optical system 201L is displayed. A plurality of AF points 151 are displayed in rows and columns on the entire display unit 150.

[0043] On the captured image of the right eye (within the imaging range), the first AF frame 152 for displaying the first AF point (first target position) selected by the user through the AF point input member 161 is displayed in a manner including the first AF point. The first AF point is the AF point for the right eye optical system 201R. In this example, when the user instructs to start AF through the AF instruction member 162 in this state, AF of the right eye optical system 201R is started.

[0044] On the captured image of the left eye (within the imaging range), a second AF frame 153 for displaying a second AF point (second target position) set by the camera control unit 190 as an AF point for the left eye optical system 201L corresponding to the first AF point in the AF processing described later is shown by a dotted line. The subject located at the second AF point is the same subject as the subject located at the first AF point. In the AF processing described later, the second AF frame 153 is not displayed until the AF of the right eye optical system 201R is completed, and after the AF is completed, the second AF frame 153 is displayed and the AF of the left eye optical system 201L is performed.

[0045] The imaging device 100 according to this example can be used in Figure 4 The display unit 150 is switched between a normal display mode for displaying a captured image in a normal size and an enlarged display mode as shown. In the enlarged display mode, an image area near the AF point selected in the normal display mode is enlarged and displayed on the display unit 150. The switching between the normal mode and the enlarged display mode can be achieved by operating a display mode switch (not shown) provided on the operation unit 160.

[0046] Figure 5 The flowchart in shows the AF processing executed by the camera control unit 190 according to the program.

[0047] In step S101, the camera control unit 190 acquires information about the position of the first AF point selected by the AF point input member 161. Then, the first AF frame 152 surrounding the first AF point is displayed on the right eye image of the display unit 150.

[0048] Next, in step S102 , the camera control unit 190 detects an AF start instruction from the AF instruction member 162 .

[0049] Next, in step S103 , the camera control unit 190 acquires the AF evaluation value at the first AF point from the AF detector 180 , and determines the driving amount of the first lens driving unit 501 according to the AF evaluation value.

[0050] Next, in step S104, the camera control unit 190 controls the first lens driving unit 501 according to the determined driving amount. Thereby, an in-focus state can be obtained in the right-eye optical system 201R, and AF of the right-eye optical system 201R is completed.

[0051] Next, in step S105, the camera control unit 190 notifies the user that the AF of the right-eye optical system 201R is completed. More specifically, the camera control unit 190 notifies the user by blinking or changing the color of the first AF frame 152 or by sound or vibration.

[0052] Next, in step S106, the camera control unit 190 selects (sets) a second AF point for the left-eye optical system 201L corresponding to the first AF point. More specifically, the parallax amount of the left-eye optical system 201L relative to the right-eye optical system 201R is calculated based on the position information about the first AF point, the focal lengths of the right-eye optical system 201R and the left-eye optical system 201L, the base line length L1, the AF evaluation value acquired from the AF detector 180, and the like. Then, the position shifted by the parallax amount from the first AF point is set as the second AF point. Thus, the AF point on the same subject as the subject located at the first AF point is selected as the second AF point.

[0053] Instead of the AF detector 180, a subject detector for performing image processing to recognize a subject such as a human face from a captured image may be provided. In this case, the subject detector is caused to recognize a subject located at a first AF point in the right eye image and detect the same subject in the left eye image. The camera control unit 190 sets the AF point on the detected subject as a second AF point.

[0054] The camera control unit 190 , which has selected the second AF point, displays a second AF frame 153 surrounding the second AF point on the left-eye image on the display unit 150 .

[0055] Next, in step S107 , the camera control unit 190 acquires the AF evaluation value at the second AF point from the AF detector 180 , and determines the driving amount of the second lens driving unit 502 according to the AF evaluation value.

[0056] Next, in step S108, the camera control unit 190 controls the second lens driving unit 502 according to the determined driving amount. Thereby, an in-focus state is also obtained in the left-eye optical system 201L, and the AF of the left-eye optical system 201L is completed.

[0057] Next, in step S109, the camera control unit 190 notifies the user that the AF of the left-eye optical system 201L has been completed. More specifically, the second AF frame 153 blinks and changes color, and notifies the user by sound or vibration.

[0058] Next, in step S110, the camera control unit 190 changes the AF point used for AF to the first AF point again, and displays the first AF frame 152 on the right eye image on the display unit 150. Then, the present flow ends.

[0059] According to the above processing, in the case where the user inputs the first AF point for the right-eye optical system 201R, the second AF point for the left-eye optical system 201L is automatically set, so that AF can be easily performed on the same subject in the right-eye optical system 201R and the left-eye optical system 201L. In addition, the user is notified of the completion of AF of the right-eye optical system 201R and the completion of AF of the left-eye optical system 201L, respectively, so that after the user receives the notification and starts shooting, the user can obtain a pair of parallax images that provide a good stereoscopic effect. In addition, by performing AF on each optical system, power consumption per unit time can be reduced.

[0060] In this example, after the right eye optical system 201R is AFed at the selected first AF point, the left eye optical system 201L is AFed at the second AF point, but the right eye optical system 201R may be AFed at the first AF point after the left eye optical system 201L is AFed at the selected second AF point.

[0061] Example 2

[0062] A description will now be given of Example 2. Figure 6 The configuration of a stereo camera system including an imaging lens 200' and an imaging device 100 that is the same as Example 1 is shown. In the imaging lens 200', a first lens driving unit 501' integrally drives a right-eye optical system 201R and a left-eye optical system 201L as a whole or a focus lens included therein. A second lens driving unit 502 drives the left-eye optical system 201L as a whole or a focus lens included therein. At this time, the driving amount of the first lens driving unit 501' is calculated based on the AF evaluation value at the first AF point.

[0063] This example can be Figure 5 AF processing shown.

[0064] Example 3

[0065] A description will now be given of Example 3. Figure 7 The flowchart in shows the AF process executed by the camera control unit 190 by a program according to Example 3. The configuration of the camera system in this example is the same as that of Example 1. The AF process according to this example can also be performed in the camera system according to Example 2.

[0066] In step S201, the camera control unit 190 acquires information about the position of the first AF point selected by the AF point input member 161. Then, the first AF frame 152 surrounding the first AF point is displayed on the right eye image on the display unit 150.

[0067] Next, in step S202 , the camera control unit 190 detects an AF start instruction from the AF instruction member 162 .

[0068] Next, in step S203, the camera control unit 190 selects (calculates) a second AF point for the left-eye optical system 201L corresponding to the first AF point. Figure 5 The camera control unit 190, which has selected the second AF point, displays a second AF frame 153 surrounding the second AF point on the left eye image on the display unit 150.

[0069] Next, in step S204 , the camera control unit 190 acquires AF evaluation values ​​at the first AF point and the second AF point from the AF detector 180 , and determines the driving amounts of the first lens driving unit 501 and the second lens driving unit 502 according to the AF evaluation values.

[0070] Next, in step S205, the camera control unit 190 controls the first lens driving unit 501 and the second lens driving unit 502 according to the determined driving amount. As a result, a focused state is obtained in each of the right eye optical system 201R and the left eye optical system 201L, and the AF of the right eye optical system 201R and the AF of the left eye optical system 201L are completed.

[0071] Next, in step S206, the camera control unit 190 notifies the user that the AF of the right eye optical system 201R and the AF of the left eye optical system 201L are completed. More specifically, the first AF frame 152 and the second AF frame 153 blink or change color, or further notify by sound or vibration.

[0072] Next, in step S207, the camera control unit 190 deletes the display of the second AF frame 153 from the display unit 150. Thus, only the first AF frame 152 is displayed.

[0073] Even in this example, once the user inputs the first AF point for the right-eye optical system 201R, the second AF point for the left-eye optical system 201L is automatically set, so that AF can be easily performed on the same subject in the right-eye optical system 201R and the left-eye optical system 201L. In addition, the user is notified of the completion of AF in the right-eye optical system 201R and the left-eye optical system 201L, so that the user can obtain a pair of parallax images providing a good stereoscopic effect by starting imaging upon receiving the notification. In this example, AF is performed simultaneously in the right-eye optical system 201R and the left-eye optical system 201L, so the time required to complete AF in the right-eye optical system 201R and the left-eye optical system 201L can be shorter than that in Example 1.

[0074] Example 4

[0075] A description will now be given of Example 4. Figure 8 The flowchart in shows the AF processing according to Example 4. This example will discuss the AF processing in the case where the user selects the enlarged display mode.

[0076] In step S301, the camera control unit 190 acquires information about the position of the first AF point selected by the AF point input member 161. Then, the camera control unit 190 causes the display unit 150 to display an enlarged image of a portion of the right eye image near the first AF point and to display the first AF frame 152 surrounding the first AF point on the enlarged image. The user can also fine-tune the first AF point by viewing the first AF frame 152 displayed on the enlarged image.

[0077] The processing of steps S302 to S305 is the same as that of Example 1 ( Figure 5 ) is the same as steps S102 to S105.

[0078] Next, in step S306, the camera control unit 190 selects (calculates) a second AF point for the left-eye optical system 201L corresponding to the first AF point. Figure 5 ) selects the second AF point in the same manner as described in step S106 of ). The camera control unit 190, which has selected the second AF point, causes the display unit 150 to display an enlarged image of a portion of the left eye image near the second AF point and displays a second AF frame 153 surrounding the second AF point on the enlarged image.

[0079] Steps S307 to S310 are the same as in Example 1 ( Figure 5) are the same as steps S107 to S110 in .

[0080] This example displays the first AF point and the second AF point on the enlarged images of the right eye image and the left eye image, respectively, and enables the user to easily confirm in which part of the subject the first AF point and the second AF point are located (such as the right eye of a person's face instead of the nose, etc.).

[0081] Even in this example, similarly to Example 1, after the AF of the left-eye optical system 201L is performed at the selected second AF point, the AF of the right-eye optical system 201R at the first AF point may be performed.

[0082] Example 5

[0083] A description will now be given of Example 5. Fig. 9 The flowchart in shows the MF process according to Example 5. This example will discuss the process in the case where the user selects the MF mode.

[0084] In step S401 , when the first AF point is selected via the AF point input means 161 , the camera control unit 190 causes the display unit 150 to display the first AF frame 152 surrounding the first AF point on the right eye image, and starts MF processing of the right eye optical system 201R.

[0085] In step S402 of the MF process, when the encoder 602 detects rotation of the MF ring 601 via the lens control unit 209 , the camera control unit 190 converts the rotation amount of the MF ring 601 detected by the encoder 602 into a driving amount of the first lens driving unit 501 .

[0086] In step S403, the camera control unit 190 controls the first lens driving unit 501 according to the converted driving amount. Thus, MF control of the right-eye optical system 201R is performed.

[0087] although Fig. 9 Although not shown in the figure, in the event that the user subsequently selects the second AF point via the AF point input member 161, the camera control unit 190 causes the left-eye optical system 201L to perform MF processing.

[0088] In this way, in the MF mode, MF of the right-eye optical system 201R is performed according to the operation of the MF ring 601 and the input of the first AF point via the AF point input member 161, and MF of the left-eye optical system 201L is performed according to the same operation of the MF ring 601 and the input of the second AF point via the AF point input member 161. Thus, MF of the right-eye optical system 201R and the left-eye optical system 201L can be performed by the operation of the single MF ring 601.

[0089] The following processing may be performed after step S403. Specifically, in the case where the camera control unit 190 detects that the MF of the right-eye optical system 201R is completed through the user operation on the operation unit 160, the camera control unit 190 calculates the distance at which the right-eye optical system 201R is focused (or detects the focused subject) based on the focal length and the focus drive position of the right-eye optical system 201R. Then, the camera control unit 190 calculates the driving amount of the second lens driving unit 502 at which the left-eye optical system 201L is focused on the distance (or subject), and controls the second lens driving unit 502 according to the driving amount. Thus, the focusing state of the left-eye optical system 201L can be obtained, and the AF of the left-eye optical system 201L according to the MF of the right-eye optical system 201R can be completed.

[0090] Next, the camera control unit 190 notifies the user of the completion of AF of the left-eye optical system 201L by sound, vibration, etc. Then, this flow ends.

[0091] This example performs AF of the left-eye optical system 201L based on the MF of the right-eye optical system 201R, so the right-eye optical system 201R and the left-eye optical system 201L can easily focus on the subject that the user wants to focus on using MF. After the MF of the right-eye optical system 201R is completed, the user can be clearly notified that the AF of the left-eye optical system 201L is completed.

[0092] The AF of the right-eye optical system 201R may be performed after the MF of the left-eye optical system 201L is completed.

[0093] Even in the case where the imaging apparatus includes an image sensor for capturing an object image formed by the first optical system and another image sensor for capturing an object image formed by the second optical system, it is possible to perform the AF processing described in Examples 1 to 4 and the MF processing described in Example 5. The AF processing and the MF processing in the respective examples can be performed not only when the first optical system and the second optical system are optical systems whose optical axes are curved, but also when the first optical system and the second optical system are coaxial optical systems whose optical axes extend in a straight line from the object side to the image side.

[0094] Other embodiments

[0095] The embodiments of the present invention may also be implemented by providing software (program) for performing the functions of the above-described embodiments to a system or device via a network or various storage media, and a computer or a central processing unit (CPU) or a microprocessing unit (MPU) of the system or device reads and executes the program.

[0096] Although the disclosure has described example embodiments, it is to be understood that some embodiments are not limited to the disclosed embodiments.The scope of the following claims is to be accorded the broadest interpretation so as to encompass all such modifications and equivalent structures and functions.

[0097] The present disclosure can easily perform AF suitable for stereoscopic imaging of two optical systems, and can appropriately notify the user of AF completion.

Claims

1. A camera device, comprising: at least one image sensor configured to capture two subject images formed by the first optical system and the second optical system arranged in parallel; a focus detector configured to detect a focus state using a signal output from the image sensor; a control unit configured to perform focus control of each of the first optical system and the second optical system based on the focus state; as well as an input unit configured to allow a user to input a first target position in an imaging range passing through the first optical system, It is characterized in that the control unit is configured as follows: performing focus control of the first optical system according to the focus state at the first target position, setting a second target position corresponding to the first target position in the imaging range of the second optical system; performing focus control of the second optical system according to the focus state at the second target position, and The user is notified of completion of the focus control of each of the first optical system and the second optical system.

2. The imaging device according to claim 1, wherein: The control unit is configured to set the second target position for the same subject as the subject for which the first target position is set.

3. The imaging device according to claim 1, wherein: The control unit is configured to sequentially perform focus control of the first optical system, notification of completion of the focus control of the first optical system, focus control of the second optical system, and notification of completion of the focus control of the second optical system.

4. The imaging device according to claim 1, wherein: The control unit is configured to sequentially perform focus control of each of the first optical system and the second optical system and notification of completion of the focus control of the first optical system and the second optical system.

5. The imaging device according to claim 1 , further comprising a display unit configured to display a first captured image obtained by imaging via the first optical system and a second captured image obtained by imaging via the second optical system, It is characterized in that The control unit is configured to: performing focus control of the first optical system by displaying the first target position on the first captured image, and After the focus control of the first optical system is completed, the focus control of the second optical system is performed by displaying the second target position on the second captured image.

6. The imaging device according to claim 5, characterized in that The control unit is configured to: causing the display unit to display an enlarged image of a portion of the first captured image that includes the first target position, and The display unit is caused to display an enlarged image of a portion of the second captured image that includes the second target position.

7. The imaging device according to claim 4, further comprising a display unit configured to display a first captured image obtained by imaging via the first optical system and a second captured image obtained by imaging via the second optical system, It is characterized in that The control unit is configured to perform focus control of the first optical system by displaying the first target position on the first captured image, and to perform focus control of the second optical system by displaying the second target position on the second captured image.

8. The imaging device according to claim 4, characterized in that The control unit is configured to control a first drive unit in focus control of the first optical system and to control a second drive unit in focus control of the second optical system, the first drive unit being configured to drive the first optical system and the second drive unit being configured to drive the second optical system.

9. The imaging device according to claim 1, wherein: The control unit is configured to control a first driving unit and a second driving unit in respective focus controls of the first optical system and the second optical system, the first driving unit being configured to drive the first optical system and the second optical system, and the second driving unit being configured to drive the second optical system.

10. The imaging device according to claim 1, wherein: capable of switching focus control of the first optical system and the second optical system and manual focus of the first optical system and the second optical system, Wherein, in the manual focusing, the control unit is configured as follows: performing control of the first optical system according to an operation of a focus operation member according to an input of the first target position via the input unit, and According to the input of the second target position via the input unit, control of the second optical system according to the operation of the focus operation member is performed.

11. The imaging device according to any one of claims 1 to 10, characterized in that: capable of switching between focus control of the first optical system and manual focus of the first optical system, The control unit is configured to set the second target position and perform focus control of the second optical system after manual focus of the first optical system according to input of the first target position and operation of the focus operation member is completed.

12. A method for controlling an image pickup device, the image pickup device comprising an image sensor configured to capture two subject images formed by a first optical system and a second optical system arranged in parallel, and detecting a focus state using a signal output from the image sensor, the method comprising the following steps: Allowing a user to input a first target position within the imaging range of the first optical system; performing focus control of the first optical system according to the focus state at the first target position; Setting a second target position corresponding to the first target position within the imaging range of the second optical system; performing focus control of the second optical system according to the focus state at the second target position; as well as The user is notified of the completion of the focus control of the first optical system and the second optical system. 13 . A non-transitory computer-readable storage medium storing a program for causing a computer to execute the control method according to claim 12 .

14. A computer program product comprising a program for causing a computer to execute the control method according to claim 12.

Images