Control device, lens device, imaging device, camera system, control method, program, and storage medium

Abstract

To provide a control device capable of reducing an image blur from a central part to a peripheral part of an image even at the time of a low-speed shutter.SOLUTION: A control device is used in a system including two correction members provided in a camera and an interchangeable lens respectively, and includes: a first correction part that corrects an image blur using at least one of two correction members based on a ratio of correction by the two correction members or a ratio of correction by the two correction members different from the ratio, based on information on image movement amounts of the central part and a peripheral part of an image when correction is performed by the two correction members; a second correction part that corrects trapezoidal distortion; and a control part that executes a first control in which the correction is performed by the two correction parts and a second control in which at least one of corrections by the two correction units is performed. The control part performs the first control when a shutter speed of a photographing is higher than a threshold value, and performs the second control when the shutter speed is lower than the threshold value.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to a control device, a lens device, an imaging device, a camera system, a control method, a program, and a storage medium.

Background Art

[0002] Depending on the optical system in an interchangeable lens that employs a central projection method, the amount of image point movement that occurs on the subject image during camera shake may differ between the central part and the peripheral part of the image. In particular, the larger the angle of view of the optical system, the greater the amount of image point movement in the peripheral part compared to the central part. When performing anti-shake, image blur may remain larger in the peripheral part than in the central part. Patent Document 1 discloses a configuration for performing so-called pitching correction, which is one type of electronic image blur correction, to cancel image blur in which the captured image is distorted into a trapezoid due to shake applied to the imaging device.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In the configuration of Patent Document 1, since electronic image blur correction is performed, the correction effect cannot be sufficiently obtained at a low shutter speed. In particular, when the optical system is a wide-angle lens in which image blur in the peripheral part is large, the shutter speed at which the correction effect in the peripheral part decreases becomes higher.

[0005] An object of the present invention is to provide a control device capable of reducing image blur from the central part to the peripheral part of an image even at a low shutter speed.

Means for Solving the Problems

[0006] A control device according to one aspect of the present invention is a control device used in a camera system including a first correction member provided on one of an imaging device and a lens device detachably attached to the imaging device, and a second correction member provided on the other of the imaging device and the lens device. The control device is based on information regarding the image movement amounts of the central portion and the peripheral portion of an image when correction using the first correction member is performed, and information regarding the image movement amounts of the central portion and the peripheral portion when correction using the second correction member is performed. A first correction ratio between the correction using the first correction member and the correction using the second correction member, or a second correction ratio between the correction using a first correction member different from the first correction ratio and the correction using the second correction member. A first correction unit that corrects image blur using at least one of the first correction member and the second correction member, a second correction unit that corrects trapezoidal distortion among the image blurs, and a first control in which correction by the first correction unit and correction by the second correction unit are performed, or a first control in which at least one of the correction by the first correction unit and the correction by the second correction unit is performed. And a control unit that executes a second control different from the above, wherein the control unit performs the first control when the shutter speed of the shooting performed by the imaging device is faster than a threshold value, and performs the second control when the shutter speed is slower than the threshold value.

Effect of the Invention

[0007] According to the present invention, it is possible to provide a control device capable of reducing image blur from the central portion to the peripheral portion of an image even at a low shutter speed.

Brief Description of the Drawings

[0008]

Figure 1

Figure 2

Figure 3

Figure 4

Figure 5

Figure 6

Figure 7

Figure 8

Mode for Carrying Out the Invention

[0009] Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In each figure, the same members are denoted by the same reference numerals, and redundant descriptions are omitted.

[0010] FIG. 1 is a block diagram of a camera system according to an embodiment of the present invention. The camera system includes a camera body (imaging device) 100 and an interchangeable lens (lens device) 101 that is detachably and communicably attached to the camera body 100. In the present embodiment, a first correction member is provided on one of the camera body 100 and the interchangeable lens 101, and a second correction member provided on the other is provided. The first correction member and the second correction member are used to correct image blur generated in a captured image. Note that the present invention is also applicable to a camera system in which the camera body and the lens are integrated.

[0011] The camera body 100 includes a camera MPU 102, an operation unit 103, an imaging element 104, a camera-side contact terminal 105, a camera-side gyro sensor 106, an imaging element actuator 107, an imaging element position sensor 108, an acceleration sensor 109, and a rear display 116.

[0012] The camera MPU 102 is a controller that manages the overall control of the camera system and controls various operations such as automatic exposure (AE), automatic focus adjustment (AF), and imaging in response to inputs from the operation unit 103. Further, the camera MPU 102 communicates various commands and information with the lens MPU 110 provided in the interchangeable lens 101 through the camera-side contact terminals 105 and the lens-side contact terminals 112 provided in the interchangeable lens 101. The camera-side contact terminals 105 and the lens-side contact terminals 112 also include power terminals for supplying power from the camera body 100 to the interchangeable lens 101.

[0013] The operation unit 103 includes a mode dial for setting various imaging modes, a release button for instructing imaging preparation operations and the start of imaging, and the like. When the release button is pressed halfway, the first switch (SW1) is turned on, and when it is pressed fully, the second switch (SW2) is turned on. In response to the turning on of SW1, AE and AF as imaging preparation operations are performed. In response to the turning on of SW2, the determination of the AE setting and the stop of AF are performed, and the start of imaging (exposure) is instructed (turning on of SW2-1). Actual exposure starts after a predetermined time from this instruction (turning on of SW2-2). SW2-1 and SW2-2 are turned off at the timing when the set exposure time has elapsed and imaging has ended. The on / off states of SW1, SW2-1, and SW2-2 are notified from the camera MPU 102 to the lens MPU 110 by communication.

[0014] The imaging element 104 is composed of a photoelectric conversion element such as a CCD sensor or a CMOS sensor, and photoelectrically converts the subject image formed by the imaging optical system described later to generate an imaging signal. The camera MPU 102 generates a video signal using the imaging signal from the imaging element 104. In the present embodiment, the imaging element 104 functions as a first correction member.

[0015] The camera-side gyro sensor 106 detects the angular shake (camera shake) applied to the camera body 100 due to hand shake or the like, and outputs a camera shake detection signal as an angular velocity signal. The camera MPU 102 drives the imaging element actuator 107 based on the camera shake detection signal and the shake correction ratio of IIS described later, thereby moving the imaging element 104 in a direction including a component in a direction orthogonal to the optical axis of the imaging optical system described later. Thereby, image shake due to camera shake can be reduced (corrected). At this time, the camera MPU 102 performs feedback control of the imaging element actuator 107 so that the position of the imaging element 104 detected by the imaging element position sensor 108 (the amount of movement from the position on the optical axis which is the center of movement) approaches the target position. With the above configuration, image shake correction (hereinafter referred to as IIS) due to the movement of the imaging element 104 is performed. In addition to performing IIS, the camera MPU 102 also electronically deforms the image using the signal from the camera-side gyro sensor 106, and also performs so-called electronic image stabilization such as translational deformation, rotational deformation, and trapezoidal deformation (rolling correction).

[0016] The acceleration sensor 109 detects the attitude of the camera body 100 or detects shake (shift shake) that is difficult to detect with the camera-side gyro sensor 106.

[0017] The rear display 116 displays an image corresponding to the video signal generated by the camera MPU 102 using the imaging signal from the imaging element 104. Before imaging, the user can observe the displayed image as a finder image (live view image). Also, after imaging, a still image or moving image for recording generated by imaging can be displayed on the rear display 116. "Imaging" in the present embodiment means imaging for recording.

[0018] The interchangeable lens 101 includes an imaging optical system including an image shake correction lens 114, a lens MPU 110, a lens-side gyro sensor 111, lens-side contact terminals 112, a lens actuator 113, and a lens position sensor 115.

[0019] The lens-side gyro sensor 111 detects the angular shake (lens shake) applied to the interchangeable lens 101 and outputs a lens shake detection signal as an angular velocity signal. The lens MPU 110 drives the lens actuator 113 based on the lens shake detection signal and the shake correction ratio of OIS described later, thereby moving the image shake correction lens 114 in a direction including a component in a direction orthogonal to the optical axis of the imaging optical system. Thereby, image shake caused by lens shake can be reduced (corrected). At this time, the lens MPU 110 performs feedback control of the lens actuator 113 so that the position of the image shake correction lens 114 detected by the lens position sensor 115 (the amount of movement from the position on the optical axis which is the center of movement) approaches the target position. With the above configuration, image shake correction (hereinafter referred to as OIS) is performed by the movement of the image shake correction lens 114. In the present embodiment, the image shake correction lens 114 functions as a second correction member.

[0020] Also, in the present embodiment, the lens MPU 110 includes a correction unit (first correction unit) 110a and a control unit 110b. The correction unit 110a corrects image shake using at least one of the imaging element 104 and the image shake correction lens 114 based on a first shake correction ratio (first correction ratio) between OIS and IIS, or a second shake correction ratio (second correction ratio) between OIS and IIS. The first shake correction ratio is determined based on information regarding the amount of image movement in the central portion and the peripheral portion of the image when OIS is performed and information regarding the amount of image movement in the central portion and the peripheral portion when IIS is performed. Also, the second shake correction ratio is a value different from the first shake correction ratio. In the present embodiment, the second shake correction ratio is determined based on the movable amount of the imaging element 104 and the movable amount of the image shake correction lens 114, but the present invention is not limited thereto. The control unit 110b executes first control or second control. In the first control, correction by the correction unit 110a and correction by an image deformation processing unit (second correction unit) 217 that corrects shake (trapezoidal distortion) that is distorted into a trapezoid among the image shake described later are performed. In the second control, at least one of correction by the correction unit 110a and correction by the image deformation processing unit 217 is performed.

[0021] In addition, in this embodiment, the lens MPU 110 functions as a control device that executes the cooperative drive control described later, but the present invention is not limited to this. The camera MPU 102 may have the functions of the correction unit 110a and the control unit 110b and function as a control device that performs cooperative drive control.

[0022] Hereinafter, with reference to FIG. 2, the configuration of the image blur correction unit of the camera system will be described. FIG. 2 is a block diagram of the image blur correction unit. The image blur correction unit includes an image blur correction unit 201 that is a part of the camera MPU 102 and an image blur correction unit 209 that is a part of the lens MPU 110.

[0023] The image shake correction unit 201 includes a camera gyro offset removal unit 202, a camera-side angle conversion unit 203, a camera information storage unit 204, a lens communication transmission unit 205, a lens communication reception unit 206, a camera-side cooperative drive control unit 207, and an imaging element drive control unit 208. The camera gyro offset removal unit 202 removes the offset component from the angular velocity signal detected by the camera-side gyro sensor 106. The camera-side angle conversion unit 203 converts the angular velocity signal output from the camera gyro offset removal unit 202 into an angle signal. The camera information storage unit 204 stores information such as the stroke (movable amount) of the imaging element 104, which is a correction member of the IIS, and the sensor size. The lens communication transmission unit 205 transmits the information stored in the camera information storage unit 204 to the camera communication reception unit 214 of the image shake correction unit 209. The lens communication reception unit 206 receives the information transmitted from the camera communication transmission unit 213 of the image shake correction unit 209. The camera-side cooperative drive control unit 207 determines the amount of image shake to be corrected by the IIS based on the information stored in the camera information storage unit 204 and the information received by the lens communication reception unit 206. The imaging element drive control unit 208 generates a drive control signal for the imaging element 104 using the angle signal output from the camera-side angle conversion unit 203 and the amount of image shake output from the camera-side cooperative drive control unit 207. Also, the output from the camera gyro offset removal unit 202 is sent to an image deformation processing unit 217, which is a separate processing block within the camera MPU 102, and the image deformation processing unit 217 performs image deformation processing on the image using the output from the camera gyro offset removal unit 202.

[0024] The image shake correction unit 209 includes a lens gyro offset removal unit 210, a lens-side angle conversion unit 211, a lens information storage unit 212, a camera communication transmission unit 213, a camera communication reception unit 214, a lens-side coordinated drive control unit 215, and an image shake correction lens drive control unit 216. The lens gyro offset removal unit 210 removes the offset component from the angular velocity signal detected by the lens-side gyro sensor 111. The lens-side angle conversion unit 211 converts the angular velocity signal output from the lens gyro offset removal unit 210 into an angle signal. The camera communication transmission unit 213 transmits the information stored in the lens information storage unit 212 to the lens communication reception unit 206 of the image shake correction unit 201. The camera communication reception unit 214 receives the information transmitted from the lens communication transmission unit 205 of the image shake correction unit 201.

[0025] The lens information storage unit 212 stores information regarding the shake correction ratio and the stroke of the image shake correction lens 114, which is a correction member for OIS. The lens information storage unit 212 also stores information on the image shake correction angle when the imaging element 104 moves by a predetermined amount, that is, the information on the camera image shake correction sensitivity.

[0026] In addition, the lens information storage unit 212 stores the lens peripheral image shake correction remaining amount information, which is the remaining amount of image shake correction in the peripheral part of the image when the image shake correction lens 114 corrects the image shake in the central part of the image by a predetermined angle. Note that the lens peripheral image shake correction remaining amount may be information on the image point movement amount in the central part of the image and the image point movement amount at a predetermined image height when the image shake correction lens 114 is moved by a predetermined amount, or may be obtained from the information on the image shake correction angle when the image shake correction lens 114 is moved by a predetermined amount. Also, the lens peripheral image shake correction remaining amount may be a function indicating how the remaining amount of image shake correction in the peripheral part of the image changes for each image height when the image shake in the central part of the image is corrected by a predetermined angle.

[0027] Furthermore, the lens information storage unit 212 stores the remaining amount of camera peripheral image blur correction, which is the remaining amount of image blur correction for the peripheral part of the image when the imaging device 104 corrects the image blur at the center of the image by a predetermined angle. The remaining amount of camera peripheral image blur correction may be obtained from the information on the amount of image point movement at the center of the image when the camera body 100 is rotated by a predetermined amount and the amount of image point movement at a predetermined image height. Also, the remaining amount of camera peripheral image blur correction may be a function indicating how the remaining amount of image blur correction for the peripheral part of the image changes for each image height when the image blur at the center of the image is corrected by a predetermined amount.

[0028] Note that the information stored in the lens information storage unit 212 may be information that changes due to the movement of a zoom lens or a focus lens included in the imaging optical system.

[0029] The lens-side cooperative drive control unit 215 performs cooperative drive control of OIS and IIS using the information stored in the lens information storage unit 212 and the information received by the camera communication reception unit 214. At this time, the lens-side cooperative drive control unit 215 sets a shake correction ratio for determining the amount of image blur to be corrected by each image blur correction unit. Also, the lens-side cooperative drive control unit 215 makes a determination to switch the lens internal information regarding the shake correction ratio and the sensitivity required for IIS using the information stored in the lens information storage unit 212 and the information received by the camera communication reception unit 214. The image blur correction lens drive control unit 216 generates a drive control signal for the image blur correction lens 114 using the angle signal output from the lens-side angle conversion unit 211.

[0030] Hereinafter, with reference to FIG. 3, a method for setting the second shake correction ratio of OIS and IIS will be described. The shake correction ratio can be set by a plurality of methods depending on the purpose. FIG. 3 is a diagram showing a method for setting the second shake correction ratio using the strokes of the correction members of OIS and IIS. Range 301 is the mechanical movable range of the imaging element 104 which is the correction member of IIS. Range 302 is the image circle of the interchangeable lens 101 and is the movable range of the image shake correction lens 114 which is the correction member of OIS. Range 303 is the stroke in the Y-axis direction (OIS stroke) of the image shake correction lens 114. Also, the imaging element 104 needs to move inside range 301 and inside range 302. Range 304 is the stroke in the Y-axis direction (IIS stroke) of the imaging element 104. When correcting the image shake of the entire camera system using two correction members, by setting the second shake correction ratio shown below, it is possible to effectively utilize the respective strokes of the correction members of OIS and IIS to perform image shake correction. Shake correction ratio of OIS: OIS stroke / (IIS stroke + OIS stroke) Shake correction ratio of IIS: IIS stroke / (IIS stroke + OIS stroke) Hereinafter, a method for setting the first shake correction ratio for suppressing the remaining amount of image shake in the peripheral portion of the image will be described. Since distortion aberration remains in a general optical system, when corrected by IIS, a difference occurs in the amount of image point movement between the central portion and the peripheral portion of the image due to a change in the amount of distortion aberration. Also, in OIS, decentering distortion due to decentering of the lens occurs, so a difference occurs in the amount of image point movement between the central portion and the peripheral portion of the image due to fluctuations in decentering distortion. Therefore, in IIS, due to the influence of the projection method and the influence of distortion aberration, a difference occurs in the amount of image point movement between the central portion and the peripheral portion of the image, and in OIS, due to the influence of the projection method and the influence of decentering distortion aberration, a difference occurs in the amount of image point movement between the central portion and the peripheral portion of the image. That is, since the causes of the difference in the amount of image point movement between the central portion and the peripheral portion of the image are different between OIS and IIS, the ratio of the amount of image point movement between the central portion and the peripheral portion of the image is different between OIS and IIS.

[0031] FIG. 4 is a diagram showing the remaining amount of image blur for each image height when the remaining amount of image blur at the center of the image is set to 0 in the case where a predetermined amount of image blur is corrected by OIS and IIS. Based on the remaining amount of image blur Ld with respect to a predetermined image height when the predetermined amount of image blur is stabilized by OIS and the remaining amount of image blur Cd with respect to the predetermined image height when the predetermined amount of image blur is stabilized by IIS, the OIS correction ratio and the IIS correction ratio are calculated as follows. Correction ratio of OIS: Cd / (Cd - Ld) Correction ratio of IIS: -Ld / (Cd - Ld) As a result, an effect of canceling the image blur in the peripheral portion while performing image blur correction in the central portion of the image can be obtained.

[0032] In this embodiment, the correction ratio is obtained from the ratio of the remaining amount of image blur with respect to each image height of OIS and IIS. However, it is also possible to select the one with the smaller remaining amount of image blur with respect to the image height between OIS and IIS and perform control alone.

[0033] As described above, by using information regarding the remaining amount of image blur in the peripheral portion of the image for calculating the correction ratio, it is possible to suppress the image blur in the peripheral portion of the image without performing electronic conversion of the captured image. On the other hand, since the movable ranges of OIS and IIS are restricted by the OIS stroke and the IIS stroke, depending on the ratio of the remaining amount of image blur with respect to each image height of OIS and IIS, there is a possibility that a sufficient image blur correction effect cannot be obtained for a large blur.

[0034] The following describes electronic image stabilization. Electronic image stabilization is generally implemented by performing image transformation using geometric transformation such as projective transformation. For example, as shown in FIG. 5, when the posture A when shooting a certain subject changes to the posture B, the point P1 on the image I1 in the posture A can be transformed into the point P2 on the image I2 in the posture B using the determinant H. As shown in FIG. 6, the types of projective transformation include translation, rotation, tilt, etc., and each transformation can be performed by setting each parameter of the determinant. The correction amounts for translation and rotation can be calculated from the output of the camera-side gyro sensor 106 and the focal length information of the interchangeable lens 101. The tilt correction amount can be calculated from the translation amount and the focal length information.

[0035] Here, the effect of electronic image stabilization in a low-speed shutter will be described. In electronic image stabilization, as described above, geometric transformation of the captured image is performed on each frame of the moving image to perform image stabilization. Therefore, it is impossible to correct the blur (in-plane blur) that occurs within one frame. When shooting with a low-speed shutter, in-plane blur occurs, causing unnatural flickering in the moving image. That is, in a wide-angle lens where image shake is large at the peripheral part of the image, significant flickering occurs at the peripheral part when shooting with a low-speed shutter.

[0036] The following describes the cooperative correction control using OIS, IIS, and tilt correction of the camera system in each embodiment.

Embodiment

[0037] FIG. 7 is a flowchart showing the cooperative correction control using OIS, IIS, and tilt correction of the camera system of this embodiment. This flow starts after the camera system is powered on and after initial driving operations and the like. In this embodiment, it is assumed that the lens MPU 110 executes cooperative driving control.

[0038] In step S701, the lens MPU 110 acquires information necessary for cooperative drive control. The information necessary for cooperative drive control includes the strokes of the correction members of OIS and IIS, the remaining amount of camera peripheral shake correction, the remaining amount of lens peripheral shake correction, information on the sensitivity required for shake correction, shutter speed information, and focal length information of the interchangeable lens 101, etc.

[0039] In step S702, the lens MPU 110 sets a shutter speed threshold that serves as a threshold when changing control based on information such as the focal length information, the remaining amount of camera peripheral shake correction, and the remaining amount of lens peripheral shake correction acquired in step S701. It is desirable to set the shutter speed threshold to a high shutter speed as the focal length of the interchangeable lens 101 is shorter. Also, it is desirable to set the shutter speed threshold to a high shutter speed as the remaining amount of camera peripheral shake correction or the remaining amount of lens peripheral shake correction is larger.

[0040] In step S703, the lens MPU 110 acquires an angle signal based on the signals detected by the camera-side gyro sensor 106 and the lens-side gyro sensor 111.

[0041] In step S704, the lens MPU 110 determines whether the current shutter speed is higher (faster) than the shutter speed threshold set in step S702. If the lens MPU 110 determines that the current shutter speed is higher than the shutter speed threshold, it executes the process of step S705, and if it determines otherwise, it executes the process of step S706. Note that when the current shutter speed is equal to the shutter speed threshold, it can be arbitrarily set which step's process to perform.

[0042] In step S705, the lens MPU 110 sets a second shake correction ratio between OIS and IIS based on the OIS stroke and the IIS stroke.

[0043] In step S706, the lens MPU 110 sets a first shake correction ratio between OIS and IIS based on the OIS image peripheral shake residue amount and the IIS image peripheral shake residue amount.

[0044] In step S707, the lens MPU 110 prohibits the implementation of pitching correction among electronic image stabilizations.

[0045] In step S708, the lens MPU 110 calculates (acquires) the OIS drive amount from the angle signal acquired in step S703 based on the shake correction ratio set in step S705 or step S706.

[0046] In step S709, the lens MPU 110 calculates (acquires) the IIS drive amount from the angle signal acquired in step S703 based on the shake correction ratio set in step S705 or step S706.

[0047] In step S710, the lens MPU 110 drives the OIS based on the OIS drive amount acquired in step S708.

[0048] In step S711, the lens MPU 110 drives the IIS based on the IIS drive amount acquired in step S709.

[0049] In step S712, the lens MPU 110 determines whether the implementation of pitching correction is permitted. When the lens MPU 110 determines that the implementation of pitching correction is permitted, it executes the process of step 713, and when it determines otherwise, it executes the process of this flow.

[0050] In step S713, first, the lens MPU 110 calculates (acquires) the pitching correction amount based on the focal length information, the OIS drive amount acquired in step S708, and the IIS drive amount acquired in step S709. Next, the lens MPU 110 performs pitching correction on the captured image obtained by the imaging device 104 using the acquired pitching correction amount.

[0051] By executing the flow of FIG. 7, when the shutter speed is high, while maximizing the amount of correction possible with optical image stabilization, shake correction reduces image blur in the peripheral part of the image. Also, when the shutter speed is low, it is possible to suppress the flickering of the moving image by reducing image blur in the peripheral part of the image using optical image stabilization.

[0052] Note that the order and content of the steps in FIG. 7 can be variously modified and changed within the scope of the gist.

[0053] As described above, according to the configuration of this embodiment, it is possible to reduce image blur and flickering in the peripheral part of the image regardless of the shutter speed.

[0054] Note that in this embodiment, the shake correction ratio between OIS and IIS was calculated from the strokes and remaining image blur amounts of OIS and IIS, but the ratio information itself calculated from the strokes and remaining image blur amounts of OIS and IIS may be directly held in the memory.

[0055] Also, in this embodiment, in an interchangeable lens type camera system, the case of reducing image blur in the peripheral part of the image using OIS, IIS, and shake correction has been described, but translational correction of electronic image stabilization may be combined within a range where there is no influence of in-plane blur.

Embodiment

[0056] In this embodiment, different control is performed when the shutter speed is not higher than the shutter speed threshold value compared to Embodiment 1. FIG. 8 is a flowchart showing cooperative correction control using OIS, IIS, and shake correction of the camera system of this embodiment. This flow starts after the camera system is powered on and after initial driving operations and the like. Note that in this embodiment, it is assumed that the lens MPU 110 executes cooperative driving control.

[0057] The processing from step S801 to step S803 is the same as the processing from step S701 to step S703 in FIG. 7, respectively, and thus the description is omitted.

[0058] In step S804, the lens MPU 110 determines whether the current shutter speed is higher than the shutter speed threshold set in step S802. If the lens MPU 110 determines that the current shutter speed is higher than the shutter speed threshold, it executes the processes of steps S805 and S806. If it determines otherwise, it executes the processes of steps S810 and S813. Note that when the current shutter speed is equal to the shutter speed threshold, which step's process to perform can be arbitrarily set.

[0059] In step S805, the lens MPU 110 calculates (acquires) the OIS drive amount from the angle signal acquired in step S803 based on the ratio of the OIS stroke to the IIS stroke.

[0060] In step S806, the lens MPU 110 calculates (acquires) the IIS drive amount from the angle signal acquired in step S803 based on the ratio of the OIS stroke to the IIS stroke.

[0061] In step S807, the lens MPU 110 drives the OIS based on the OIS drive amount acquired in step S805.

[0062] In step S808, the lens MPU 110 drives the IIS based on the IIS drive amount acquired in step S806.

[0063] In step S809, first, the lens MPU 110 calculates (acquires) the shake correction amount based on the focal length information, the OIS drive amount acquired in step S805, and the IIS drive amount acquired in step S806. Next, the lens MPU 110 performs shake correction on the captured image obtained by the imaging device 104 using the acquired shake correction amount.

[0064] In step S810, the lens MPU 110 obtains a low-frequency range angle signal by performing, for example, LPF processing on the angle signal acquired in step S803.

[0065] In step S811, the lens MPU 110 calculates (acquires) a low-frequency range OIS driving amount from the low-frequency range angle signal acquired in step S810 based on the ratio of the OIS stroke to the IIS stroke.

[0066] In step S812, the lens MPU 110 calculates (acquires) a low-frequency range IIS driving amount from the low-frequency range angle signal acquired in step S810 based on the ratio of the OIS stroke to the IIS stroke.

[0067] In step S813, the lens MPU 110 obtains a high-frequency range angle signal by performing, for example, HPF processing on the angle signal acquired in step S803.

[0068] In step S814, the lens MPU 110 calculates (acquires) a high-frequency range OIS driving amount from the high-frequency range angle signal acquired in step S813 based on the ratio of the remaining image blur amount in the peripheral part of the image when performing image stabilization with OIS and IIS.

[0069] In step S815, the lens MPU 110 calculates (acquires) a high-frequency range IIS driving amount from the high-frequency range angle signal acquired in step S813 based on the ratio of the remaining image blur amount in the peripheral part of the image when performing image stabilization with OIS and IIS.

[0070] In step S816, the lens MPU 110 drives the OIS based on the low-frequency range OIS driving amount acquired in step S811 and the high-frequency range OIS driving amount acquired in step S814.

[0071] In step S817, the lens MPU 110 drives the IIS based on the low-frequency range IIS driving amount acquired in step S812 and the high-frequency range IIS driving amount acquired in step S815.

[0072] In step S818, the lens MPU 110 first calculates (acquires) a pitching correction amount based on the focal length information, the low-frequency area OIS driving amount acquired in step S811, and the low-frequency area IIS driving amount acquired in step S814. Next, the lens MPU 110 performs pitching correction on the captured image obtained by the imaging device 104 using the acquired pitching correction amount.

[0073] By executing the flow of FIG. 8, for the shake in the high-frequency region (second frequency region) that causes in-plane blur, optical image stabilization reduces the image blur at the peripheral part of the image. Also, for the shake in the low-frequency region (first frequency region), by reducing the image blur at the peripheral part of the image using the pitching correction of electronic image stabilization, it becomes possible to efficiently use the strokes of OIS and IIS.

[0074] As described above, according to the configuration of the present embodiment, it is possible to reduce image blur and shaking at the peripheral part of the image regardless of the shutter speed.

[0075] Note that in this embodiment, the shake correction ratio between OIS and IIS is calculated from the strokes of OIS and IIS and the remaining amount of image blur, but the ratio information itself calculated from the strokes of OIS and IIS and the remaining amount of image blur may be directly held in the memory.

[0076] Also, in this embodiment, in an interchangeable lens type camera system, the case of reducing the image blur at the peripheral part of the image using OIS, IIS, and pitching correction has been described, but translational correction of electronic image stabilization may be combined within a range where there is no influence of in-plane blur. [Other Embodiments] The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

[0077] The disclosure of this embodiment includes the following configurations and methods. (Configuration 1) A control device used in a camera system including a first correction member provided on one of an imaging device and a lens device detachably attached to the imaging device, and a second correction member provided on the other of the imaging device and the lens device, Based on information regarding the image movement amounts of the central portion and the peripheral portion of the image when correction using the first correction member is performed, and information regarding the image movement amounts of the central portion and the peripheral portion when correction using the second correction member is performed, a first correction ratio between the correction using the first correction member and the correction using the second correction member, or a second correction ratio between the correction using the first correction member, which is different from the first correction ratio, and the correction using the second correction member, a first correction unit that corrects image blur using at least one of the first correction member and the second correction member, A second correction unit that corrects trapezoidal distortion among the image blur, A control unit that executes a first control in which correction by the first correction unit and correction by the second correction unit are performed, or a second control that is different from the first control in which at least one of the correction by the first correction unit and the correction by the second correction unit is performed, The control unit performs the first control when a shutter speed of shooting performed by the imaging device is faster than a threshold value, and performs the second control when the shutter speed is slower than the threshold value. A control device characterized by this. (Configuration 2) The second correction ratio is a ratio between the correction using the first correction member and the correction using the second correction member based on the movable amounts of the first correction member and the second correction member. The control device according to Configuration 1, characterized by this. (Configuration 3) The first control is a control in which correction based on the second correction ratio by the first correction unit and correction by the second correction unit are performed. The control device according to Configuration 1 or 2, characterized by this. (Configuration 4) When the control unit executes the first control, it acquires the correction amount of the correction using the second correction unit based on the movement amount of the first correction member, the movement amount of the second correction member, and the focal length information of the lens device. The control device according to Configuration 3, characterized in that. (Configuration 5) The second control is a control in which correction based on the first correction ratio by the first correction unit is performed and correction by the second correction unit is not performed. The control device according to any one of Configurations 1 to 4, characterized in that. (Configuration 6) The second control is a control in which correction based on the second correction ratio by the first correction unit and correction by the second correction unit are performed for the first frequency region of the image blur, and correction based on the first correction ratio by the first correction unit is performed for the second frequency region, which is a higher frequency region than the first frequency region of the image blur, and correction by the second correction unit is not performed. The control device according to any one of Configurations 1 to 4, characterized in that. (Configuration 7) When the control unit executes the second control, it acquires the correction amount of the correction using the second correction unit based on the movement amount of the first correction member and the movement amount of the second correction member in the correction for the first frequency region and the focal length information of the lens device. The control device according to Configuration 6, characterized in that. (Configuration 8) The threshold value is set according to the focal length information of the lens device. The control device according to any one of Configurations 1 to 7, characterized in that. (Configuration 9) The threshold value is set so as to be larger as the focal length of the lens device is shorter. The control device according to any one of Configurations 1 to 8, characterized in that. (Configuration 10) The control device according to any one of Configurations 1 to 9, An imaging optical system, and a lens device characterized by having the same. (Configuration 11) The control device according to any one of Configurations 1 to 9, An imaging element, and an imaging device characterized by having the same. (Configuration 12) A control device according to any one of Configurations 1 to 9, an imaging optical system, an imaging element, and a camera system characterized by comprising the same. (Method 1) A control method for a control device used in a camera system including an imaging device, a first correction member provided on one of the imaging device and a lens device detachably attached to the imaging device, and a second correction member provided on the other of the imaging device and the lens device, wherein the control device Based on information on the image movement amounts of the central portion and the peripheral portion of the image when correction using the first correction member is performed and information on the image movement amounts of the central portion and the peripheral portion when correction using the second correction member is performed, a first correction ratio between the correction using the first correction member and the correction using the second correction member, or a second correction ratio between the correction using the first correction member different from the first correction ratio and the correction using the second correction member, a first correction unit that corrects image blur using at least one of the first correction member and the second correction member, a second correction unit that corrects trapezoidal distortion among the image blurs, and performing a first control in which correction by the first correction unit and correction by the second correction unit are performed, or a second control different from the first control in which at least one of the correction by the first correction unit and the correction by the second correction unit is performed, In the step, when the shutter speed of the photographing performed by the imaging device is faster than a threshold value, the first control is performed, and when the shutter speed is slower than the threshold value, the second control is performed. A control method characterized by this. (Configuration 13) A program characterized by causing a computer of an imaging device or a lens device to execute the control method described in Method 1. (Configuration 14) A computer-readable storage medium storing the program described in Configuration 13.

[0078] As described above, the preferred embodiments of the present invention have been explained. However, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist thereof.

Explanation of Signs

[0079] 100 Camera body (imaging device) 101 Interchangeable lens (lens device) 102 Camera MPU (control device) 104 Image sensor (first correction member) 110 Lens MPU (control device) 110a Correction unit (first correction unit) 110b Control unit 114 Image stabilization lens (second correction member) 217 Image distortion processing unit (second correction unit)

Claims

1. A control device used in a camera system including a first correction member provided on one of an imaging device and a lens device detachably attached to the imaging device, and a second correction member provided on the other of the imaging device and the lens device, a first correction unit that corrects image blur using at least one of the first correction member and the second correction member based on information regarding the image movement amounts of the central portion and the peripheral portion of an image when correction using the first correction member is performed and information regarding the image movement amounts of the central portion and the peripheral portion of the image when correction using the second correction member is performed, based on a first correction ratio between the correction using the first correction member and the correction using the second correction member, or a second correction ratio between the correction using the first correction member and the correction using the second correction member that is different from the first correction ratio, a second correction unit that corrects trapezoidal distortion among the image blur, and a control unit that executes a first control in which correction by the first correction unit and correction by the second correction unit are performed, or a second control that is different from the first control in which at least one of the correction by the first correction unit and the correction by the second correction unit is performed. The control unit performs the first control when a shutter speed of shooting performed by the imaging device is faster than a threshold value, and performs the second control when the shutter speed is slower than the threshold value. A control device characterized by this.

2. The control device according to claim 1, wherein the second correction ratio is a ratio between the correction using the first correction member and the correction using the second correction member based on the movable amounts of the first correction member and the second correction member.

3. The control device according to claim 1 or 2, wherein the first control is a control in which correction based on the second correction ratio by the first correction unit and correction by the second correction unit are performed.

4. The control device according to claim 3, wherein when the control unit executes the first control, it acquires a correction amount of correction using the second correction unit based on the movement amount of the first correction member, the movement amount of the second correction member, and focal length information of the lens device.

5. The control device according to claim 1 or 2, wherein the second control is a control in which correction based on the first correction ratio by the first correction unit is performed and correction by the second correction unit is not performed.

6. The second control is such that, for the image shake in the first frequency region, correction based on the second correction ratio by the first correction unit and correction by the second correction unit are performed, and for the image shake in the second frequency region which is a higher frequency region than the first frequency region, correction based on the first correction ratio by the first correction unit is performed and correction by the second correction unit is not performed. The control device according to claim 1 or 2, characterized in that it is control.

7. When the control unit executes the second control, based on the movement amount of the first correction member and the movement amount of the second correction member in the correction for the first frequency region, and the focal length information of the lens device, the control device according to claim 6, characterized in that it acquires the correction amount of the correction by the second correction unit.

8. The threshold value is set according to the focal length information of the lens device. The control device according to claim 1 or 2, characterized in that it is set.

9. The threshold value is set so as to be larger as the focal length of the lens device is shorter. The control device according to claim 1 or 2, characterized in that it is set.

10. A lens device, characterized by comprising the control device according to claim 1 or 2, and an imaging optical system.

11. An imaging device, characterized by comprising the control device according to claim 1 or 2, and an imaging element.

12. A camera system, characterized by comprising the control device according to claim 1 or 2, an imaging optical system, and an imaging element.

13. A control method for a control device used in a camera system including an imaging device and a first correction member provided on one of the imaging device and a lens device detachably attached to the imaging device, and a second correction member provided on the other of the imaging device and the lens device, wherein the control device, based on information on the image movement amounts of the central portion and the peripheral portion of the image when correction using the first correction member is performed and information on the image movement amounts of the central portion and the peripheral portion of the image when correction using the second correction member is performed, a first correction ratio of the correction using the first correction member and the correction using the second correction member, or a second correction ratio of the correction using the first correction member different from the first correction ratio and the correction using the second correction member, a first correction unit that corrects image shake using at least one of the first correction member and the second correction member, and a second correction unit that corrects trapezoidal distortion in the image shake.

14. The first correction unit corrects image shake using the first correction member and the second correction member based on a first correction ratio when the focal length of the lens device is equal to or less than a threshold value, and corrects image shake using the first correction member based on a second correction ratio different from the first correction ratio when the focal length of the lens device is greater than the threshold value. The control method according to claim 13, characterized in that it is a control method.

15. The second control is such that, for the image shake in the first frequency region, correction based on the second correction ratio by the first correction unit and correction by the second correction unit are performed, and for the image shake in the second frequency region which is a higher frequency region than the first frequency region, correction based on the first correction ratio by the first correction unit is performed and correction by the second correction unit is not performed. The control method according to claim 13, characterized in that it is control.

16. When the control unit executes the second control, based on the movement amount of the first correction member and the movement amount of the second correction member in the correction for the first frequency region, and the focal length information of the lens device, the control method according to claim 13, characterized in that it acquires the correction amount of the correction by the second correction unit.

17. performing first control in which correction by the first correction unit and correction by the second correction unit are performed, or performing second control different from the first control in which at least one of the correction by the first correction unit and the correction by the second correction unit is performed; In the step, when a shutter speed of shooting performed by the imaging device is faster than a threshold value, the first control is performed, and when the shutter speed is slower than the threshold value, the second control is performed. A control method characterized by this.

14. A program characterized by causing a computer of an imaging device or a lens device to execute the control method according to claim 13.

15. A computer-readable storage medium storing the program according to claim 14.

Images