Control device, lens device, imaging apparatus, camera system, control method and program

Abstract

To provide a control device which can obtain the excellent image blur correction effect.SOLUTION: A control device used for a camera system including a first correction member provided in one of a camera and an interchangeable lens and a second correction member provided in the other comprises: a correction unit which performs image blur correction by using at least one of the first and second correction members on the basis of a first correction ratio of correction using the first and second correction members based on movable amounts of the first and second correction members, or a second correction ratio of correction using the first and second correction members based on information about image movement amounts of a center part and a peripheral part of the image when the correction using the first or second correction member is performed; and a control unit which executes first control in which the image blur correction based on the first correction ratio is performed and correction of a trapezoidal distortion is performed or second control in which the image blur correction based on the second correction ratio is performed and the correction of the trapezoidal distortion is not performed.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a control device, a lens device, an imaging device, a camera system, a control method, and a program. [Background technology]

[0002] Conventionally, a camera system has been proposed that performs image stabilization using both image stabilization (OIS) by moving a correction lens provided in an interchangeable lens and image stabilization (IIS) by moving an image sensor provided in a camera. Patent Document 1 discloses a configuration that sets the image stabilization ratio of OIS and IIS so that the image stabilization ranges of both OIS and IIS are effectively used.

[0003] In addition, depending on the optical system in an interchangeable lens that employs the central projection method, the amount of image point movement that occurs on the subject image during camera shake may differ between the center and periphery of the image. In particular, the wider the angle of the optical system, the greater the amount of image point movement in the periphery compared to the center, so when image shake correction is performed, the blurring may remain larger in the periphery compared to the center. Patent Document 2 discloses a configuration that sets a shake correction ratio in consideration of the difference between the amount of image shake in the center caused by the central projection method and the amount of image shake at an arbitrary image point position.

[0004] Furthermore, Patent Document 3 discloses a configuration for performing tilt correction, which is one type of so-called electronic shake correction, in which image shake, in which an image is distorted into a trapezoid shape due to a shake applied to an imaging device, is cancelled out by deforming the image. [Prior art documents] [Patent documents]

[0005] [Patent Document 1] Patent No. 6410431 [Patent Document 2] JP 2018-173632 A [Patent Document 3] Patent No. 6103877 Summary of the Invention [Problem to be solved by the invention]

[0006] The configurations of Patent Document 1 and Patent Document 2 have different reductions in image blurring at the periphery of an image due to differences in the settings of the shake correction ratio. If tilt correction is also performed, there is a risk that appropriate tilt correction will not be performed unless the operation is changed according to the setting of the shake correction ratio.

[0007] An object of the present invention is to provide a control device that can obtain a good image blur correction effect. [Means for solving the problem]

[0008] A control device according to one aspect of the present invention is a control device used in a camera system including an imaging device and a lens device detachably attached to the imaging device, a first correction member provided on one of the imaging device and the lens device, and a second correction member provided on the other of the imaging device and the lens device, and the control device outputs a first correction ratio between correction using the first correction member and correction using the second correction member, based on a movable amount of the first correction member and a movable amount of the second correction member, or information regarding an image movement amount between a central portion and a peripheral portion of an image when correction using the first correction member is performed and information regarding an image movement amount between the central portion and a peripheral portion of an image when correction using the second correction member is performed. and a control unit that executes a first control in which the first correction unit corrects image blur based on the first correction ratio and the second correction unit corrects keystone distortion, which is a part of the image blur, by performing a first control, or a second control in which the first correction unit corrects image blur based on the second correction ratio and the second correction unit does not correct keystone distortion. Effect of the Invention

[0009] According to the present invention, it is possible to provide a control device capable of obtaining a good image blur correction effect. [Brief description of the drawings]

[0010] [Figure 1] 1 is a block diagram of a camera system according to an embodiment of the present invention. [Diagram 2] FIG. 2 is a block diagram of an image blur correction unit. [Diagram 3] 6A to 6C are diagrams illustrating a method for setting a first shake correction ratio. [Figure 4] FIG. 11 is a diagram showing the amount of remaining image blur for each image height when the amount of remaining image blur at the center of the image is set to 0 in a case where a predetermined amount of blur is corrected by the OIS and the IIS. [Diagram 5] 11A and 11B are diagrams illustrating a second shake correction ratio setting method. [Figure 6] FIG. 1 is an explanatory diagram of projective transformation. [Figure 7] FIG. 1 is a diagram showing types of electronic image stabilization. [Figure 8] 5 is a flowchart showing cooperative drive control of an OIS and an IIS in the first embodiment. [Figure 9] 10 is a flowchart showing cooperative drive control of an OIS and an IIS in the second embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In each drawing, the same reference numerals are used to refer to the same components, and duplicated explanations will be omitted. EXAMPLES

[0012] 1 is a block diagram of a camera system according to an embodiment of the present invention. The camera system includes a camera body (imaging device) 100, and an interchangeable lens 101 that is detachably and communicatively attached to the camera body 100.

[0013] The camera body 100 comprises a camera MPU 102, an operation unit 103, an image sensor 104, a camera side contact terminal 105, a camera side gyro sensor 106, an image sensor actuator 107, an image sensor position sensor 108, an acceleration sensor 109, and a rear display 116.

[0014] The camera MPU 102 is a controller that handles the overall control of the camera system, and controls various operations such as automatic exposure (AE), automatic focus adjustment (AF), and image capture in response to input from the operation unit 103. The camera MPU 102 also communicates various commands and information with a lens MPU 110 provided in the interchangeable lens 101 via a camera side contact terminal 105 and a lens side contact terminal 112 provided in the interchangeable lens 101. The camera side contact terminal 105 and the lens side contact terminal 112 also include a power supply terminal for supplying power from the camera body 100 to the interchangeable lens 101.

[0015] The operation unit 103 includes a mode dial for setting various imaging modes, a release button for instructing imaging preparation operations and the start of imaging, and the like. A first switch (SW1) is turned on by half-pressing the release button, and a second switch (SW2) is turned on by fully pressing the button. AE and AF are performed as imaging preparation operations in response to SW1 being turned on, and AE settings are finalized and AF is stopped in response to SW2 being turned on, and an instruction is given to start imaging (exposure) (SW2-1 being turned on). Actual exposure starts a predetermined time after the instruction (SW2-2 being turned on). SW2-1 and SW2-2 are turned off when the set exposure time has elapsed and imaging is completed. The off / on status of SW1, SW2-1, and SW2-2 is notified to the lens MPU 110 by communication from the camera MPU 102.

[0016] The image sensor 104 is composed of a photoelectric conversion element such as a CCD sensor or a CMOS sensor, and generates an image signal by photoelectrically converting an object image formed by an image pickup optical system described later. The camera MPU 102 generates a video signal using the image signal from the image sensor 104.

[0017] The camera-side gyro sensor 106 detects angular shake (camera shake) applied to the camera body 100 due to hand shake or the like, and outputs a camera shake detection signal as an angular velocity signal. The camera MPU 102 drives the image sensor actuator 107 based on the camera shake detection signal and a shake correction ratio of an IIS described later, thereby moving the image sensor 104 in a direction including a component in a direction perpendicular to the optical axis of the imaging optical system described later. This makes it possible to reduce (correct) image shake caused by camera shake. At this time, the camera MPU 102 performs feedback control of the image sensor actuator 107 so that the position of the image sensor 104 detected by the image sensor position sensor 108 (the amount of movement from a position on the optical axis that is the center of movement) approaches the target position. With the above configuration, image shake correction (hereinafter referred to as IIS) is performed by moving the image sensor 104. In addition to performing IIS, the camera MPU 102 also electronically transforms the image using a signal from the camera-side gyro sensor 106, and performs so-called electronic image stabilization such as translation transformation, rotation transformation, and keystone transformation (tilt correction).

[0018] The acceleration sensor 109 detects the attitude of the camera body 100 and detects shake (shift shake) that is difficult to detect with the camera side gyro sensor 106 .

[0019] The rear display 116 displays an image corresponding to a video signal generated by the camera MPU 102 using an imaging signal from the imaging element 104. Before imaging, the user can observe the displayed image as a viewfinder image (live view image). After imaging, a still image or video for recording generated by imaging can be displayed on the rear display 116. In this embodiment, "imaging" refers to imaging for recording.

[0020] The interchangeable lens 101 includes an imaging optical system including an image stabilization lens 114 , a lens MPU 110 , a lens side gyro sensor 111 , a lens side contact terminal 112 , a lens actuator 113 , and a lens position sensor 115 .

[0021] The lens side gyro sensor 111 detects angular shake (lens shake) applied to the interchangeable lens 101 and outputs a lens shake detection signal as an angular velocity signal. The lens MPU 110 drives the lens actuator 113 based on the lens shake detection signal and a shake correction ratio of the OIS described later, thereby moving the image shake correction lens 114 in a direction including a component in a direction perpendicular to the optical axis of the imaging optical system. This makes it possible to reduce (correct) image shake caused by lens shake. At this time, the lens MPU 110 performs feedback control of the lens actuator 113 so that the position of the image shake correction lens 114 detected by the lens position sensor 115 (the amount of movement from the position on the optical axis that is the center of movement) approaches the target position. With the above configuration, image shake correction (hereinafter referred to as OIS) is performed by moving the image shake correction lens 114.

[0022] In addition, in this embodiment, the lens MPU 110 includes a correction unit (first correction unit) 110a and a control unit 110b. The correction unit 110a performs correction for image blur using at least one of the image sensor 104 and the image blur correction lens 114 based on a first blur correction ratio (first correction ratio) between the OIS and the IIS, or a second blur correction ratio (second correction ratio) between the OIS and the IIS. The first blur correction ratio is determined based on the movable amount of the image sensor 104 and the movable amount of the image blur correction lens 114. The second blur correction ratio is determined based on information on the image movement amount between the center and periphery of the image when the OIS is performed and information on the image movement amount between the center and periphery of the image when the IIS is performed. The control unit 110b executes the first control or the second control. In the first control, the correction unit 110a corrects image blur based on a first shake correction ratio, and the image transformation processing unit (second correction unit) 217 ​​corrects trapezoidal distortion (trapezoidal distortion) of image blur, which will be described later. In the second control, the correction unit 110a corrects image blur based on a second shake correction ratio, and the image transformation processing unit 217 does not correct trapezoidal distortion.

[0023] The configuration of the image stabilization unit of the camera system will be described below with reference to Fig. 2. Fig. 2 is a block diagram of the image stabilization unit. The image stabilization unit includes an image stabilization unit 201 that is a part of the camera MPU 102, and an image stabilization unit 209 that is a part of the lens MPU 110.

[0024] The image blur correction unit 201 includes a camera gyro offset removal unit 202, a camera side angle conversion unit 203, a camera information storage unit 204, a lens communication transmission unit 205, a lens communication reception unit 206, a camera side coordinated drive control unit 207, and an image sensor drive control unit 208. The camera gyro offset removal unit 202 removes an offset component from an angular velocity signal detected by the camera side gyro sensor 106. The camera side angle conversion unit 203 converts the angular velocity signal output from the camera gyro offset removal unit 202 into an angle signal. The camera information storage unit 204 stores information such as the stroke (movable amount) of the image sensor 104, which is a correction member of the IIS, and the sensor size. The lens communication transmission unit 205 transmits the information stored in the camera information storage unit 204 to a camera communication reception unit 214 of the image blur correction unit 209. The lens communication reception unit 206 receives information transmitted from the camera communication transmission unit 213 of the image blur correction unit 209. The camera-side cooperative drive control unit 207 determines the amount of image blur to be corrected by the IIS, based on the information stored in the camera information storage unit 204 and the information received by the lens communication receiving unit 206. The image sensor drive control unit 208 generates a drive control signal for the image sensor 104, using the angle signal output from the camera-side angle conversion unit 203 and the amount of image blur output from the camera-side cooperative drive control unit 207. In addition, the output from the camera gyro offset removal unit 202 is sent to an image transformation processing unit 217, which is a separate processing block in the camera MPU 102, and the image transformation processing unit 217 performs image transformation processing on the image using the output from the camera gyro offset removal unit 202.

[0025] The image blur correction unit 209 includes a lens gyro offset removal unit 210, a lens side angle conversion unit 211, a lens information storage unit 212, a camera communication transmission unit 213, a camera communication reception unit 214, a lens side coordinated drive control unit 215, and an image blur correction lens drive control unit 216. The lens gyro offset removal unit 210 removes an offset component from the angular velocity signal detected by the lens side gyro sensor 111. The lens side angle conversion unit 211 converts the angular velocity signal output from the lens gyro offset removal unit 210 into an angle signal. The camera communication transmission unit 213 transmits information stored in the lens information storage unit 212 to the lens communication reception unit 206 of the image blur correction unit 201. The camera communication reception unit 214 receives information transmitted from the lens communication transmission unit 205 of the image blur correction unit 201.

[0026] The lens information storage unit 212 stores information about the shake correction ratio and the stroke of the image shake correction lens 114, which is a correction member of the OIS. The lens information storage unit 212 also stores information about the image shake correction angle when the image sensor 104 moves a predetermined amount, that is, information about the camera image shake correction sensitivity.

[0027] Furthermore, the lens information storage unit 212 stores lens peripheral image blur correction remaining amount information, which is the remaining amount of image blur correction in the peripheral part of the image when the image blur correction lens 114 corrects the image blur in the center of the image by a predetermined angle. Note that the lens peripheral image blur correction remaining amount may be information on the image point movement amount in the center of the image and the image point movement amount at a predetermined image height when the image blur correction lens 114 is moved by a predetermined amount, or may be found from information on the image blur correction angle when the image blur correction lens 114 is moved by a predetermined amount. Furthermore, the lens peripheral image blur correction remaining amount may be a function indicating how the image blur correction remaining amount in the peripheral part of the image changes for each image height when the image blur in the center of the image is corrected by a predetermined angle.

[0028] Furthermore, the lens information storage unit 212 stores a camera peripheral image blur correction remaining amount, which is the amount of image blur correction remaining in the peripheral part of the image when the image sensor 104 corrects the image blur in the center of the image by a predetermined angle. The camera peripheral image blur correction remaining amount may be found from information on the image point movement amount in the center of the image when the camera body 100 is rotated a predetermined amount and the image point movement amount at a predetermined image height. The camera peripheral image blur correction remaining amount may also be a function indicating how the image blur correction remaining amount in the peripheral part of the image changes for each image height when the image blur in the center of the image is corrected by a predetermined angle.

[0029] The information stored in the lens information storage unit 212 may be information that changes with the movement of a zoom lens or a focus lens included in the imaging optical system.

[0030] The lens side coordinated drive control unit 215 performs coordinated drive control of the OIS and IIS using information stored in the lens information storage unit 212 and information received by the camera communication receiving unit 214. At that time, the lens side coordinated drive control unit 215 sets a shake correction ratio for determining the amount of image blur to be corrected by each image blur correction unit. In addition, the lens side coordinated drive control unit 215 uses information stored in the lens information storage unit 212 and information received by the camera communication receiving unit 214 to determine whether to switch the shake correction ratio and lens internal information related to the sensitivity required for the IIS. The image blur correction lens drive control unit 216 generates a drive control signal for the image blur correction lens 114 using the angle signal output from the lens side angle conversion unit 211.

[0031] Hereinafter, a method for setting the first shake correction ratio of the OIS and IIS will be described with reference to FIG. 3. The shake correction ratio can be set by a plurality of methods depending on the purpose. FIG. 3 is a diagram showing a method for setting the first shake correction ratio using the stroke ratio of the correction members of the OIS and IIS. Range 301 is the mechanical movable range of the image sensor 104, which is the correction member of the IIS. Range 302 is the image circle of the interchangeable lens 101, and is the movable range of the image shake correction lens 114, which is the correction member of the OIS. Range 303 is the stroke (OIS stroke) of the image shake correction lens 114 in the Y-axis direction. In addition, the image sensor 104 needs to move within the range 301 and within the range 302. Range 304 is the stroke (IIS stroke) of the image sensor 104 in the Y-axis direction. When image shake of the entire camera system is corrected using two correction components, by setting the first image shake correction ratio shown below, image shake correction can be performed by effectively utilizing the strokes of each of the OIS and IIS correction components. OIS shake correction ratio: OIS stroke / (IIS stroke+OIS stroke) IIS shake correction ratio: IIS stroke / (IIS stroke+OIS stroke) Hereinafter, a method for setting the second image blur correction ratio for suppressing the residual image blur in the peripheral parts of an image will be described. Since distortion remains in a general optical system, when correction is performed by an IIS, a difference occurs in the amount of image point movement between the center and the peripheral parts of an image due to a change in the amount of distortion. In addition, decentering distortion occurs in an OIS due to decentering of the lens, so a difference occurs in the amount of image point movement between the center and the peripheral parts of an image due to a change in decentering distortion. Therefore, in an IIS, a difference occurs in the amount of image point movement between the center and the peripheral parts of an image due to the influence of the projection method and the influence of distortion, and in an OIS, a difference occurs in the amount of image point movement between the center and the peripheral parts of an image due to the influence of the projection method and the influence of decentering distortion. In other words, the cause of the difference in the amount of image point movement between the center and the peripheral parts of an image is different between OIS and IIS, so the ratio of the amount of image point movement between the center and the peripheral parts of an image is different between OIS and IIS.

[0032] Fig. 4 is a diagram showing the amount of remaining image blur for each image height when a predetermined amount of image blur is corrected by the OIS and IIS and the amount of remaining image blur at the center of the image is set to 0. As shown in Fig. 4, when the ratio of the image point movement amount at the center and periphery of the image differs, the amount of remaining image blur at the center and periphery of the image is reduced by preferentially using one of the correction members to correct the image blur.

[0033] Therefore, as shown in FIG. 5, a method of setting a second shake correction ratio for the image shake correction amount a of the entire camera system is conceivable. When the absolute value of the image shake correction amount a is smaller than a predetermined threshold TH1, the shake correction ratio of the OIS is set to A (=1), and the shake correction ratio of the IIS is set to 1-A (=0). When the absolute value of the image shake correction amount a is equal to or greater than the predetermined threshold TH1 and smaller than the predetermined threshold TH2, the shake correction ratio of the OIS is set to B, and the shake correction ratio of the IIS is set to 1-B, and the shake correction ratio of the OIS and IIS is gradually changed. When the absolute value of the image shake correction amount a is equal to or greater than the predetermined threshold TH2, the shake correction ratio of the OIS is set to C (=0), and the shake correction ratio of the IIS is set to 1-C (=1). In this way, by preferentially using the one with a smaller image point movement amount in the periphery relative to the center of the image, the shake correction ratio can be set so as to reduce the amount of remaining image shake in the periphery of the image, compared to the method of setting the shake correction ratio by the stroke ratio. However, when the method shown in FIG. 5 is used, the amount of remaining image blur in the peripheral parts of the image differs in each of the areas of shake correction ratios A, B, and C, and the computational load increases compared to setting the first shake correction ratio based on the stroke ratio.

[0034] The electronic image stabilization will be described below. The electronic image stabilization is generally performed by performing image deformation using a geometric transformation such as a projective transformation. For example, as shown in FIG. 6, when the posture A during shooting of a certain subject changes to posture B, a point P1 on an image I1 in posture A can be transformed to a point P2 on an image I2 in posture B using a determinant H. As shown in FIG. 7, the types of projective transformation include translation, rotation, tilt, etc., and each transformation can be performed by setting each parameter of the determinant. Here, the translation and rotation correction amounts can be calculated from the output of the camera-side gyro sensor 106 and the focal length information of the interchangeable lens 101. The tilt correction amount can be calculated from the translation movement amount and the focal length information. However, since the calculation becomes complicated, the formula is often constructed on the assumption that each projective transformation correction amount changes in proportion to the image shake applied to the camera system. Therefore, when the second shake correction ratio for suppressing the amount of remaining image shake in the peripheral part of the image described above is set, the amount of remaining image shake in the peripheral part changes nonlinearly according to the amount of image shake applied to the camera system. If electronic image stabilization is performed in this state, a problem occurs in that correction is not performed correctly, particularly in tilt correction for correcting keystone distortion.

[0035] Hereinafter, the cooperative drive control of the OIS and IIS of this embodiment will be described with reference to Fig. 8. In this embodiment, the lens MPU 110 executes the cooperative drive control. Fig. 8 is a flowchart showing the cooperative drive control of the OIS and IIS of this embodiment. This flow starts after the camera system is powered on and goes through an initial drive operation and the like.

[0036] In step S801, the lens MPU 110 acquires information necessary for the cooperative drive control, such as the strokes of the correction members of the OIS and IIS, the remaining amount of image blur correction at the camera periphery, the remaining amount of image blur correction at the lens periphery, information on the sensitivity required for image blur correction, and information on whether or not electronic image stabilization is performed by the image transformation processing unit 217.

[0037] In step S802, the lens MPU 110 determines whether or not to perform tilt correction as part of electronic image stabilization. If it is determined that tilt correction is to be performed, the process of step S803 is executed, and if it is determined that tilt correction is not to be performed, the process of step S804 is executed.

[0038] In step S803, the lens MPU 110 selects a first shake correction ratio setting method based on a stroke ratio.

[0039] In step S804, the lens MPU 110 selects a second shake correction ratio setting method for suppressing the amount of remaining image blur in the peripheral portion of the image.

[0040] In step S805, the lens MPU 110 sets the shake correction ratio of the OIS and the shake correction ratio of the IIS based on the selected method for setting the shake correction ratio.

[0041] In step S806, the lens MPU 110 executes the OIS and IIS using the shake correction ratio set in step S805.

[0042] According to the configuration of this embodiment, when tilt correction is performed, a setting method of a first shake correction ratio based on a stroke ratio is selected. That is, the lens MPU 110 executes a first control in which the image transformation processing unit 217 performs tilt correction and the OIS and IIS are controlled to drive in a coordinated manner at a first shake correction ratio set by the setting method selected in step S803. As a result, image blur correction is performed so that the strokes of the OIS and IIS are appropriately used up, and the remaining image blur amount in the peripheral portion of the image can be corrected using tilt correction. On the other hand, when tilt correction is not performed, a setting method of a second shake correction ratio for reducing the remaining image blur amount in the peripheral portion of the image is selected. That is, the lens MPU 110 executes a second control in which the image transformation processing unit 217 does not perform tilt correction and the OIS and IIS are controlled to drive in a coordinated manner at a second shake correction ratio set by the setting method selected in step S804. As a result, the remaining image blur amount in the peripheral portion of the image can be reduced.

[0043] In this embodiment, the cooperative drive control is executed by the lens MPU 110, but it may be executed by the camera MPU 102. In this case, the camera MPU 102 includes a correction unit and a control unit. EXAMPLES

[0044] The basic configuration of the camera system of this embodiment is similar to that of the camera system of embodiment 1. In this embodiment, the cooperative drive control is different from that of embodiment 1. In this embodiment, only the configuration different from embodiment 1 will be described, and the description of the common configuration will be omitted.

[0045] Hereinafter, the cooperative drive control of the OIS and IIS of this embodiment will be described with reference to Fig. 9. In this embodiment, the lens MPU 110 executes the cooperative drive control. Fig. 9 is a flowchart showing the cooperative drive control of the OIS and IIS of this embodiment. This flow starts after the camera system is powered on and goes through an initial drive operation and the like.

[0046] In step S901, the lens MPU 110 acquires information necessary for the cooperative drive control, such as the movable stroke of the correction members of the OIS and IIS, the remaining amount of image blur correction at the camera periphery, the remaining amount of image blur correction at the lens periphery, information on the sensitivity required for image blur correction, and information on whether or not electronic image stabilization is performed by the image transformation processing unit 217.

[0047] In step S902, the lens MPU 110 judges whether the value of the ratio of one of the camera peripheral image blur correction remaining amount and the lens peripheral image blur correction remaining amount to the other is greater than a predetermined value. If it is determined that the value of the ratio of one of the camera peripheral image blur correction remaining amount and the lens peripheral image blur correction remaining amount to the other is greater than a predetermined value, that is, if the implementation of the image blur correction based on the first shake correction ratio is selected, the processing of step S903 is executed. If it is determined that the value of the ratio of one of the camera peripheral image blur correction remaining amount and the lens peripheral image blur correction remaining amount to the other is smaller than a predetermined value, that is, if the implementation of the image blur correction based on the second shake correction ratio is selected, the processing of step S905 is executed. Note that, if the value of the ratio of one of the camera peripheral image blur correction remaining amount and the lens peripheral image blur correction remaining amount to the other is equal to a predetermined value, it is possible to arbitrarily set which step processing is executed.

[0048] In step S903, the lens MPU 110 selects a second shake correction ratio setting method for reducing the amount of remaining image blur in the peripheral portion of the image.

[0049] In step S904, the lens MPU 110 sets the electronic image stabilization so as to prohibit tilt correction, so that only translational and rotational deformations are performed in the electronic image stabilization.

[0050] In step S905, the lens MPU 110 selects a method for setting the first shake correction ratio based on the stroke ratio.

[0051] In step S906, the lens MPU 110 sets the shake correction ratio of the OIS and the shake correction ratio of the IIS using the selected shake correction ratio setting method.

[0052] In step S907, the lens MPU 110 executes the OIS and IIS using the shake correction ratio calculated in step S805.

[0053] According to the configuration of this embodiment, when the value of the ratio of the camera peripheral image blur correction remaining amount and the lens peripheral image blur correction remaining amount to the other is larger than a predetermined value, the second shake correction ratio setting method for suppressing the image blur remaining amount in the peripheral part of the image is selected, so that the image blur remaining amount in the peripheral part of the image can be reduced. Also, in this case, by prohibiting the implementation of tilt correction in electronic image stabilization, a high image blur correction effect can be obtained.

[0054] In this embodiment, the cooperative drive control is executed by the lens MPU 110, but may be executed by the camera MPU 102. In this case, the camera MPU 102 includes an acquisition unit, a determination unit, and a setting unit. [Other Examples] The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-mentioned embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions.

[0055] The disclosure of this embodiment includes the following configurations and methods. (Configuration 1) A control device used in a camera system including a first correction member provided on one of an imaging device and a lens device detachably attached to the imaging device, the first correction member correcting image blur, and a second correction member provided on the other of the imaging device and the lens device, the second correction member correcting the image blur, a first correction unit that performs correction for the image blur using at least one of the first correction member and the second correction member, based on a first correction ratio between correction using the first correction member and correction using the second correction member, which is based on a movable amount of the first correction member and a movable amount of the second correction member, or a second correction ratio between correction using the first correction member and correction using the second correction member, which is based on information on image movement amounts between a central portion and a peripheral portion of an image when correction using the first correction member is performed and information on image movement amounts between the central portion and the peripheral portion when correction using the second correction member is performed; and a control unit that executes a first control in which the first correction unit corrects the image blur based on the first correction ratio, and a second correction unit that corrects the trapezoidal distortion of the image blur is corrected by the second correction unit, the second correction unit being configured to correct the trapezoidal distortion, or a second control in which the first correction unit corrects the image blur based on the second correction ratio, and the second correction unit is not configured to correct the trapezoidal distortion. (Configuration 2) The control device according to configuration 1, characterized in that the control unit performs the first control when the execution of the trapezoidal distortion correction is selected, and performs the second control when the execution of the trapezoidal distortion correction is not selected. (Configuration 3) 2. The control device according to claim 1, wherein the control unit performs the first control when a selection is made to correct the image blur based on the first correction ratio, and performs the second control when a selection is made to correct the image blur based on the second correction ratio. (Configuration 4) The control device according to any one of configurations 1 to 3, characterized in that an amount of remaining image blur in the peripheral portion when the image blur is corrected based on the first correction ratio is greater than an amount of remaining image blur in the peripheral portion when the image blur is corrected based on the second correction ratio. (Configuration 5) A control device according to any one of configurations 1 to 4; and an imaging optical system. (Configuration 6) A control device according to any one of configurations 1 to 4; and an imaging element. (Configuration 7) A control device according to any one of configurations 1 to 4; An imaging optical system; and an imaging element. (Method 1) A control method for a camera system including an imaging device and a first correction member provided on one of a lens device detachably attached to the imaging device, and a second correction member provided on the other of the imaging device and the lens device, comprising: performing correction for the image blur using at least one of the first correction member and the second correction member based on a first correction ratio between the correction using the first correction member and the correction using the second correction member, the first correction ratio being based on a movable amount of the first correction member and a movable amount of the second correction member, or a second correction ratio between the correction using the first correction member and the correction using the second correction member, the second correction ratio being based on information on image movement amounts between a central portion and a peripheral portion of an image when the correction using the first correction member is performed and information on image movement amounts between the central portion and the peripheral portion when the correction using the second correction member is performed; and performing a first control in which keystone distortion of the image shake is corrected and the correction unit corrects the image shake based on the first correction ratio, or performing a second control in which the keystone distortion is not corrected and the correction unit corrects the image shake based on the second correction ratio. (Configuration 8) A program for causing a computer of an imaging device or a lens device to execute the control method according to Method 1.

[0056] Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. [Explanation of symbols]

[0057] 100 Camera body (imaging device) 101 Interchangeable lenses (lens devices) 102 Camera MPU (control unit) 104 Imaging element (first correction member or second correction member) 110 Lens MPU (control unit) 110a Correction section (1st correction section) 110b Control section 114 Image stabilization lens (second correction member or first correction member) 217 Image transformation processing unit (second correction unit)

Claims

1. A control device used in a camera system including an imaging device and a first correction member provided on one of a lens device detachably attached to the imaging device, and a second correction member provided on the other of the imaging device and the lens device, a control unit that executes a first control in which image blur is corrected based on a first correction ratio between the correction using the first correction member and the correction using the second correction member, and trapezoidal distortion of the image blur is corrected electronically, or a second control in which image blur is corrected based on a second correction ratio between the correction using the first correction member and the correction using the second correction member, and the trapezoidal distortion is not corrected electronically.

2. A control device as described in claim 1, characterized in that the second correction ratio is different from the first correction ratio.

3. The control device described in Claim 1, characterized in that the first correction ratio and the second correction ratio are set based on mutually different information.

4. The first correction ratio is based on the movable amount of the first correction member and the movable amount of the second correction member, 2. The control device according to claim 1, wherein the second correction ratio is based on information regarding the amount of image movement between the center and peripheral parts of the image when correction is performed using the first correction member, and information regarding the amount of image movement between the center and peripheral parts when correction is performed using the second correction member.

5. 2. The control device according to claim 1, wherein the control unit performs the first control when the execution of the trapezoidal distortion correction is selected, and performs the second control when the execution of the trapezoidal distortion correction is not selected.

6. 2. The control device according to claim 1, wherein the control unit performs the first control when a selection is made to correct the image blur based on the first correction ratio, and performs the second control when a selection is made to correct the image blur based on the second correction ratio.

7. 2. The control device according to claim 1, wherein the amount of remaining image blur in the peripheral portion of the image when the image blur is corrected based on the first correction ratio is greater than the amount of remaining image blur in the peripheral portion when the image blur is corrected based on the second correction ratio.

8. A control device according to any one of claims 1 to 5; and an imaging optical system.

9. A control device according to any one of claims 1 to 5; and an imaging element.

10. A control device according to any one of claims 1 to 5; an imaging optical system; and an imaging element.

11. A control method used in a camera system including an imaging device and a first correction member provided on one of a lens device detachably attached to the imaging device, and a second correction member provided on the other of the imaging device and the lens device, comprising: a step of executing a first control in which image blur is corrected based on a first correction ratio between the correction using the first correction member and the correction using the second correction member, and trapezoidal distortion of the image blur is corrected electronically, or a second control in which image blur is corrected based on a second correction ratio between the correction using the first correction member and the correction using the second correction member, and the trapezoidal distortion is not corrected electronically.

12. A program causing a computer of an imaging device or a lens device to execute the control method according to claim 11.

Images