Imaging device, control method for imaging device, and program

Abstract

To provide an imaging apparatus which can prevent image quality deterioration by performing image blur correction related to a subject according to execution of camera shake correction.SOLUTION: A camera system control unit 5 in an imaging apparatus detects the movement of a subject on the basis of a photographed image acquired according to execution of camera shake correction of the imaging apparatus by a gimbal system control unit 14. The camera system control unit 5 corrects an image blur related to a subject on the basis of detected movement information of the subject.SELECTED DRAWING: Figure 1

Description

Technical Field

[0001] The present invention relates to an imaging apparatus, a control method for an imaging apparatus, and a program.

Background Art

[0002] A photographing method using a stick (hereinafter referred to as a "selfie stick") for arranging an imaging apparatus in front of the photographer to shoot the photographer himself / herself as a subject is known. Further, as an example of a configuration in which a gimbal mechanism is provided at the tip of a selfie stick to which the imaging apparatus is attached, a gimbal stick is known. The gimbal stick is a stick with a stabilizer function that corrects camera shake of the imaging apparatus. Patent Document 1 discloses an imaging apparatus that corrects camera shake using two shake correction units.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] When shooting using a selfie stick or a gimbal stick, the photographer moves relative to the imaging apparatus due to the shooting operation, causing blur related to the subject (subject blur) in the captured image. The imaging apparatus described in Patent Document 1 can correct camera shake, but cannot correct subject blur caused by the movement of the subject relative to the imaging apparatus. An object of the present invention is to provide an imaging apparatus capable of correcting subject blur in accordance with the execution of camera shake correction and preventing image quality degradation.

Means for Solving the Problems

[0005] An imaging apparatus according to one embodiment of the present invention includes: a first motion detection means for detecting the movement of a subject based on an image acquired in response to the execution of a first correction by a first correction control means for correcting image blur caused in the image due to vibration of the imaging apparatus; and a second correction control means for executing a second correction based on the motion information of the subject output by the first motion detection means for correcting image blur related to the subject. Furthermore, the main body of the imaging device has a shake detection means that outputs a shake detection signal related to the shake of the imaging device, and the second correction control means performs the second correction based on the difference information between the motion information of the subject and the shake detection signal. . [Effects of the Invention]

[0006] According to the present invention, it is possible to prevent image quality degradation caused by subject blur, which occurs when the subject moves relative to the imaging device in response to the execution of image stabilization. [Brief explanation of the drawing]

[0007] [Figure 1] This figure shows an example of the configuration of an imaging device. [Figure 2] This is an example of a subject image. [Figure 3] This diagram illustrates a modified example of correcting subject blur. [Figure 4] This is a flowchart explaining the control of image blur correction. [Figure 5] This figure shows an example of the configuration of an imaging device. [Modes for carrying out the invention]

[0008] (Example 1) Figure 1 shows an example of the configuration of the imaging device according to this embodiment. Figure 1(A) shows the external appearance of the imaging device. Figure 1(B) is a functional block diagram of the imaging device. The camera body 1 is the main body of the imaging device. The gimbal mechanism 2 is detachable from the camera body 1 and corrects image blur (camera shake) in the captured image caused by vibrations applied to the imaging device by driving the camera body 1. The present invention can also be applied to a predetermined device (for example, a device for taking selfies) that is detachable from the camera body 1 and has a gimbal mechanism 2. A gimbal stick may be used as a device for taking selfies. A gimbal stick is a selfie stick with a stabilizer function.

[0009] In Example 1, a configuration in which the camera body 1 of the imaging device is attached to the gimbal mechanism 2 is described, but the scope of application of the present invention is not limited to the configuration shown in Figure 1. The present invention is applicable to any imaging device to which a predetermined device having a function of correcting camera shake can be attached or detached. For example, the present invention is also applicable to interchangeable lens cameras.

[0010] The camera body 1 shown in Figure 1(B) has an imaging optical system 3 to a communication unit 13. The imaging optical system 3 is provided in the lens barrel and has multiple optical elements such as an image stabilization lens 3a, an attached focus lens, and a zoom lens. The image stabilization lens 3a corrects image blur by being driven in a plane perpendicular to the optical axis 4.

[0011] The camera-side shake detection unit 11 detects shake (rotational shake and translational shake) applied to the imaging device and outputs a shake detection signal. The camera-side shake detection unit 11 can be implemented using, for example, a vibration gyroscope. The camera system control unit 5 controls the entire camera body 1. The camera system control unit 5 has a subject movement detection unit 5a and a subject detection unit 5b for blur correction. The subject detection unit 5b functions as a subject detection means and detects a subject to be corrected for image blur (shake of the subject image; hereinafter referred to as subject blur) based on the captured image. The subject movement detection unit 5a functions as a first motion detection means and detects the movement of the subject detected by the subject detection unit 5b for blur correction. Subject blur occurs, for example, when the photographer moves relative to the imaging device due to the shooting operation. The subject detection unit 5b for blur correction detects, for example, the user giving the shooting instruction as the subject to be corrected for subject blur.

[0012] The camera system control unit 5 controls the camera-side image stabilization unit 12 when performing image blur correction. The camera-side image stabilization unit 12 drives the image stabilization lens 3a in a plane perpendicular to the optical axis 4 according to the instructions of the camera system control unit 5. This corrects image blur. The camera-side image stabilization unit 12 may also correct image blur by driving the image sensor 6 in a plane perpendicular to the optical axis 4. The camera system control unit 5 may also drive a focus lens, aperture, etc. (not shown) using a drive means (not shown). The communication unit 13 communicates with the camera body 1 and the gimbal mechanism 2. The camera system control unit 5 communicates with the gimbal system control unit 14 via the communication unit 13.

[0013] The subject light is imaged onto the imaging surface of the image sensor 6 via the imaging optical system 3. The image sensor 6 converts the subject light into photoelectric signals and outputs signals related to the captured image. The camera system control unit 5 adjusts the imaging optical system 3 based on the information obtained from the image sensor 6, which provides the image evaluation amount and appropriate exposure amount. As a result, the image sensor 6 is exposed to the appropriate amount of light, and the subject image is formed near the image sensor 6.

[0014] The image processing unit 7 generates an image by performing image processing based on the signal output by the image sensor 6. For this purpose, the image processing unit 7 includes an A / D converter, a white balance adjustment circuit, a gamma correction circuit, an interpolation calculation circuit, a color interpolation processing means, etc. The color interpolation processing means generates a color image by performing color interpolation (demosaiking) processing on the Bayer array signal. The image processing unit 7 also compresses images, videos, audio, etc., using a predetermined method. The image processing unit 7 can also generate a shake detection signal related to shake applied to the imaging device based on a comparison between multiple images obtained from the image sensor 6. Therefore, the camera-side shake detection unit 11 may be realized by the image sensor 6 and the image processing unit 7. The memory unit 8 is a storage unit that stores signals related to the image output by the image processing unit 7. The display unit 9 displays information to be presented to the user (e.g., image information). The display unit 9 includes, for example, a rear display device provided on the back of the camera body 1 or an EVF (electronic viewfinder) provided in the viewfinder.

[0015] The camera-side operation detection unit 10 detects signals from operating means, including a shutter release button (not shown). The camera system control unit 5 controls the imaging system, image processing system, and recording / playback system according to user operations. For example, when the camera-side operation detection unit 10 detects that the shutter release button has been pressed, the camera system control unit 5 controls the driving of the image sensor 6, the operation of the image processing unit 7, and compression processing. Furthermore, the camera system control unit 5 instructs the display unit 9 to control the state of each segment of the information display device that displays information. Note that by making the rear display device, which is part of the display unit 9, a touch panel, the display unit 6 may have both the function of displaying information and the function of accepting operations.

[0016] The gimbal mechanism 2 includes a communication unit 13 to a gimbal-side shake correction unit 17. The gimbal-side shake detection unit 16 detects shake (rotational shake and translational shake) applied to the imaging device. The gimbal-side shake detection unit 16 is implemented using, for example, a vibration gyroscope. The gimbal system control unit 14 controls the entire gimbal mechanism 2. The gimbal-side operation detection unit 15 detects user operations. The gimbal-side operation detection unit 15 detects, for example, signals from operation means including a shutter release button (not shown) provided on the gimbal mechanism 2. The gimbal-side shake detection unit 16 detects shake applied to the imaging apparatus and outputs a shake detection signal. The gimbal-side image stabilization unit 17 drives the gimbal mechanism 2 to drive the camera body 1. The gimbal-side image stabilization unit 17 drives the gimbal mechanism 2 to rotate about three axes, for example.

[0017] A user instructs, for example, a shooting instruction operation for the camera body 1 via the operation means in the gimbal mechanism 2. When the operation means in the gimbal mechanism 2 is operated, the gimbal-side operation detection unit 15 detects that the operation has been performed, and the gimbal system control unit 14 notifies the camera system control unit 5 via the communication unit 13 that the shooting instruction has been issued. The camera system control unit 5 that has received the notification starts the shooting operation of the camera body 1. Specifically, the camera system control unit 5 appropriately controls a focus lens driving unit and a diaphragm driving unit, which are not shown. Regarding operations other than the shooting instruction, operations performed by the user on the gimbal mechanism 2 are notified to the camera body 1 in a similar manner. This allows the user to operate the camera body 1 via the gimbal mechanism 2.

[0018] Next, control related to image blur correction will be described. The gimbal system control unit 14 functions as a first correction control unit that executes camera shake correction (first correction control). Specifically, the gimbal system control unit 14 acquires a shake detection signal (first shake detection signal) output by the gimbal-side shake detection unit 16, and calculates the drive amount of the gimbal mechanism 2 for correcting image blur based on the first shake detection signal. Then, the gimbal system control unit 14 transmits the calculated drive amount to the gimbal-side image stabilization unit 17 as a command value, and drives the gimbal mechanism 2. As a result, the entire camera body 1 attached to the gimbal mechanism 2 is driven, and camera shake correction is executed.

[0019] The camera system control unit 5 acquires a shake detection signal (second shake detection signal) output by the camera-side shake detection unit 11. The camera system control unit 5 calculates a drive amount of the blur correction lens 5a for correcting image blur based on the acquired second shake detection signal. The camera system control unit 5 transmits the calculated drive amount to the camera-side blur correction unit 12 as a command value, and drives the blur correction lens 3a.

[0020] Assume a case where a photographer performs self-shooting to photograph themselves. In this case, the photographer attaches a selfie stick having a gimbal mechanism 2 to the camera body 1, and photographs themselves as a subject. As shown in FIG. 1(B), in a state where the gimbal mechanism 2 is attached to the camera body 1, a large amount of camera shake can be canceled by the gimbal mechanism 2. The gimbal-side shake detection unit 16 detects camera shake when the user holds the entire imaging apparatus by hand, whereas the camera-side shake detection unit 11 detects camera shake in a state where camera shake has been canceled to some extent by the gimbal mechanism 2. Therefore, in the present embodiment, the blur correction lens does not largely perform camera shake correction, and most camera shake correction is performed by the gimbal mechanism 2.

[0021] In the present embodiment, in the imaging apparatus, when a subject blur correction mode is set, the gimbal mechanism 2 executes camera shake correction, and the camera system control unit 5 functions as a second correction control unit that corrects subject blur (executes second correction control). In response to the gimbal mechanism 2 being driven to execute camera shake correction, the imaging element 6 and the image processing unit 7 acquire a captured image in a state where camera shake has been canceled to some extent. A blur correction target subject detection unit 5b included in the camera system control unit 5 detects a subject to be a correction target for subject blur based on the acquired captured image, and a subject movement detection unit 5a outputs motion information of the detected subject. The camera system control unit 5 drives the blur correction lens 3a via the camera-side blur correction unit 12 based on the motion information of the subject. As a result, subject blur is corrected.

[0022] FIG. 2 is an example of a subject image observed on a display unit. Figure 2(A) shows the subject image when the subject is stationary. Figure 2(B) shows the subject image when the subject is moving. The subject 21 shown in Figure 2 is the user giving the shooting command. The focus point 22 is the focus point used for focusing during shooting. The user can change the focus point 22 as they see fit. In the example shown in Figure 2, the face of the subject 21 is selected as the focus point 22. The blur correction target subject detection unit 5b detects, for example, the subject 21 near the focus point 22 as the user giving the shooting command and as the target for blur correction. The blur correction target subject detection unit 5b may also detect the user giving the shooting command by detecting the handle of the gimbal mechanism 2 or the like that is visible in the shooting screen instead of the focus point 22.

[0023] The subject movement detection means 5a detects the movement of the subject 21 using motion vectors between captured images arranged in a time series. For example, the subject movement detection means 5a detects the motion vector 23 shown in Figure 2(B) as motion information of the subject 21. The camera system control unit 5 drives the image stabilization lens 3a via the camera-side image stabilization means 12 based on the detected motion vector 23 to correct subject blur.

[0024] The imaging device of this embodiment acquires motion vectors during video recording and uses them to correct subject blur. However, if there is a method to acquire the motion vector of the subject during shooting, the present invention is also effective for still image shooting. One method for acquiring motion vectors during still image shooting is to use an imaging device having multiple image sensors, and acquire motion vectors from the captured image obtained by the other image sensor while still image shooting (exposure) is being performed with one image sensor. Another method that can be applied is to use an image sensor that can read out signals during exposure, known as non-destructive readout.

[0025] In the configuration of Example 1, most of the camera shake is canceled by the gimbal mechanism 2, so the detected motion vector 23 roughly matches the movement of the subject. Therefore, the amount of drive for the image stabilization lens 3a is calculated based on the detected motion vector 23, and the image stabilization lens 3a is driven to correct subject blur.

[0026] The following method may be applied as a method for correcting subject blur. The blur detection signal output by the camera-side blur detection unit 11 indicates the remaining image stabilization by the gimbal mechanism 2. Therefore, the camera system control unit 5 calculates the amount of drive for the image stabilization lens 3a based on the motion vector 23 of the subject detected by the subject movement detection unit 5a and the blur detection signal output by the camera-side blur detection unit 11, and drives the image stabilization lens 3a. Specifically, the camera system control unit 5b subtracts the amount of blur corresponding to the blur detection signal output by the camera-side blur detection unit 11 from the motion information indicated by the motion vector 23. The camera system control unit 5b uses the above subtraction result (difference information) as the motion information of the subject 21, and drives the image stabilization lens 3a based on this motion information. The camera system control unit 5 also transmits the blur detection signal output by the camera-side blur detection unit 11 to the gimbal system control unit 14 of the gimbal mechanism 2 via the communication unit 13. Based on the shake detection signal received from the camera system control unit 5, the gimbal system control unit 14 instructs the gimbal-side image stabilization unit 17 to drive the gimbal mechanism 2 and perform image stabilization.

[0027] In the imaging device of Embodiment 1, the camera-side image stabilization unit 12 corrects only subject blur and translational blur (image blur caused by the camera body 1 moving parallel to the image sensor), which cannot be corrected by the gimbal mechanism 2. Therefore, the correction stroke for image blur correction in the camera-side image stabilization unit 12 is less likely to be insufficient, making it possible to correct larger subject blurs.

[0028] Figure 3 illustrates a modified example of subject blur correction. Figure 3 shows an example of the subject image observed on the display unit. Figure 3(A) shows the subject image when the subject 31 is stationary. Figure 3(B) shows the subject image when the subject 31 is moving, and Figure 3(b) shows the subject image when the subject is moving and camera shake is input to the camera body 1. The subject 31 is the user giving the shooting command. The background 32 is captured together with the subject 31. The blur correction target subject detection unit 5b detects the subject 31 as the user giving the shooting command and as the target for blur correction.

[0029] The subject movement detection means 5a detects the motion vector 33 shown in Figure 3(B) as motion information of the subject 31. The subject movement detection means 5a also detects the motion vector (background vector) 34 shown in Figure 3(B) as motion information of the background 32. Since the background 32 is generally stationary, the amount of movement of the camera body 1 relative to the background 32 is observed as a background vector 34. Most of the camera shake is canceled out by the gimbal mechanism 2. Therefore, the background vector 34 corresponds to the observation of the remaining image stabilization by the gimbal mechanism 2. Based on the detected motion vector 33, the camera system control unit 5 drives the image stabilization lens 3a via the camera-side image stabilization unit to correct subject blur.

[0030] As shown in Figure 3(B), if the remaining image stabilization in the gimbal mechanism 2 is large enough to be observed as a background vector 34 (for example, above a threshold), subject blur may be corrected using the following method. The camera system control unit 5 transmits information on the amount of shake (angular shake) corresponding to the remaining image stabilization detected as a background vector 34 from the camera system control unit 5 to the gimbal system control unit 14. The gimbal system control unit 14 performs image stabilization based on the shake amount information received from the camera system control unit 5. Then, the camera system control unit 5 drives the image stabilization lens 3a based on the difference information between the motion vector 33 and the background vector 34 to correct subject blur.

[0031] Figure 4 is a flowchart illustrating the control of image blur correction by the imaging device of Example 1. The process described in this flowchart is implemented by the processor (CPU) of the imaging device executing a control program read from a predetermined memory unit. This process begins as soon as power is turned on to the imaging device. In Figure 4, S indicates the step number of each process described in this flowchart.

[0032] In S4001, the camera system control unit 5 determines whether the shutter release button has been pressed and a shooting start command has been input (S2 is ON). If no shooting start command has been input, the process returns to S4001. If a shooting start command has been input, the process proceeds to S4002. In S4002, the camera system control unit 5 determines whether the subject blur correction mode is set. If the subject blur correction mode is not set, the process proceeds to S4007. If the subject blur correction mode is set, the process proceeds to S4003. In S4003, the gimbal system control unit 14 drives the gimbal-side shake correction unit 17 to perform image stabilization based on the output of the gimbal-side shake detection unit 16, or the output of the gimbal-side shake detection unit 16 and the camera-side shake detection unit 11.

[0033] Next, in S4004, the camera system control unit 5 drives the camera-side image stabilization unit 12 to correct subject blur based on the subject movement information detected by the subject movement detection unit 5a. The camera system control unit 5 may also correct subject blur based on the difference information between the detection result of the subject movement detection unit 5a and the amount of shake corresponding to the output of the camera-side image stabilization unit 11. In S4005, the camera system control unit 5 starts the shooting operation. In S4006, the camera system control unit 5 decides whether to end the shooting. If shooting is to be ended, the process ends. If shooting is not to be ended, the process returns to S4001.

[0034] Furthermore, in S4007, the gimbal system control unit 14 drives the gimbal-side shake correction unit 17 based on the output of the gimbal-side shake detection unit 16 to perform image stabilization. Subsequently, in S4008, the camera system control unit 5 drives the camera-side shake correction unit 12 based on the output of the camera-side shake detection unit 11 to perform image stabilization (correction of translational shake). Then, in S4009, the camera system control unit 5 starts the shooting operation, and the process proceeds to S4006.

[0035] According to the imaging device of Example 1, the gimbal mechanism 2 performs image stabilization and the camera body 1 performs subject blur correction, thereby correcting camera shake and preventing image quality degradation caused by subject blur resulting from the subject moving relative to the imaging device.

[0036] (Example 2) Figure 5 shows an example of the configuration of the imaging device in Example 2. In the imaging device of Example 2, a predetermined device that can be attached to and detached from the camera body is the lens device. The other configurations are basically the same as those of the imaging device of Example 1, so only the differences will be described in detail.

[0037] Figure 5(A) shows an example of a central cross-section of the imaging device. Figure 5(B) is a functional block diagram of the imaging device. Components with the same reference numerals in Figures 5(A) and 5(B) correspond to each other. The camera body 51 is the main body of the imaging device. The lens device 52 is detachable from the camera body 51. In this embodiment, a so-called interchangeable-lens camera in which the camera body 51 and lens barrel 52 are detachably provided is described, but the scope of application of the present invention is not limited to interchangeable-lens cameras. The present invention is also applicable to integrated-lens cameras.

[0038] In Figures 5(A) and (B), the camera system control unit 55 controls the camera body 51. The camera system control unit 55 corresponds to the camera system control unit 5 in Figure 1. The image sensor 56, image processing unit 57, memory unit 58, display unit 59, and operation detection unit 60 correspond to the image sensor 6, image processing unit 7, memory unit 8, display unit 9, and camera-side operation detection unit 10 in Figure 1, respectively. The rear display device 59a is a display device provided on the back of the camera body 51. The EVF 59b is an electronic viewfinder provided in the viewfinder of the camera body 51. The electrical contact 63 mediates communication between the camera body 1 and the lens device 52.

[0039] The camera-side shake detection unit 61 detects shake applied to the imaging device and outputs a shake detection signal. The camera-side shake detection unit 61 corresponds to the camera-side shake detection unit 11 in Figure 1. The camera system control unit 55 controls the camera-side image stabilization unit 62 based on the output of the camera-side shake detection unit 61. The camera-side image stabilization unit 62 corrects image blur by driving the image sensor 56 in a plane perpendicular to the optical axis 54, according to the instructions of the camera system control unit 55. The camera-side image stabilization unit 62 corresponds to the camera-side image stabilization unit 12 in Figure 1.

[0040] The image stabilization target subject detection unit 55b corresponds to the image stabilization target subject detection unit 5b in Figure 1. The subject movement detection unit 55a corresponds to the image stabilization target subject detection unit 5b in Figure 1. When the subject image stabilization mode is set, the camera system control unit 55 acquires the captured image obtained in response to the execution of image stabilization by the lens device 52 from the image processing unit 57. Then, the camera system control unit 55 corrects subject blur based on the subject movement information detected based on the acquired captured image. Specifically, the camera system control unit 55 drives the image sensor 56 via the camera-side image stabilization unit 62 based on the subject movement information detected by the image stabilization target subject detection unit 55b, which is output by the subject movement detection unit 55a. This corrects subject blur. As a modification of this embodiment, the camera system control unit 55 may transmit subject movement information to the lens system control unit 64, and the lens system control unit 64 may drive the image stabilization lens 3a based on the received movement information to correct subject blur.

[0041] Similar to Example 1, the camera system control unit 55 may transmit information on the amount of shake indicating the remaining image stabilization to the gimbal system control unit 14, and drive the image sensor 56 based on the difference information between the motion vector of the subject and the background vector to correct subject blur.

[0042] In the lens device 52, the imaging optical system 53 is a photographic optical system having multiple lenses and provided in the lens barrel 52. The optical axis 54 is the optical axis of the photographic optical system 53. The image stabilization lens 53a corrects image blur by being driven in a plane perpendicular to the optical axis 54. The image stabilization lens 53a corresponds to the image stabilization lens 3a in Figure 1.

[0043] The lens system control unit 64 controls the entire lens device 52. The lens-side shake detection unit 65 detects shake applied to the imaging device. Based on the output of the lens-side shake detection unit 65, the lens system control unit 64 controls the lens-side shake correction unit 66. In accordance with this control, the lens-side shake correction unit 66 drives the shake correction lens 53a to perform image stabilization.

[0044] The imaging device of Example 2 performs image stabilization in the lens barrel 52 and subject blur correction in the camera body 51. This makes it possible to correct camera shake and prevent image quality degradation caused by subject blur resulting from the movement of the subject relative to the imaging device. In the above-described embodiments 1 and 2, the case in which a predetermined device equipped with an image stabilization function (stabilizer function) is attached was explained. However, it is also possible to attach a predetermined device that does not have an image stabilization function to the camera body 1. If the predetermined device attached to the camera body 1, such as a selfie stick, does not have a stabilizer function such as a gimbal mechanism 2, the camera body 1 may perform image stabilization control differently from the case in which the attached predetermined device has a stabilizer function. Specifically, if the attached predetermined device does not have a stabilizer function, the camera body 1 may perform image stabilization control based on the detection result of a second motion detection means that detects the movement of the camera body. Also, if the predetermined device attached to the camera body 1 does not have a gimbal mechanism 2, the camera body 1 may perform control that corrects both camera shake and subject shake based on the outputs of the second motion detection means and the first motion detection means. All of these controls have in common that they correct camera shake based on the output of the second motion detection means. These controls are referred to as the third correction control in this specification. Furthermore, a gyro sensor, an accelerometer, or a motion vector detection means can be used as the second motion detection means. However, if a motion vector detection means is used as the second motion detection means, the motion vector detection means shall output a background vector.

[0045] Furthermore, whether or not the attached predetermined device has an image stabilization function may be determined by communication with the attached predetermined device after the detection means has detected that the predetermined device has been attached. For example, it may be determined whether or not the attached device has an image stabilization function (first correction means that executes the first correction control) by obtaining the model number of the attached device. Alternatively, it may be determined by shooting a video (so-called live view video) after the predetermined device has been attached and comparing the output of the second motion detection means with the amount of background movement that appears in the video. If the attached device has an image stabilization function, the second correction control is executed in the camera body.

[0046] The disclosure of this invention includes the following configurations, methods, and programs. (Composition 1) A first motion detection means detects the movement of a subject based on the captured image acquired in response to the execution of a first correction by a first correction control means, which corrects image blur caused in the captured image due to the shaking of the imaging device. The system includes a second correction control means that performs a second correction to correct image blur related to the subject based on the motion information of the subject output by the first motion detection means. An imaging device characterized by the following features. (Configuration 2) The first correction control means performs the first correction by driving the main body of the imaging device. The imaging apparatus according to configuration 1, characterized by the features described above. (Composition 3) The first correction control means is, A predetermined device that is detachably attached to the main body of the imaging device is provided, The gimbal mechanism of the aforementioned predetermined device drives the main body. The imaging apparatus according to configuration 2, characterized in that... (Composition 4) The aforementioned device is a device for taking selfies. The imaging apparatus according to configuration 3, characterized by the above. (Composition 5) The first correction control means is, A predetermined device that is detachably attached to the main body of the imaging device is provided, The first correction is performed by driving the first correction means of the predetermined device. The imaging apparatus according to configuration 1, characterized by the features described above. (Composition 6) The aforementioned predetermined device is a lens device. The imaging apparatus according to configuration 5, characterized in that it is a device. (Composition 7) The main body of the imaging device has a vibration detection means that outputs a vibration detection signal related to the vibration of the imaging device. The second correction control means performs the second correction based on the motion information of the subject and the shake detection signal. An imaging device according to any one of configurations 1 to 4, characterized by the above. (Composition 8) The second correction control means performs the second correction based on the difference information between the motion information of the subject and the shake detection signal. The imaging device according to configuration 7, characterized by the features described above. (Composition 9) The second correction control means transmits the vibration detection signal to the first correction control means. The first correction control means further performs the first correction based on the shake detection signal received from the second correction control means. The imaging apparatus according to claim 7 or 8. (Composition 10) The system includes a subject detection means that detects the user who issued the shooting instruction as the subject, The first motion detection means detects the motion vector of the subject detected by the subject detection means. The imaging apparatus according to configuration 1, characterized by the features described above. (Composition 11) The first motion detection means detects the motion vector of the subject and the background vector, The second correction control means performs the second correction based on the difference information between the motion vector of the subject and the background vector. The imaging apparatus according to configuration 10, characterized by the above. (Composition 12) The second correction control means transmits information on the amount of oscillation corresponding to the background vector to the first correction control means. The first correction control means further performs the first correction based on the information of the amount of deflection received from the second correction control means. The imaging apparatus according to configuration 11, characterized by the features described above. (Composition 13) The second correction control means performs the second correction by driving an optical element or an image sensor. An imaging device according to any one of configurations 1 to 12, characterized by the above. (Composition 14) It is equipped with a detection means for detecting that a predetermined device has been installed, The second correction control means is The second correction is performed when the predetermined device, whose installation has been detected by the detection means, is equipped with a first correction means capable of performing the first correction. The imaging apparatus according to configuration 1, characterized by the features described above. (Composition 15) It is equipped with a second motion detection means for detecting the movement of the imaging device, The second correction control means is If the predetermined device whose installation has been detected by the detection means does not have the first correction means, Perform a third correction that is different from the second correction described above. The imaging apparatus according to configuration 14, characterized by the features described above. (Composition 16) The third correction, at a minimum, corrects image blur occurring in the captured image based on motion information of the imaging device output by the second motion detection means. The imaging apparatus according to configuration 15, characterized by the features described above. (Composition 17) An imaging device having a main body and a predetermined device that can be attached to or detached from the main body, The aforementioned predetermined device has a first correction control means that performs a first correction to correct image blur caused in the captured image due to the shaking of the imaging device, The main body is, A first motion detection means for detecting the movement of a subject based on the captured image acquired in response to the execution of the first correction control means, The system includes a second correction control means that performs a second correction to correct image blur related to the subject based on the motion information of the subject output by the first motion detection means. An imaging device characterized by the following features. (Composition 18) A first motion detection step detects the movement of a subject based on the captured image acquired in response to the execution of a first correction by a first correction control means, which corrects image blur caused in the captured image due to vibration of the imaging device. The system includes a second correction control step which performs a second correction to correct image blur related to the subject based on the motion information of the subject output by the first motion detection step. A control method for an imaging device, characterized by the following: (Composition 19) The computer in the imaging device, A first motion detection step detects the movement of a subject based on the captured image acquired in response to the execution of a first correction that corrects image blur caused in the captured image due to vibration of the imaging device, A second correction control step is performed, which executes a second correction to correct image blur related to the subject based on the motion information of the subject output by the first motion detection step. A program characterized by the following features.

[0047] (Other embodiments) The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions. [Explanation of Symbols]

[0048] 1. Camera body 2. Gimbal mechanism 5. Camera System Control Unit 14. Gimbal System Control Unit

Claims

1. A first motion detection means detects the movement of a subject based on the captured image acquired in response to the execution of a first correction by a first correction control means, which corrects image blur caused in the captured image due to the shaking of the imaging device. The system further includes a second correction control means that performs a second correction to correct image blur related to the subject based on the motion information of the subject output by the first motion detection means, The main body of the imaging device has a vibration detection means that outputs a vibration detection signal related to the vibration of the imaging device. The second correction control means performs the second correction based on the difference information between the motion information of the subject and the shake detection signal. An imaging device characterized by the following features.

2. A subject detection means for detecting a subject from an captured image, A first motion detection means detects the motion vector of the subject detected by the subject detection means and the background vector based on the captured image acquired in response to the execution of a first correction by the first correction control means, which corrects image blur caused in the captured image due to the shaking of the imaging device. The system includes a second correction control means that performs a second correction to correct image blur related to the subject based on the difference information between the motion vector of the subject output by the first motion detection means and the background vector. An imaging device characterized by the following features.

3. The first correction control means performs the first correction by driving the main body of the imaging device. The imaging apparatus according to claim 1 or 2.

4. The first correction control means is A predetermined device that is detachably attached to the main body of the imaging device is provided, The gimbal mechanism of the aforementioned predetermined device drives the main body. The imaging device according to feature 3.

5. The aforementioned device is a device for taking selfies. The imaging apparatus according to feature 4.

6. The first correction control means is A predetermined device that is detachably attached to the main body of the imaging device is provided, The first correction is performed by driving the first correction means of the predetermined device. The imaging apparatus according to claim 1 or 2.

7. The aforementioned predetermined device is a lens device. The imaging device according to feature 6.

8. The main body of the imaging device has a vibration detection means that outputs a vibration detection signal related to the vibration of the imaging device. The second correction control means performs the second correction based on the motion information of the subject and the shake detection signal. The imaging device according to feature 2.

9. The second correction control means transmits the vibration detection signal to the first correction control means. The first correction control means further performs the first correction based on the vibration detection signal received from the second correction control means. The imaging apparatus according to feature 1 or 8.

10. The subject detection means detects the user who issued the shooting instruction as the subject. The imaging device according to feature 2.

11. The second correction control means transmits information on the amount of oscillation corresponding to the background vector to the first correction control means. The first correction control means further performs the first correction based on the information of the amount of deflection received from the second correction control means. The imaging device according to feature 2.

12. The second correction control means performs the second correction by driving an optical element or an image sensor. The imaging apparatus according to claim 1 or 2.

13. It is equipped with a detection means for detecting that a predetermined device has been installed, The second correction control means is, The second correction is performed when the predetermined device, whose installation has been detected by the detection means, is equipped with a first correction means capable of performing the first correction. The imaging apparatus according to claim 1 or 2.

14. It is equipped with a second motion detection means for detecting the movement of the imaging device, The second correction control means is, If the predetermined device whose installation has been detected by the detection means does not have the first correction means, Perform a third correction that is different from the second correction described above. The imaging apparatus according to feature 13.

15. The third correction, at least, corrects image blur occurring in the captured image based on the motion information of the imaging device output by the second motion detection means. The imaging apparatus according to feature 14.

16. An imaging device having a main body and a predetermined device that can be attached to or detached from the main body, The predetermined device has a first correction control means that performs a first correction to correct image blur caused in the captured image due to the shaking of the imaging device, The main body is, A first motion detection means for detecting the movement of a subject based on the captured image acquired in response to the execution of the first correction control means, A second correction control means performs a second correction to correct image blur related to the subject based on the motion information of the subject output by the first motion detection means, The device includes a vibration detection means that outputs a vibration detection signal related to the vibration of the imaging device, The second correction control means performs the second correction based on the difference information between the motion information of the subject and the shake detection signal. An imaging device characterized by the following features.

17. An imaging device having a main body and a predetermined device that can be attached to or detached from the main body, The predetermined device has a first correction control means that performs a first correction to correct image blur caused in the captured image due to the shaking of the imaging device, The main body is, A subject detection means for detecting a subject from an captured image, A first motion detection means detects the motion vector of the subject detected by the subject detection means and the background vector based on the captured image acquired in response to the execution of the first correction control means, The system includes a second correction control means that performs a second correction to correct image blur related to the subject based on the difference information between the motion vector of the subject output by the first motion detection means and the background vector. An imaging device characterized by the following features.

18. A first motion detection step detects the movement of a subject based on the captured image acquired in response to the execution of a first correction by a first correction control means, which corrects image blur caused in the captured image due to vibration of the imaging device. The system includes a second correction control step which performs a second correction to correct image blur related to the subject based on the difference information between the motion information of the subject output by the first motion detection step and the shake detection signal related to the shake of the imaging device output by the shake detection means of the main body of the imaging device. A control method for an imaging device, characterized by the following:

19. A first motion detection step, based on the captured image acquired in response to the execution of a first correction by a first correction control means for correcting image blur caused in the captured image due to vibration of the imaging device, detects the motion vector of the subject detected by a subject detection means for detecting a subject from the captured image and the background vector, The system includes a second correction control step which performs a second correction to correct image blur related to the subject based on the difference information between the motion vector of the subject output by the first motion detection step and the background vector. A control method for an imaging device, characterized by the following:

20. To cause a computer to perform each of the steps described in claim 18 or 19. A program characterized by the following features.

Images