Control apparatus and imaging apparatus

The control device addresses the challenge of correcting small high-frequency image shake by employing pre-capture and during-capture stabilization operations, enhancing image quality through combined sensor and lens vibration isolation.

JP2026026556APending Publication Date: 2026-02-18CANON KK
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2024128744
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2024-08-05
Publication Date
2026-02-18

AI Technical Summary

Technical Problem

Existing image stabilization methods struggle to effectively correct small high-frequency image shake during image capture, which affects the quality of synthesized images and single images.

Method used

A control device that performs a first stabilization operation before capturing an image to reduce low-frequency shake and a second stabilization operation during image capture to reduce high-frequency shake, using a combination of sensor and lens vibration isolation mechanisms.

Benefits of technology

This approach effectively reduces image blurring during image capture by correcting both low and high-frequency shake, improving the quality of synthesized and single images.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2026026556000001_ABST
    Figure 2026026556000001_ABST
Patent Text Reader

Abstract

To control a vibration-proof operation so as to reduce image blur during imaging.SOLUTION: The control device 5 controls a first anti-shake operation capable of reducing a shake of a first frequency of a subject image to be captured and a second anti-shake operation capable of reducing a shake of a second frequency higher than the first frequency of the subject image. The controller causes the first anti-shake operation to be performed before imaging, and causes the second anti-shake operation to be performed during imaging.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to vibration reduction control in imaging. [Background technology]

[0002] Some imaging devices perform sensor vibration reduction, which reduces (corrects) image blur caused by camera shake such as hand shake, by moving the imaging element. Patent Document 1 discloses an imaging device that performs image synthesis vibration reduction in addition to sensor vibration reduction, which generates a composite image with reduced image blur by aligning and superimposing (combining) multiple images acquired by imaging. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Publication No. 2017-021250 Summary of the Invention [Problem to be solved by the invention]

[0004] In image synthesis image stabilization, the image quality of each of the multiple images to be synthesized is important. Since the imaging (exposure) time when each image is acquired is short and small high-frequency image shake may be included, it is desirable to be able to effectively correct such small high-frequency image shake. Correcting small high-frequency image shake during imaging is effective not only when generating a synthesized image, but also when capturing images to acquire a single image.

[0005] The present invention provides a control device for controlling an image stabilization operation so as to reduce image blur during image capture. [Means for solving the problem]

[0006] A control device according to one aspect of the present invention controls a first stabilization operation capable of reducing shake of a first frequency in an image of a subject to be captured, and a second stabilization operation capable of reducing shake of the subject image up to a second frequency higher than the first frequency. The control device performs the first stabilization operation before capturing an image, and the second stabilization operation during capturing an image.

[0007] A control device according to another aspect of the present invention controls an anti-shake operation capable of reducing shake of an image of a subject being captured. The control device controls the anti-shake operation so that the frequency of shake that can be reduced before and during image capture differs. Note that an image capture device equipped with each of the above control devices also constitutes another aspect of the present invention.

[0008] Yet another aspect of the present invention is a control method for controlling a first stabilization operation capable of reducing shake of a first frequency in an image of a subject being captured, and a second stabilization operation capable of reducing shake up to a second frequency higher than the first frequency in the image of the subject. The control method is characterized by comprising the steps of: performing the first stabilization operation before capturing an image; and performing the second stabilization operation during capturing an image. Note that a program for causing a computer to execute processing in accordance with the above control method also constitutes another aspect of the present invention. [Effects of the Invention]

[0009] According to the present invention, it is possible to reduce image blurring during image capture. [Brief explanation of the drawings]

[0010] [Figure 1] 1A and 1B are a cross-sectional view and a block diagram of an imaging system according to an embodiment. [Figure 2] FIG. 2 is an exploded perspective view of the sensor vibration isolation mechanism according to the embodiment. [Figure 3] 10 is a flowchart showing an image stabilization process performed in the embodiment. [Figure 4] 10 is another flowchart showing the image stabilization process performed in the embodiment. [Figure 5] 3A and 3B are diagrams showing examples of a lens vibration isolation mechanism and a sensor vibration isolation mechanism provided in the imaging system of the embodiment. [Figure 6] 6A and 6B are diagrams showing changes over time in amplitude of a movable part in the vibration isolation process of the embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. [Example]

[0012] Fig. 1(a) shows a cross section of an imaging system comprising an imaging device 1 of the embodiment and a lens device 2 detachably attached thereto, and Fig. 1(b) shows the electrical configuration of the imaging system. In Fig. 1(a) and Fig. 1(b), the same components are denoted by the same reference numerals.

[0013] The lens device 2 has an imaging lens 3 that includes multiple lenses (optical elements) and an aperture. The imaging lens 3 has a focus lens and a variable magnification lens that move in the direction in which an optical axis 4 extends (optical axis direction). The lens device 2 also has a lens vibration isolation mechanism 18 that moves (shifts) a correction lens, which is part of the imaging lens 3, in two directions that are perpendicular to the optical axis 4 and perpendicular to each other. The lens device 2 also has a lens driver 13 that drives the focus lens, aperture, and lens vibration isolation mechanism 18, and a lens controller 12 that controls this.

[0014] The imaging device 1 has a camera control unit 5, an imaging element 6, an image processing unit 7, a memory 8, a rear display 9a, an electronic viewfinder (EVF) 9b, an operation detection unit 10, and electrical contacts 11.

[0015] The imaging element 6 is composed of photoelectric conversion elements such as a CCD sensor or a CMOS sensor, and photoelectrically converts (captures) the subject image formed by the imaging lens 3. The image processing unit 7 generates an image (a live view image or captured image) based on the imaging signal obtained from the imaging element 6. The captured image data is recorded in memory 8. The imaging element 6 and image processing unit 7 can generate still images and videos in various formats (aspect ratios, resolutions, etc.). They can also generate HDR (high dynamic range) images, noise-reduced images, etc. by combining multiple images acquired by capturing multiple images consecutively in time.

[0016] The rear display 9a is composed of a display element such as an LCD and displays a live view image and various imaging information. The EVF 9b is composed of a display element such as an LCD and an eyepiece optical system, and the user can view the live view image and other images displayed on the display element by looking through the eyepiece optical system.

[0017] The operation detection unit 10 detects user operations of various operation members (shutter button, setting dial, etc.) provided on the imaging device 1, and outputs a detection signal to the camera control unit 5. The electrical contacts 11 establish an electrical connection with the lens device 2. This enables power supply from the imaging device 1 to the lens device 2 and communication between the imaging device 1 and the lens device 2.

[0018] The imaging device 1 also has a sensor vibration isolation mechanism 14, a vibration sensor 15, and a shutter mechanism 16. The vibration sensor 15 detects camera shake caused by hand shake or the like. Camera shake includes pan shake and tilt shake in two directions that are perpendicular to the optical axis 4 and perpendicular to each other, and roll shake around an axis parallel to the optical axis 4. The sensor vibration isolation mechanism 14 reduces (corrects) image shake by moving (shifting) the imaging element 6 in two directions that are perpendicular to the optical axis 4 and perpendicular to each other, and by moving (rolling) the imaging element 6 around an axis parallel to the optical axis 4. The shutter mechanism 16 controls the exposure time of the imaging element 6.

[0019] The camera control unit 5 is a computer configured with a CPU and the like, and corresponds to a control device. The camera control unit 5 performs operations in response to operation signals from the operation detection unit 10, controls the sensor vibration isolation mechanism 14 based on camera shake detected by the vibration sensor 15, and controls the shutter mechanism 16. The camera control unit 5 also performs autofocus (AF) and automatic exposure (AE), which sets the aperture value and shutter speed, via the lens control unit 12 based on the focus detection signal and brightness signal obtained from the image sensor 6. The camera control unit 5 also causes the lens control unit 12 to control the operation of the aperture and lens vibration isolation mechanism 18.

[0020] Next, we will explain the imaging process performed by the camera control unit 5. When the user half-presses the shutter button provided on the imaging device 1, the camera control unit 5 detects this through the operation detection unit 10 and performs imaging preparation operations including AF, AE, and opening the shutter mechanism 16. During the imaging preparation operations (i.e., before imaging), the user performs aiming to determine a composition that includes the subject to be captured while viewing a live view image displayed on the rear display 9a or EVF 9b. To facilitate aiming, the camera control unit 5 controls the sensor vibration isolation mechanism 14 based on camera shake detected by the shake sensor 15.

[0021] Thereafter, when the user fully presses the shutter button, camera control unit 5 detects this through operation detection unit 10 and performs an imaging operation in which shutter mechanism 16 is opened and closed at the set shutter time to expose image sensor 6 and generate a captured image (still image). While image sensor 6 is being exposed (i.e., while capturing an image), sensor vibration isolation mechanism 14 is also controlled to suppress blurring of the subject image. After exposure is complete and a predetermined time has elapsed, camera control unit 5 stops controlling the sensor vibration isolation mechanism.

[0022] Figure 2 shows the mechanical configuration of the sensor vibration isolation mechanism 14. The up and down direction in Figure 2 is the optical axis direction. In Figure 2, members that make up the fixed part that does not move are given reference numbers in the 100s, and members that make up the movable part that moves relative to the fixed part are given reference numbers in the 200s.

[0023] Reference numeral 101 denotes the upper yoke, 102a, 102b, and 102c denote screws, 103a, 103b, 103c, 103d, 103e, and 103f denote upper magnets, 104a and 104b denote auxiliary spacers, 105a, 105b, and 105c denote main spacers, 106a, 106b, and 106c denote fixed ball receiving plates, 107a, 107b, 107c, 107d, 107e, and 107f denote lower magnets, 108 denotes the lower yoke, 109a, 109b, and 109c denote screws, and 110 denotes the base plate.

[0024] 201 denotes an FPC (flexible printed circuit board), 202a, 202b, and 202c denote element mounting positions on the FPC 201, 203 denotes a movable PCB (printed circuit board), 204a, 204b, and 204c denote movable ball receivers, 205a, 205b, and 205c denote coils, 206 denotes a movable frame, and 301a, 301b, and 301c denote balls.

[0025] A magnetic circuit (closed circuit) is formed by upper yoke 101, upper magnets 103 to 103f, lower magnets 107a to 107f, and lower yoke 108. Upper magnets 103a to 103f are adhesively fixed in a state of being attracted to upper yoke 101. Similarly, lower magnets 107a to 107f are adhesively fixed in a state of being attracted to lower yoke 108.

[0026] The upper magnets 103a to 103f and the lower magnets 107a to 107f are each magnetized in the optical axis direction, with adjacent magnets (e.g., upper magnets 103a and 103b) magnetized in different directions. Opposing magnets (e.g., upper magnet 103a and lower magnet 107a) are magnetized in the same direction. This magnetization generates a high magnetic flux density in the optical axis direction between the upper yoke 101 and the lower yoke 108, generating a strong attractive force. Therefore, the main spacers 105a to 105c and auxiliary spacers 104a and 104b are configured to maintain an appropriate distance between the upper yoke 101 and the lower yoke 108. The appropriate distance is a distance that ensures a predetermined gap between the upper magnets 103a to 103f and the lower magnets 107a to 107f after the coils 205a to 205c and the FPC 201 are placed between them.

[0027] The main spacers 105a to 105c have screw holes, and the upper yoke 101 is fixed to the main spacers 105a to 105c by screws 102a to 102c inserted into these screw holes. Rubber is also arranged on the body of the main spacers 105a to 105c, forming a mechanical end (stopper) for the moving part.

[0028] Openings are provided in base plate 110 at positions corresponding to lower magnets 107a to 107f, and the coil-side surfaces of lower magnets 107a to 107f protrude from these openings. That is, base plate 110 and lower yoke 108 are fixed with screws 109a to 109c, and lower magnets 107a to 107f, which are thicker than base plate 110, are fixed to base plate 110 so as to protrude from the openings.

[0029] The movable frame 206 is made of magnesium die-cast or aluminum die-cast, and is lightweight and highly rigid. The members that make up the movable part are fixed to the movable frame 206. Position detection elements are attached to the backside (the surface not visible in FIG. 2) of the element attachment positions 202a to 202c on the FPC 201. As the position detection elements, Hall elements or the like that can detect the position of the movable part using the magnetic circuit described above are used. The position detection elements are arranged inside the windings of the coils 205a to 205c.

[0030] The movable PCB 203 is connected to the imaging element 6 shown in FIG. 1(a), coils 205a to 205c, and position detection elements, which communicate electrically with the outside via connectors on the movable PCB 203.

[0031] Fixed ball receiving plates 106a to 106c are adhesively fixed to base plate 110, and movable ball receiving plates 204a to 204c are adhesively fixed to movable frame 206. Balls 301a to 301c are rollably sandwiched between fixed ball receiving plates 106a to 106c and the opposing movable ball receiving plates 204a to 204c. By rolling, balls 301a to 301c are guided in a direction perpendicular to optical axis 4 without tilting the movable portion relative to the fixed portion in the optical axis direction.

[0032] In the above-described configuration, by energizing coils 205a to 205c, an electromagnetic force (thrust) is generated in the magnetic circuit according to Fleming's left-hand rule, which allows the movable part to shift or roll. In this case, the shift position or roll position of the movable part can be feedback-controlled using signals from the position detection elements. Specifically, the movable part can be rolled by energizing coils 205a to 205c so that the signals from the position detection elements at element mounting positions 202b and 202c are in opposite phase while the signal from the position detection element at element mounting position 202a is kept constant.

[0033] The sensor vibration isolation mechanism 14 shown in FIG. 2 uses a magnet and coil as an actuator, and drives the movable part at a low speed to correct low-frequency (e.g., 10 Hz or less) image shake caused by camera shake or the like with a large drive amount (amplitude) of the movable part. In contrast, by using a piezoelectric element or other actuator that can drive the movable part at high speed, it becomes possible to correct even higher-frequency image shake. The amount by which the movable part can be driven when correcting high-frequency image shake is smaller than the amount by which the movable part can be driven when correcting low-frequency image shake. In other words, the amount of high-frequency image shake that can be corrected is smaller than the amount of low-frequency image shake that can be corrected.

[0034] In the following explanation, a first image stabilization operation that can correct (reduce) low-frequency (first frequency) image shake by driving the movable part at a low speed and with a large drive amount is referred to as low-speed image stabilization, and a second image stabilization operation that can correct image shake up to a higher frequency (second frequency) by driving the movable part at a high speed and with a small drive amount is referred to as high-speed image stabilization.In the following explanation, the sensor image stabilization mechanism 14 of the imaging device 1 is assumed to be a low-speed and high-speed image stabilization mechanism that can perform both low-speed and high-speed image stabilization, as shown in Figure 5(A).

[0035] 5(A), the lens device 2 may have a second lens vibration isolation mechanism 18A that performs high-speed vibration isolation in addition to a (first) lens vibration isolation mechanism 18 that performs low-speed vibration isolation. This allows both the imaging device 1 and the lens device 2 to perform low-speed vibration isolation and high-speed vibration isolation.

[0036] In the lens device 2, if the first and second lens vibration isolation mechanisms 18, 18A can drive multiple lenses (first optical elements and second optical elements) to sufficiently correct image shake caused by pan and tilt shake, the sensor vibration isolation mechanism 14 may be configured to correct only roll shake.

[0037] When controlling the lens vibration isolation mechanism of the lens device 2 and the sensor vibration isolation mechanism of the imaging device 1, the camera control unit 5 directly controls the sensor vibration isolation mechanism and also indirectly controls the lens vibration isolation mechanism by sending a control command for the lens vibration isolation mechanism to the lens control unit 12. In this case, although not shown in FIG. 1(b), the lens control unit 12 may control the lens vibration isolation mechanism based on camera shake detected by a lens-side vibration sensor provided in the lens device 2. Furthermore, the lens control unit (control device) 12 may have a function for controlling the vibration isolation mechanism of the camera control unit 5, or an external control device separate from the imaging device 1 and the lens device 2 may have this function. Next, the image stabilization process (control method) executed by the camera control unit 5 according to a program will be described using the flowcharts shown in Figures 3(a) to 3(c). "S" stands for step (process). Figure 6 shows the change in amplitude of the moving part over time during image stabilization in low-speed image stabilization (upper row) and high-speed image stabilization (lower row). The horizontal axis represents time t, and the vertical axis represents amplitude.

[0038] 3(a), the camera control unit 5 determines whether to perform image synthesis processing, which involves aligning and superimposing (i.e., compositing) a plurality of images (e.g., two) acquired by a plurality of consecutive imaging (exposures) to obtain a composite image. Specifically, the camera control unit 5 determines whether or not the execution of image synthesis processing has been selected by the user, for example. If the image synthesis processing is to be performed, the process of S502 is performed, and if the image synthesis processing is not to be performed, the process of S503 is performed.

[0039] In S502, the camera control unit 5 performs image synthesis processing. Details of the image synthesis and image stabilization will be described later using the flowchart in FIG. 3(b). In S503, the camera control unit 5 performs normal processing. Details of the normal processing will be described later with reference to the flowchart in FIG.

[0040] The image synthesis process will now be described. When the user half-presses the shutter button in S504 of Fig. 3(b), the camera control unit 5 starts image capture preparation operations. At the same time, the camera control unit 5 starts low-speed image stabilization (A in Fig. 6). The low-speed image stabilization at this time is performed by one or both of the sensor image stabilization mechanism 14 and the first lens image stabilization mechanism 18.

[0041] Next, in S505, when the user fully presses the shutter button, the camera control unit 5 starts exposure. Then, in S506, high-speed image stabilization is performed (B in FIG. 6). This high-speed image stabilization during exposure is performed by one or both of the sensor image stabilization mechanism 14 and the second lens image stabilization mechanism 18A.

[0042] Next, in S507, the camera control unit 5 determines whether exposure for the set shutter time has ended. If exposure has not ended, the process returns to S506 and high-speed image stabilization continues. When exposure has ended (i.e., after image capture), the process of S508 is performed.

[0043] In S508, the camera control unit 5 centers the movable part of the high-speed vibration isolation mechanism (C in FIG. 6). At this time, the movable part of the low-speed vibration isolation mechanism is driven so as to reduce the displacement of the subject image caused by centering the high-speed vibration isolation mechanism (i.e., in the opposite direction to centering), and then driven so as to obtain the image shake correction effect of the low-speed vibration isolation. This allows the high-speed vibration isolation mechanism to be centered and the subsequent drive capacity of the high-speed vibration isolation mechanism to be secured, while maintaining the image shake correction effect. Note that centering refers to the operation of moving the movable part closer to the reference position when the position of the movable part deviates from the reference position, which is the center position of the driveable range of the movable part. In FIG. 6, the reference position is shown as a position where the amplitude is 0. The driveable range of the movable part may be set for control purposes, and the reference position may be variable depending on, for example, the center of the lens optical axis of the lens device 2. In other words, the control at B and C in FIG. 6 can be rephrased as follows: During imaging, the second optical element (movable part of the high-speed vibration isolation mechanism) is moved from a reference position so as to reduce blurring of the subject image. After imaging, the second optical element is moved closer to the reference position, and the first optical element (movable part of the low-speed vibration isolation mechanism) is moved so as to reduce movement of the subject image caused by moving the second optical element closer to the reference position.

[0044] Next, in S509, the camera control unit 5 determines whether or not the planned capturing of multiple images has been completed. If the capturing of multiple images has not been completed, the process from S504 is repeated (D and E in FIG. 6). In this case, low-speed image stabilization is performed between the previous exposure and the next exposure (i.e., before the next exposure). If the capturing of multiple images has been completed, the process of S510 is performed.

[0045] In S510, the camera control unit 5 performs a process of aligning and synthesizing multiple images. For example, it calculates a correlation value between a first image and a second image as multiple images, or detects feature points using template matching or the like, and then aligns the first image and the second image using the obtained correlation value and feature points and then superimposes them. This generates a composite image in which image shake has been well corrected. Then, the image synthesis process ends.

[0046] Normal processing will be described. Here, an example of normal image stabilization will be described, but other normal image stabilization processes may also be performed.

[0047] 4, the camera control unit 5 determines whether exposure has started. If exposure has not started, the determination of S520 is repeated. If exposure has started, the process of S521 is performed.

[0048] In S521, the camera control unit 5 corrects image shake by using the low-speed vibration isolation mechanism and the high-speed vibration isolation mechanism, that is, by switching between the low-speed vibration isolation and the high-speed vibration isolation according to the camera shake.

[0049] Next, in S522, the camera control unit 5 determines whether or not the exposure has finished, and if not, continues the image blur correction in S521.If the exposure has finished, the normal processing ends.

[0050] While Fig. 5(A) shows a case where the lens device 2 is provided with a low-speed vibration isolation mechanism (18) and a high-speed vibration isolation mechanism (18A), as shown in Fig. 5(B), the lens device 2 may be provided with only a high-speed vibration isolation mechanism (18A). Also, as shown in Fig. 5(C), the imaging device 1 may be provided with only a high-speed vibration isolation mechanism (14A), or the lens device 2 may be provided with a low-speed and high-speed vibration isolation mechanism (18B). In this way, if the imaging system has at least one low-speed vibration isolation mechanism and at least one high-speed vibration isolation mechanism, the vibration isolation processes shown in Figs. 3(a), 3(b), and 4 can be performed.

[0051] An example of how to use both low-speed and high-speed vibration reduction when imaging device 1 is capable of low-speed and high-speed vibration reduction and lens device 2 is also capable of low-speed and high-speed vibration reduction will be described.

[0052] First, during the imaging preparation operation period before exposure, the lens device 2 is made to perform low-speed image stabilization for panning and tilting, and during exposure, the lens device 2 is made to perform high-speed image stabilization for panning and tilting, and the imaging device 1 is made to perform high-speed image stabilization for rolling. This is because the lens image stabilization mechanism cannot correct image blur caused by rolling. Note that the imaging device 1 may also be made to perform low-speed image stabilization for rolling before exposure.

[0053] Between the end of an exposure and the next exposure, the lens device 2 is made to perform centering for high-speed image stabilization, and also to perform low-speed image stabilization. The centering for high-speed image stabilization and low-speed image stabilization at this time are as explained in S508 of Figure 3(b). Furthermore, between the end of an exposure and the next exposure, the imaging device 1 may be made to perform low-speed image stabilization for roll shake.

[0054] If the lens device 2 is capable of low-speed and high-speed vibration isolation and the imaging device 1 is only capable of low-speed vibration isolation, high-speed vibration isolation for roll shake during exposure is not performed. If the lens device 2 is capable of low-speed and high-speed vibration isolation and the imaging device 1 does not have an vibration isolation mechanism, vibration isolation for roll shake is not performed. If the imaging device 1 is capable of low-speed and high-speed vibration isolation and the lens device does not have an vibration isolation mechanism, low-speed and high-speed vibration isolation for pan shake, tilt shake, and roll shake is performed in the imaging device 1.

[0055] The reason for performing high-speed image stabilization during exposure in this embodiment will be explained. Image blur during exposure cannot be corrected by image synthesis image stabilization. As a result, image blur during exposure remains as an afterimage in the final composite image. Furthermore, since high-frequency vibrations that cause image blur are often included during exposure compared to before exposure, it is necessary to correct image blur caused by high-frequency vibrations using high-speed image stabilization. High-frequency vibrations can be caused by movement of components of the imaging device 1, such as the opening and closing of the shutter blades in the shutter mechanism 16, or by the user's hand shake.

[0056] For this reason, in this embodiment, high-speed image stabilization is performed during exposure for each image to be synthesized, thereby synthesizing multiple images in which image shake has been corrected, and as a result, a synthesized image with little image shake can be obtained.

[0057] In this embodiment, the reason for performing centering of high-speed image stabilization upon completion of exposure will be explained. In a high-speed image stabilization mechanism, the drivable amount of the movable part (maximum drive amount determined by the mechanical end or control end) is set smaller than in a low-speed image stabilization mechanism. For this reason, if high-speed image stabilization is performed in the next exposure while maintaining a state in which the movable part of the high-speed image stabilization mechanism has moved in the pan or tilt direction from its drive center, the drivable amount of the movable part may be insufficient, making it impossible to perform good high-speed image stabilization. To prevent this, centering of high-speed image stabilization is performed upon completion of exposure.

[0058] In this embodiment, the reason why low-speed image stabilization is performed in the opposite direction to centering of high-speed image stabilization will be explained. Simply performing centering of high-speed image stabilization can result in a large deviation between the image obtained by the first exposure and the image obtained by the next exposure. For this reason, by performing low-speed image stabilization in the opposite direction to centering of high-speed image stabilization, it is possible to reduce the deviation between these images. This makes it possible to reduce the area that is removed from each image to be aligned and combined as an area unnecessary for combination.

[0059] Furthermore, by performing low-speed image stabilization until the next exposure, it is possible to reduce the image misalignment described above, which also reduces the area to be removed from each image to be aligned and combined.

[0060] The image synthesis image stabilization described in the above embodiment may be used when generating one frame image by synthesizing multiple subframe images in video capture, or when generating a composite image equivalent to a still image acquired by long-second exposure by aligning and synthesizing multiple still images. Also, low-speed image stabilization before exposure and high-speed image stabilization during exposure may be performed in normal capture, where one image is generated in one capture.

[0061] Furthermore, in the above embodiment, an imaging system is described that is configured from an interchangeable lens imaging device and a lens device, but low-speed image stabilization and high-speed image stabilization may also be performed by driving the lens of the optical system or the image sensor in a lens-integrated imaging device.

[0062] The above embodiment includes the following configurations.

[0063] (Configuration 1) A control device for controlling a first image stabilization operation capable of reducing a shake of a first frequency of an image of a subject to be captured and a second image stabilization operation capable of reducing a shake of the subject up to a second frequency higher than the first frequency, performing the first image stabilization operation before imaging; A control device that causes the second vibration isolation operation to be performed during image capture. (Configuration 2) 2. The control device according to configuration 1, wherein after imaging, centering of the second image stabilization operation is performed, and the first image stabilization operation is performed so as to reduce displacement of the subject image due to the centering. (Configuration 3) 3. The control device according to configuration 1 or 2, wherein in the first and second vibration isolation operations, at least one of an optical element included in an optical system that forms the subject image and an imaging element that captures the subject image is driven. (Configuration 4) The control device according to configuration 3, wherein in the first and second image stabilization operations, the optical element is driven so as to reduce the shake in a direction perpendicular to the optical axis of the optical system, and the image sensor is driven so as to reduce the shake around an axis parallel to the optical axis. (Configuration 5) the first image stabilization operation driving a first optical element included in an optical system that forms the subject image; a second image stabilization operation for driving the first optical element or a second optical element included in the optical system; the first vibration isolation operation for driving the imaging element; 4. The control device according to configuration 3, wherein the control device controls the second vibration isolation operation for driving the imaging element. (Configuration 6) 6. The control device according to any one of configurations 1 to 5, wherein, in a case where a composite image is generated by aligning and combining multiple images acquired by multiple imaging, the control device performs the first image stabilization operation before each of the multiple imaging operations, and the control device performs the second image stabilization operation during each of the multiple imaging operations. (Configuration 7) The control device according to configuration 5, characterized in that after each of the plurality of images is taken, centering of the second image stabilization operation is performed, and the first image stabilization operation is performed so as to reduce displacement of the subject image due to the centering, and the first image stabilization operation is further performed until the next image is taken. (Configuration 8) A control device according to any one of configurations 1 to 7; an imaging element for capturing the subject image. (Configuration 9) 9. The imaging device according to configuration 8, wherein the first image stabilization operation for driving the imaging element and the second image stabilization operation for driving the imaging element are performed. (Configuration 10) A lens device that is detachably attached to the imaging device according to configuration 9 and has an optical system that forms the subject image, A lens device characterized by performing a first vibration isolation operation that drives a first optical element included in the optical system, and a second vibration isolation operation that drives the first optical element or a second optical element included in the optical system. (Configuration 11) A control device that controls a first vibration isolation means that can reduce shake of a captured subject image by moving a first optical element, and a second vibration isolation means that can reduce shake of the subject image by moving a second optical element and that can reduce a frequency of shake that is higher than that of the first vibration isolation means, A control device characterized in that the first vibration isolation means and the second vibration isolation means move the second optical element from a reference position so as to reduce blurring of the subject image during image capture, and after image capture, the second optical element is moved closer to the reference position, and the first optical element is moved so as to reduce displacement of the subject image caused by moving the second optical element closer to the reference position (Other Examples). The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program.The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0064] The embodiments described above are merely representative examples, and various modifications and alterations are possible to each embodiment when implementing the present invention. [Explanation of symbols]

[0065] 1. Imaging device 2 Lens device 5 Camera control unit 6. Image sensor 14 Sensor vibration isolation mechanism 15 Vibration sensor 18 Lens vibration isolation mechanism

Claims

1. a control device for controlling a first image stabilization operation capable of reducing a shake of a first frequency of an image of a subject to be captured and a second image stabilization operation capable of reducing a shake of the subject up to a second frequency higher than the first frequency, performing the first image stabilization operation before imaging; A control device that causes the second vibration isolation operation to be performed during image capture.

2. 2. The control device according to claim 1, wherein after image capture, centering of the second image stabilization operation is performed, and the first image stabilization operation is performed so as to reduce displacement of the subject image due to the centering.

3. 2. The control device according to claim 1, wherein in the first and second vibration reduction operations, at least one of an optical element included in an optical system that forms the subject image and an imaging element that captures the subject image is driven.

4. 4. The control device according to claim 3, wherein in the first and second vibration isolation operations, the optical element is driven so as to reduce the shake in a direction perpendicular to the optical axis of the optical system, and the imaging element is driven so as to reduce the shake around an axis parallel to the optical axis.

5. the first image stabilization operation driving a first optical element included in an optical system that forms the subject image; a second image stabilization operation for driving the first optical element or a second optical element included in the optical system; the first image stabilization operation for driving the image sensor; 4. The control device according to claim 3, wherein the control device controls the second vibration isolation operation for driving the image sensor.

6. 2. The control device according to claim 1, wherein, in a case where a composite image is generated by aligning and combining multiple images acquired by multiple imaging, the first image stabilization operation is performed before each of the multiple imaging operations, and the second image stabilization operation is performed during each of the multiple imaging operations.

7. 6. The control device according to claim 5, wherein after each of the plurality of images is taken, centering of the second image stabilization operation is performed, and the first image stabilization operation is performed so as to reduce displacement of the subject image due to the centering, and the first image stabilization operation is further performed until the next image is taken.

8. A control device according to any one of claims 1 to 7; an imaging element for capturing the subject image.

9. 9. The imaging apparatus according to claim 8, wherein the first vibration isolation operation for driving the imaging element and the second vibration isolation operation for driving the imaging element are performed.

10. A lens device that is detachably attached to the imaging device according to claim 9 and has an optical system that forms the subject image, A lens device characterized by performing a first vibration-reduction operation that drives a first optical element included in the optical system, and a second vibration-reduction operation that drives the first optical element or a second optical element included in the optical system.

11. A control device for controlling a first vibration isolation means capable of reducing a shake of an image of a subject to be captured by moving a first optical element, and a second vibration isolation means capable of reducing a shake of the subject image by moving a second optical element, the second vibration isolation means having a higher vibration reduction frequency than the first vibration isolation means, a control device that uses the first vibration-proof means and the second vibration-proof means to move the second optical element from a reference position so as to reduce blurring of the subject image during image capture, and that moves the second optical element closer to the reference position after image capture, and moves the first optical element so as to reduce displacement of the subject image caused by moving the second optical element closer to the reference position.

12. A control method for controlling a first image stabilization operation capable of reducing a shake of a first frequency in an image of a subject to be captured and a second image stabilization operation capable of reducing a shake of the subject up to a second frequency higher than the first frequency, the method comprising: performing the first image stabilization operation before imaging; and performing the second vibration isolation operation during image capture.

13. A program causing a computer to execute a process according to the control method of claim 12.

Citation Information

Patent Citations

  • Imaging device and image processing method

    JP2017021250A