Imaging apparatus and method for controlling the same

Abstract

To provide an imaging apparatus that can prevent exposure unevenness, while performing front curtain switching control against an impact during an operation of mechanical shutter means.SOLUTION: A camera main body 1 comprises a camera shake correction unit 7 that can drive an image pick-up device 5 in a plane perpendicular to an optical axis 4 of an imaging optical system 3. An SH control unit 8 performs control to switch between a mechanical front curtain driving mode using a mechanical front curtain and a mechanical rear curtain of a focal plane shutter device 6, and an electronic front curtain driving mode using an electronic front curtain and the mechanical rear curtain utilizing a storage start reset operation of the image pick-up device 5. In a photographing condition in which a photographed image may be deteriorated due to an impact during an operation of the mechanical front curtain, a control unit 9 causes the SH control unit 8 to select the electronic front curtain driving mode, causes the camera shake correction unit 7 to restrict a rolling operation of the image pick-up device 5 rotating around the optical axis, and controls an image processing unit 10 to perform image correction of a rolling component of a shake applied to an imaging apparatus.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to an imaging device, and more particularly to an imaging device capable of driving an image sensor within a plane perpendicular to the optical axis of an imaging optical system. [Background technology]

[0002] Image stabilization is a technology for suppressing the influence of vibrations on a captured image caused by an image capture device such as an interchangeable lens digital camera. For example, image stabilization means include a method of driving a correction lens or an image sensor in a plane perpendicular to the optical axis. There is also a horizontal correction technology that uses an image stabilization means to maintain the horizontal state of a captured image.

[0003] On the other hand, interchangeable lens digital cameras generally have a focal plane shutter as a mechanical shutter means for adjusting the exposure time. In a focal plane shutter, the front and rear curtains run near the subject side of the image sensor, and the exposure time is determined by adjusting the time interval between the front and rear curtain runs. Since the image blur correction means includes a drive mechanism for the optical element and the image sensor, there is a possibility that image blur will occur due to vibrations that occur when the mechanical shutter means is driven.

[0004] Furthermore, a technology called electronic shutter utilizes the accumulation reset function of the imaging element. Alternatively, there is a shutter means that combines an electronic shutter with a mechanical shutter mechanism. Patent Document 1 discloses a technology for preventing erroneous shake correction operation caused by front curtain shock in an imaging device with a shake correction function. In a shake correction execution mode, an electronic shutter is used as the front curtain, and when the shake correction execution mode is not in effect, a mechanical focal plane shutter is used as the front curtain.

[0005] Patent Document 2 discloses a method for dealing with exposure unevenness (also called exposure unevenness) in an imaging device in which the front curtain is an electronic shutter (electronic front curtain) and the rear curtain is a focal plane shutter (mechanical rear curtain). The cause of exposure unevenness is that an angle difference occurs between the electronic front curtain and the mechanical rear curtain due to the rotation of the imaging element when the imaging element is rotated by the image blur correction means, and exposure unevenness occurs because a difference occurs in the width of the slit exposure between the left and right sides of the screen. In Patent Document 2, control is performed to return the tilt of the imaging element to a predetermined tilt or less just before exposure. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] JP 2007-193155 A [Patent Document 2] JP 2021-113859 A Summary of the Invention [Problem to be solved by the invention]

[0007] In conventional technology, when an electronic front curtain is used to avoid the impact caused by driving a mechanical shutter means, it is difficult to appropriately control switching between the mechanical front curtain and the electronic front curtain while suppressing the occurrence of exposure unevenness. An object of the present invention is to provide an imaging apparatus capable of suppressing exposure unevenness while controlling front curtain switching in response to shocks caused by the operation of a mechanical shutter means. [Means for solving the problem]

[0008] The apparatus according to an embodiment of the present invention is an imaging apparatus capable of correcting an image acquired by an imaging element through an imaging optical system, comprising: a driving means for driving the imaging element in a plane perpendicular to an optical axis of the imaging optical system; an image processing means for processing an image acquired by the imaging element; a first control means for controlling switching between a first driving mode using a front curtain and a rear curtain of a mechanical shutter means arranged between the imaging optical system and the imaging element and a second driving mode using an electronic front curtain and a rear curtain of the shutter means utilizing an accumulation start reset operation of the imaging element; and a second control means for controlling the driving means or correcting the image using the image processing means. In the case of a predetermined shooting condition, the first control means selects the second driving mode, and the second control means controls to limit the driving of the imaging element by the driving means, or to correct the image by the alignment and composition process performed by the image processing means on a plurality of images acquired continuously from the imaging element. Effect of the Invention

[0009] According to the present invention, it is possible to provide an imaging apparatus capable of suppressing exposure unevenness while controlling front curtain switching in response to shocks caused by the operation of a mechanical shutter means. [Brief description of the drawings]

[0010] [Figure 1] 1A and 1B are a schematic cross-sectional view and a schematic block diagram of an imaging apparatus according to an embodiment; [Diagram 2] 11A and 11B are conceptual diagrams for explaining exposure unevenness that may occur in the electronic front curtain drive mode. [Diagram 3] 1 is a conceptual diagram for explaining an electronic roll operation in an imaging device. [Figure 4] 11 is a flowchart illustrating a process executed by the imaging device. [Diagram 5] 10 is a flowchart illustrating a notification process in the imaging device. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Hereinafter, an embodiment of the present invention will be described in detail with reference to the drawings. In the embodiment, an image pickup apparatus capable of suppressing exposure unevenness while performing appropriate front curtain switching control in response to shocks caused by mechanical shutter operation will be described. An example of a lens-interchangeable single-lens reflex camera will be shown, but the present invention can be applied to various image pickup apparatuses.

[0012] 1A and 1B are a schematic cross-sectional view and a schematic block diagram of an imaging device 1000. Fig. 1A is a diagram showing a schematic cross-sectional configuration of the imaging device 1000. Fig. 1B is a block diagram showing a characteristic configuration of the imaging device 1000.

[0013] The imaging device 1000 comprises a camera body 1, which is the main body of the device, and an interchangeable lens 2 that can be attached to the camera body 1. A user can attach the interchangeable lens 2 to the camera body 1 via a camera mount and take pictures. The interchangeable lens 2 has an imaging optical system 3, whose optical axis 4 is indicated by a dashed dotted line. Light from a subject passes through the lenses and aperture that make up the imaging optical system 3, and forms an image at a predetermined position within the camera body 1.

[0014] A focal plane shutter device 6 and an image sensor 5 are disposed in the camera body 1. When light from a subject is focused on the image sensor 5, the image sensor 5 performs photoelectric conversion and outputs an image signal to an image processing unit 10. The image processing unit 10 executes various processes such as development, and outputs the processed data to a storage unit 11. The storage unit 11 stores data such as image files.

[0015] The camera body 1 has an image blur correction unit 7. The image blur correction unit 7 performs image blur correction so that a captured image is not deteriorated due to vibrations such as camera shake applied to the imaging device 1000. The image blur correction is performed according to a control command from the control unit 9 to the image blur correction unit 7. For example, the control unit 9 includes a CPU (Central Processing Unit) and controls the image blur correction by executing a predetermined program. In this case, a first image blur correction control means for controlling the image blur correction unit 7 is constructed within the control unit 9 by software processing.

[0016] In the first image stabilization, the image stabilization unit 7 translates the image sensor 5 in a plane perpendicular to the optical axis 4, thereby performing drive control to cancel vibrations such as camera shake. The image stabilization unit 7 can not only translate the image sensor 5, but also rotate (roll) it about the optical axis 4. By using the roll motion by the image stabilization unit 7, image correction can be performed for roll components such as camera shake applied to the imaging device 1000. The roll component is a rotation angle component with the optical axis 4 as the central axis. By using the roll motion by the image stabilization unit 7, it is possible to correct the inclination of the image sensor 5 so that the composition at the time of shooting is horizontal when the photographer holds the imaging device 1000.

[0017] In this specification, the roll operation is distinguished between a first roll operation and a second roll operation. The first roll operation is an operation for maintaining the horizontality of the composition at the time of shooting when the photographer holds the imaging device 1000, and is hereinafter referred to as a horizontal correction operation. The camera body 1 has a spirit level 13, and the control unit 9 acquires the output of the spirit level 13 (denoted as θ). The spirit level 13 detects the tilt based on the horizontal attitude state of the imaging device 1000 and outputs a detection signal to the control unit 9. For example, an acceleration sensor or a geomagnetic sensor can be used to detect the tilt. In the horizontal correction operation, the control unit 9 performs control to maintain the attitude of the imaging element 5 equivalent to the horizontal attitude state where the output θ of the spirit level 13 is zero. The second roll operation is an operation for suppressing the influence of roll components such as camera shake, and is hereinafter referred to as a roll shake correction operation. The image processing unit 10 acquires image data divided and accumulated in the time axis direction by the imaging element 5, and detects the change in the roll state between images that are consecutive in time series based on the amount of movement of the feature points of the subject, and performs alignment and synthesis processing. The operation based on this processing is called an electronic roll operation. The imaging element 5 and image processor 10 that realize the electronic roll operation perform a second image blur correction that is different from the image blur correction using the image blur correction unit 7. The electronic roll operation will be described in detail later.

[0018] The camera body 1 has a notification unit 12. The notification unit 12 notifies the user before or after the event that should be notified, related to the roll operation, in accordance with a control command from the control unit 9. Specifically, the notification unit 12 notifies the user using a display means constituted by a viewfinder device or a liquid crystal display device, or a speaker device, and can present the user with necessary information.

[0019] Next, the control of the shutter operation will be described. In still image shooting, the mechanical front curtain and the mechanical rear curtain of the focal plane shutter device 6 run on the subject side of the image sensor 5 with a predetermined time difference, so that the exposure start time and the exposure end time can be specified. Hereinafter, the mode in which the exposure operation is performed using the mechanical front curtain and the mechanical rear curtain, which are mechanical shutter means, is called the mechanical front curtain drive mode. On the other hand, the image sensor 5 can sequentially start photoelectric conversion in a plurality of pixel units arranged in a two-dimensional array in the row direction (the up and down direction when the photographer normally holds the camera) (accumulation start reset operation). Instead of the mechanical front curtain, it is possible to specify the exposure start time by performing the accumulation start reset operation at high speed. Such a function is called the electronic front curtain. Hereinafter, the mode in which the exposure operation is performed using the electronic front curtain and the mechanical rear curtain of the focal plane shutter device 6 is called the electronic front curtain drive mode. In this embodiment, the focal plane shutter device 6 is fixed to the camera body 1 so that the running directions of the mechanical front curtain and mechanical rear curtain of the focal plane shutter device 6 are constant relative to the camera body 1.

[0020] The camera body 1 has an SH control unit 8 which is a front curtain switching control means. The SH control unit 8 performs switching control between the mechanical front curtain drive mode and the electronic front curtain drive mode according to a control command from the control unit 9. The SH control unit 8 judges whether or not a predetermined condition exists under which degradation in image quality of a captured image may occur. The predetermined condition is, for example, a shooting condition under which degradation in image quality such as image blur may occur in a captured image due to an impact caused by the operation of the mechanical front curtain in the imaging device 1000. The SH control unit 8 performs switching control to the mechanical front curtain drive mode or the electronic front curtain drive mode according to the judgment result.

[0021] The SH control unit 8 can determine whether or not the shooting conditions are such that deterioration in image quality of the captured image may occur due to the exposure time set by the setting operation by the photographer or the automatic exposure function of the imaging device 1000. For example, it is known that image quality deterioration occurs when the shock caused by the operation of the mechanical front curtain causes vibrations in the imaging element 5, etc., at intermediate seconds among the settable exposure times. When such an exposure time is set, the SH control unit 8 performs control for switching to the electronic front curtain drive mode.

[0022] The SH control unit 8 can also determine whether the imaging device 1000 is attached to a support device. The support device is a tripod, a monopod, or the like, and the SH control unit 8 can determine whether the imaging conditions are such that degradation of the image quality of the captured image may occur based on the result of the determination of the tripod, the monopod, or the like. In a fixed state in which the imaging device 1000 is attached to a support device, there is a possibility that the impact of the mechanical front curtain during operation will reach the imaging element 5. Therefore, the SH control unit 8 obtains the output of a shake detection means (not shown) to determine whether the imaging device 1000 is in a fixed state. The shake detection means is provided in the camera body 1 or the interchangeable lens 2, and is specifically an angular velocity sensor, an acceleration sensor, or the like. When the imaging device 1000 is attached to a tripod, a monopod, or the like (in the case of a predetermined imaging condition), the SH control unit 8 determines that the imaging device 1000 is in a fixed state and performs control to switch to the electronic front curtain drive mode.

[0023] In addition, the SH control unit 8 can determine whether the shooting conditions are such that degradation of the image quality of the captured image may occur based on the setting state of the continuous shooting mode or single shooting mode set according to the photographer's operational instructions. Specifically, when the continuous shooting mode is set, image quality may deteriorate due to the impact caused by the operation of the mechanical front curtain, so the SH control unit 8 controls switching to the electronic front curtain drive mode.

[0024] The method of determining whether the photographing conditions may cause deterioration of the image quality of the photographed image may be one of the above methods or a combination of two or more of them. In addition, a judgment criterion related to a specific photographing condition may be added as necessary.

[0025] FIG. 2 is a conceptual diagram showing the movement of the front and rear curtains in the mechanical front-curtain drive mode and the electronic front-curtain drive mode. FIG. 2(A) shows the movement of the curtains in the mechanical front-curtain drive mode. The mechanical front curtain 61 and the mechanical rear curtain 62 of the focal plane shutter device 6 move relative to the image sensor 5. FIG. 2(B) shows the movement of the curtains in the electronic front-curtain drive mode. The mechanical rear curtain 62 of the focal plane shutter device 6 moves relative to the image sensor 5. In FIG. 2(A) and FIG. 2(B), the image sensor 5 rotates around the optical axis 4 at an angle θ R The tilt is achieved by rotating only one angle.

[0026] In Figure 2(A), mechanical front curtain 61 travels in the direction of arrow A, and mechanical rear curtain 62 travels in the direction of arrow B. The gap between mechanical front curtain 61 and mechanical rear curtain 62 is denoted as dL and dR. dL represents the gap on the left end side, and dR represents the gap on the right end side. Mechanical front curtain 61 and mechanical rear curtain 62 travel such that "dL = dR", and therefore in this state no uneven exposure occurs in the left-right direction of the screen.

[0027] 2B, the electronic front curtain sequentially resets the image sensor 5 to start accumulation in the vertical direction. This is shown by the solid black area below the image sensor 5. In other words, this is equivalent to the front curtain virtually being present in the black area. The vertical direction of the image sensor 5 is the direction of arrow A, which is different from the direction of arrow B, which is the travel direction of the mechanical rear curtain 62. The reason for this is that the image sensor 5 rotates around the optical axis 4 at an angle θ R In this case, the tilt angle is θ R As a result, the gap between the electronic front curtain and the mechanical rear curtain 62 differs in the left-right direction. The gap between the electronic front curtain and the mechanical rear curtain 62 is denoted as dL and dR. dL represents the gap on the left edge side, and dR represents the gap on the right edge side. In this example, "dL>dR". If an image is taken in this state, uneven exposure will occur in the left-right direction of the screen. Angle θ RThe larger the value of θ, the more likely it is that uneven exposure will occur in the left and right direction of the screen. Also, the shorter the exposure time, the greater the impact of uneven exposure on the image. Therefore, in the case of electronic front curtain drive mode, θ R It is required to limit the value of and suppress uneven exposure. The angle (correction angle) required for correction in roll shake correction operation is relatively small compared to the horizontal correction operation. Therefore, when only the roll shake correction operation is enabled in the imaging device 1000, the control unit 9 imposes a smaller limiting amount than when the horizontal correction operation is enabled. However, when the horizontal correction operation is enabled and there is concern about the effect of the impact of the mechanical front curtain on image quality degradation, it is necessary to suppress the limiting amount to a smaller amount than the limiting amount normally imposed in the horizontal correction operation. In this case, there is a problem in that the horizontal correction operation may not be performed sufficiently.

[0028] The electronic roll operation performed by the imaging device 1000 will be described with reference to Fig. 3. Fig. 3(A) is a schematic diagram showing, in time series, how the imaging element 5 captures images during the electronic roll operation. Fig. 3(B) is a schematic diagram for explaining how correction processing is performed on an image acquired during the imaging in Fig. 3(A). Fig. 3 shows an example in which still image shooting involving electronic roll operation is performed in a situation in which a horizontal correction operation is not performed.

[0029] The horizontal axis t in FIG. 3(A) is the time axis, and the direction of time passage is from left to right. T represents the total exposure time, and T d represents the divided exposure time. The image sensor 5 performs divided exposures T d The numbers 1 to 6 in the rectangular boxes represent the chronological order in which the images are taken.

[0030] The upper part of Fig. 3(B) shows only images 1 to 3 acquired from the first to third imaging among the six images acquired during the electronic roll operation. As the imaging device 1000 has tilted from the horizontal state, the subject image in images 2 and 3 is tilted. The image processing unit 10 removes the tilt of the subject image caused by the tilt of the imaging device 1000 to acquire the area enclosed by the dashed line. The area enclosed by the dashed line is an extracted area cut out at a predetermined angle of view where many of the feature points in all images match based on the amount of movement of the feature points between the continuously captured images, making alignment and synthesis possible.

[0031] The middle part of FIG. 3(B) shows the areas within the dashed frame corresponding to image 1 to image 3, respectively. The image processing unit 10 performs the cropping process for images 1 to 6 and then performs the image synthesis process. The lower part of FIG. 3(B) shows an image generated by the synthesis process of the cropped images. The image synthesis process acquires a synthetic image with a total exposure time T. In the image synthesis, the image processing unit 10 performs averaging process, simple addition process, etc., but a known synthesis method can be used. In this embodiment, the horizontal correction operation can be electronically realized by electronic roll operation without using the roll operation of the image shake correction unit 7.

[0032] 4 and 5, a photographing sequence and a notification operation for countermeasures against shocks caused by the operation of the mechanical front curtain and for countermeasures against uneven exposure will be described.

[0033] FIG. 4 is a flowchart for explaining the process executed by the imaging device 1000. The following process is started when the photographer sets a predetermined mode in the imaging device 1000, half-presses the shutter release button, and starts preparation for shooting. The predetermined mode is, for example, the "automatic mode" selected from three shutter modes, "mechanical front-curtain drive mode," "electronic front-curtain drive mode," and "automatic mode." When the "automatic mode" is set, the SH control unit 8 determines the mechanical front-curtain drive mode or the electronic front-curtain drive mode. When the shutter release button of the imaging device 1000 is half-pressed, the first switch (SW1) is detected as being on. When the user further presses the shutter release button all the way down, the second switch (SW2) is detected as being on.

[0034] In S001 of FIG. 4, the SH control unit 8 judges whether or not the shooting conditions are such that image quality degradation may occur. It judges whether or not the shooting conditions are such that an impact caused by the operation of the mechanical front curtain 61 may affect the image. As described above, the condition judgment process is performed according to the exposure time setting, the use of a tripod or monopod, and the single shooting mode or the continuous shooting mode. If it is judged that the condition of S001 (predetermined condition) is satisfied, the process proceeds to S002. Also, if it is judged that the condition of S001 is not satisfied, the SH control unit 8 sets the mechanical front curtain drive mode. In this case, a shutter mode using a mechanical front curtain and a mechanical rear curtain is selected. The mechanical front curtain drive mode is well known, so a detailed description thereof will be omitted.

[0035] In S002, the control unit 9 determines whether the setting of the horizontal correction operation, which is the first roll operation, is enabled (ON) or not. If it is determined that the setting of the horizontal correction operation is enabled, the process proceeds to S003, and if it is determined that the setting of the horizontal correction operation is disabled (OFF), the process proceeds to S006.

[0036] In S003, since the horizontal correction operation requiring a large roll correction angle is in an effective state, the control unit 9 sets the angle range for driving the image blur correction unit 7 in the roll correction to a predetermined range. The predetermined range is a range in which no uneven exposure occurs in the left-right direction on the screen, and a first predetermined limit amount (hereinafter, referred to as limit amount 1) is set. Since the horizontal correction operation cannot fully function in a situation in which limit amount 1 is exceeded, the following notification and electronic roll operation are implemented.

[0037] After S003, the process proceeds to S004. In S004, the notification unit 12 executes a first notification process (hereinafter, referred to as notification 1). In notification 1, the notification unit 12 notifies the user that the imaging device 1000 is not in a horizontal state as necessary. Details of notification 1 will be described later with reference to FIG. 5(A). After S004, the process proceeds to S005.

[0038] In S005, the control unit 9 judges whether or not the ON state of SW2 is detected by the full depression of the shutter release button. If the ON state of SW2 is detected, the process proceeds to S010, and if the OFF state of SW2 is detected, the process proceeds to S004.

[0039] When proceeding from S002 to S006 (No in S002), the control unit 9 determines in S006 whether or not the setting for the roll shake compensation operation, which is the second roll operation, is enabled (ON). If it is determined that the setting for the roll shake compensation operation is enabled, the process proceeds to S007. If it is determined that the setting for the roll shake compensation operation is disabled (OFF), the image sensor 5 does not perform a roll operation around the optical axis 4, and no uneven exposure occurs on the left and right of the screen. Because the settings for the horizontal compensation operation and the roll shake compensation operation are disabled (OFF), there is no need to set the angle range of the image blur compensation unit 7, and the process proceeds to S009.

[0040] In S007, since the setting of the roll shake compensation operation, which is effective at a smaller compensation angle than the horizontal compensation operation, is valid, the control unit 9 sets a second limit amount (hereinafter, referred to as limit amount 2) smaller than limit amount 1. Next, the process proceeds to S008, where the control unit 9 judges whether SW2 is on or off, similar to S005. If it is detected that SW2 is on, the process proceeds to S010, and if it is detected that SW2 is off, the process waits temporarily and the judgment process of S008 is repeated. On the other hand, if it is determined in S006 that the setting of the roll shake compensation operation is invalid (OFF), the process proceeds to S009. In S009, the control unit 9 judges whether SW2 is on or off, similar to S005 and S008. If it is detected that SW2 is on, the process proceeds to S011, and if it is detected that SW2 is off, the process waits temporarily and the judgment process of S009 is repeated.

[0041] In S010, the control unit 9 performs roll limitation. For the image blur correction unit 7 that has rotated the image sensor 5 in the roll direction in the horizontal correction operation or roll blur correction operation, the control unit 9 controls the drive of the image blur correction unit 7 so as not to exceed limit amount 1 set in S003 or limit amount 2 set in S007. Next, in S011, the exposure operation of the image sensor 5 is started. Here, the electronic front curtain drive mode is selected, and exposure is started by the electronic front curtain. Next, the process proceeds to S012.

[0042] In S012, electronic roll operation is performed on the roll components that exceed the limit amount 1 or the limit amount 2. In the exposure in the electronic roll operation, as described in FIG. d Image capture is performed with the total exposure time T divided by the above. When the divided exposures are completed, one composite image is generated, as shown in the lower part of Fig. 3(B). Note that the electronic roll operation is also performed if the result of S006 is No and the ON state of SW2 is detected in S009.

[0043] Next, in S013, the notification unit 12 executes a second notification process (hereinafter, referred to as notification 2). In notification 2, if the image generated by the exposure operation in S011 and the electronic roll operation in S012 is not horizontal, a notification is given to the photographer and metadata is generated. Details of notification 2 will be described later with reference to FIG. 5(B).

[0044] Next, in S014, an image recording process is performed. The data of the composite image acquired in S012 is stored in the storage unit 11. If metadata is generated in S013, the metadata is embedded in the image and stored together with the image data in the storage unit 11. Then, the series of processes ends.

[0045] Fig. 5 is a flowchart for explaining the processes of notification 1 and notification 2 in Fig. 4. Fig. 5(A) is a flowchart for notification 1, and Fig. 5(B) is a flowchart for notification 2.

[0046] Assume that the setting of the horizontal correction operation is enabled (ON) in S002 in Fig. 4, and the limit amount 1 is set in S003. If the attitude of the image capture device 1000 before shooting is significantly tilted, there is a possibility that the horizontal correction operation cannot be performed sufficiently. Therefore, notification 1 shown in Fig. 5(A) is executed. In S101, the control unit 9 adjusts the output θ of the spirit level 13 to a threshold value (θ th θ th corresponds to the output of the level 13 in a situation where the uneven exposure on the left and right sides of the screen is sufficiently suppressed, as defined by the limit amount 1. th If it is determined that the output θ of the level 13 is greater than θ th If it is determined that the number is equal to or less than the predetermined number, the determination process of S101 is repeated.

[0047] In S102, the notification unit 12 issues a notification that the image capture device 1000 is significantly deviated from the horizontal posture. This notification is displayed on a liquid crystal display device or an electronic viewfinder provided on the rear surface of the camera body 1, or is output as sound using a speaker. After S102, the process of notification 1 ends.

[0048] The process of notification 1 is repeatedly executed until it is determined that SW2 is on in Fig. 4. Therefore, it is possible to urge the photographer to keep the imaging device 1000 held by the photographer as close to a horizontal attitude as possible before exposure.

[0049] Next, the processing of notification 2 will be described with reference to Fig. 5(B). If the exposure operation is started in S011 of Fig. 4, and the electronic roll operation is performed in S012, but the correction amount is still insufficient, the captured image may be significantly deviated from the horizontal state. Therefore, in the processing of notification 2, in S201, the control unit 9 determines whether or not the correction amount of the horizontal correction operation was insufficient during the exposure operation of S011. If it is determined that the correction amount of the horizontal correction operation was insufficient, the process proceeds to S202, and if it is determined that the correction amount of the horizontal correction operation is not insufficient, the processing of notification 2 is terminated.

[0050] In S202, the notification unit 12 notifies the user of the inclination of the image. For example, a liquid crystal display device or an electronic viewfinder provided on the rear surface of the camera body 1 may display a message to the effect that the image was shot tilted relative to the horizontal state. Next, in S203, the control unit 9 performs a process of calculating the degree to which the image was tilted based on the insufficient amount of horizontal correction operation, and generating metadata. Data indicating the amount of image inclination is generated as metadata to be embedded in the image when the image is recorded in S014 of FIG. 4. After S203, the notification 2 process ends.

[0051] The photographer can recognize that the shooting has failed from the contents of the notification 2, and can obtain the tilt amount of the image as metadata. Therefore, in image processing after shooting, it is possible to easily perform image rotation correction processing based on the metadata.

[0052] In this embodiment, the horizontal correction operation and the roll shake correction operation are performed within a predetermined limit range by the limit amount 1 in the horizontal correction operation and the limit amount 2 in the roll shake correction operation, but this is not limited to this example. For example, the limit amount 1 and the limit amount 2 may be set to zero, and all the horizontal correction operations may be left to the electronic roll operation. In that case, the image shake correction unit 7 does not perform any roll operation, and the movable part of the image shake correction unit 7 moves to the initial position when the imaging device 1000 is installed horizontally, and stops there.

[0053] In addition, in this embodiment, an example in which electronic roll operation is always possible has been described. Electronic roll operation can be performed using the imaging element 5 and the image processing unit 10. When the image blur caused by the roll component of the shake applied to the imaging device cannot be sufficiently corrected by the image blur correction unit 7, the image processing unit 10 corrects the image by electronic roll operation for the roll component exceeding the limited amount. In addition, in the case of an imaging device in which electronic roll operation is not possible, a sequence is performed in which the process of S012 in FIG. 4 is skipped and the process proceeds from S011 to S013.

[0054] According to this embodiment, it is possible to provide an imaging device that can suppress deterioration in image quality due to the impact caused by the operation of a mechanical shutter means, while suppressing uneven exposure on the left and right sides of the screen due to roll movement.

[0055] Embodiments of the present disclosure include the following configurations and methods. [Configuration 1] An imaging device capable of correcting an image acquired by an imaging element via an imaging optical system, a driving means for driving the image sensor within a plane perpendicular to an optical axis of the image pickup optical system; an image processing means for processing an image acquired by the imaging element; a first control means for controlling switching between a first drive mode using a front curtain and a rear curtain of a mechanical shutter means disposed between the imaging optical system and the imaging element, and a second drive mode using an electronic front curtain and a rear curtain of the shutter means utilizing an accumulation start reset operation of the imaging element; a second control means for controlling the driving means or for controlling the image correction means to correct the image; When a predetermined photographing condition is met, the first control means selects the second driving mode, and the second control means controls to restrict the driving of the image sensor by the driving means, or to correct the images by the alignment and synthesis process performed by the image processing means on a plurality of images continuously obtained from the image sensor. 1. An imaging device comprising: [Configuration 2] under the predetermined photographing condition, the second control means sets a first limiting amount for a first roll motion that keeps the composition horizontal during photographing, or a second limiting amount for a second roll motion related to a roll component of a shake applied to the imaging device; Before an exposure operation of the image sensor, the second control means controls the drive means within the range of the first limit amount or the second limit amount. 2. The imaging device according to configuration 1, [Configuration 3] The second control means controls the image processing means to correct the image after the exposure operation of the image sensor. 3. The imaging device according to configuration 1 or 2, [Configuration 4] The second control means controls the correction of the image by the image processing means, and the driving means moves to an initial position and stops there. 3. The imaging device according to configuration 1 or 2, [Configuration 5] The image processing means acquires a plurality of images captured with a total exposure time divided and generates a composite image. 5. The imaging device according to any one of configurations 1 to 4. [Configuration 6] The second control means controls the driving means or controls the correction of the image by the image processing means with respect to a roll component of the shake applied to the imaging device obtained from the detection means. 6. The imaging device according to any one of configurations 1 to 5. [Configuration 7] Under the predetermined photographing condition, the second control means controls the driving means to limit a roll motion of the image sensor rotating around the optical axis, and when an image blur caused by a roll component of a shake applied to the imaging device is not corrected by the driving means, the second control means controls the image processing means to correct the image for the roll component exceeding a limited amount. 2. The imaging device according to configuration 1, [Configuration 8] the first roll motion is a motion for correcting a tilt of the image sensor caused by a change in the image pickup device from a horizontal attitude, and the second roll motion is a motion corresponding to a roll component around the optical axis of a shake applied to the image pickup device, The second control means sets the first or second limit amount when it determines that the setting of the first or second roll action is valid. 3. The imaging device according to configuration 2. [Configuration 9] a detection means for detecting an inclination of the imaging device with respect to a horizontal attitude state; a notification means for providing a notification related to the roll operation, The second control means controls the notifying means to notify that the image capturing apparatus is largely deviated from the horizontal attitude when the tilt detected by the detecting means is greater than a threshold value corresponding to the first limit amount. 9. The imaging device according to configuration 8, [Configuration 10] The second control means controls the notifying means to notify the tilt of the captured image when the correction by the driving means or the correction by the image processing means is performed and it is determined that the amount of correction is insufficient. 10. The imaging device according to configuration 9. [Configuration 11] a storage means for storing metadata relating to the acquired image; When it is determined that the correction amount is insufficient, the second control means performs control to store the metadata representing the tilt amount of the image corresponding to the insufficient amount in the storage means. 11. The imaging device according to configuration 10. [Configuration 12] The second control means determines whether the predetermined photographing condition is met based on the exposure time of the image sensor, whether the image pickup device is attached to a support device, or whether a continuous shooting mode or a single shooting mode is set. 12. The imaging device according to any one of configurations 1 to 11. [Configuration 13] The predetermined photographing condition is a photographing condition in which an impact caused by the movement of the front curtain may affect the image. 13. The imaging device according to any one of configurations 1 to 12. [method] A control method executed in an imaging device capable of correcting an image acquired by an imaging element through an imaging optical system, comprising: a step of driving the image sensor by a driving means within a plane perpendicular to an optical axis of the image pickup optical system; a first control step for controlling switching between a first drive mode using a front curtain and a rear curtain of a mechanical shutter means disposed between the imaging optical system and the imaging element and a second drive mode using an electronic front curtain and a rear curtain of the shutter means utilizing an accumulation start reset operation of the imaging element; A step of processing an image acquired by the imaging element by an image processing means; A second control step of controlling the driving means or correcting an image using the image processing means, When the photographing conditions are predetermined, the second driving mode is selected in the first control step, and in the second control step, the driving of the image sensor by the driving means is restricted, or the image processing means performs control to correct the images by performing alignment and synthesis processing on a plurality of images continuously obtained from the image sensor. 23. A method for controlling an imaging apparatus comprising the steps of: [Explanation of symbols]

[0056] 5. Imaging element 7. Image stabilization unit 8. SH control section 9. Control section 10. Image processing section

Claims

1. An imaging device capable of correcting an image acquired by an imaging element via an imaging optical system, a driving means for driving the image sensor within a plane perpendicular to an optical axis of the image pickup optical system; an image processing means for processing an image acquired by the imaging element; a first control means for controlling switching between a first drive mode using a front curtain and a rear curtain of a mechanical shutter means disposed between the imaging optical system and the imaging element, and a second drive mode using an electronic front curtain and a rear curtain of the shutter means utilizing an accumulation start reset operation of the imaging element; a second control means for controlling the driving means or for controlling the image correction means to correct the image; When a predetermined photographing condition is met, the first control means selects the second drive mode, and the second control means controls to restrict the drive of the image sensor by the drive means, or to correct the images by the alignment and synthesis process performed by the image processing means on a plurality of images continuously obtained from the image sensor.

1. An imaging device comprising:

2. under the predetermined photographing condition, the second control means sets a first limiting amount for a first roll motion that keeps the composition horizontal during photographing, or a second limiting amount for a second roll motion related to a roll component of a shake applied to the imaging device; Before an exposure operation of the image sensor, the second control means controls the drive means within the range of the first limit amount or the second limit amount.

2. The imaging device according to claim 1 .

3. The second control means performs control to correct the image by the image processing means after an exposure operation of the image sensor.

3. The imaging device according to claim 1, wherein the first and second lenses are arranged in a first direction.

4. The second control means controls the correction of the image by the image processing means, and the driving means moves to an initial position and stops there.

3. The imaging device according to claim 1, wherein the first and second lenses are arranged in a first direction.

5. The image processing means acquires a plurality of images captured with a total exposure time divided and generates a composite image.

2. The imaging device according to claim 1 .

6. The second control means controls the driving means or controls the correction of the image by the image processing means with respect to a roll component of the shake applied to the imaging device obtained from the detection means.

2. The imaging device according to claim 1 .

7. Under the predetermined photographing condition, the second control means controls the driving means to limit a roll motion of the image sensor rotating around the optical axis, and when an image blur caused by a roll component of a shake applied to the imaging device is not corrected by the driving means, the second control means controls the image processing means to correct the image for the roll component exceeding a limited amount.

2. The imaging device according to claim 1 .

8. the first roll motion is a motion for correcting a tilt of the image sensor caused by a change in the image pickup apparatus from a horizontal attitude, and the second roll motion is a motion corresponding to a roll component around the optical axis of a shake applied to the image pickup apparatus, The second control means sets the first or second limit amount when it determines that the setting of the first or second roll motion is valid.

3. The imaging device according to claim 2.

9. a detection means for detecting an inclination of the imaging device with respect to a horizontal attitude state; a notification means for providing a notification related to the roll operation, The second control means controls the notifying means to notify that the image capturing apparatus is largely deviated from the horizontal attitude when the tilt detected by the detecting means is greater than a threshold value corresponding to the first limit amount.

9. The imaging device according to claim 8.

10. The second control means controls the notifying means to notify the tilt of the captured image when the correction by the driving means or the correction by the image processing means is performed and it is determined that the amount of correction is insufficient.

10. The imaging device according to claim 9.

11. a storage means for storing metadata relating to the acquired image; When it is determined that the correction amount is insufficient, the second control means performs control to store the metadata representing the amount of tilt of the image corresponding to the insufficient amount in the storage means.

11. The imaging device according to claim 10.

12. The second control means determines whether the predetermined photographing conditions are met based on the exposure time of the image sensor, whether the image pickup device is attached to a support device, or whether a continuous shooting mode or a single shooting mode is set.

2. The imaging device according to claim 1 .

13. The predetermined photographing condition is a photographing condition in which an impact caused by the movement of the front curtain may affect the image.

2. The imaging device according to claim 1 .

14. A control method executed in an imaging device capable of correcting an image acquired by an imaging element through an imaging optical system, comprising: a step of driving the image sensor by a driving means within a plane perpendicular to an optical axis of the image pickup optical system; a first control step for controlling switching between a first drive mode using a front curtain and a rear curtain of a mechanical shutter means disposed between the imaging optical system and the imaging element and a second drive mode using an electronic front curtain and a rear curtain of the shutter means utilizing an accumulation start reset operation of the imaging element; A step of processing an image acquired by the imaging element by an image processing means; a second control step of controlling the driving means or correcting an image using the image processing means; When the photographing conditions are predetermined, the second driving mode is selected in the first control step, and in the second control step, the driving of the image sensor by the driving means is restricted, or the image processing means performs control to correct the images by performing alignment and synthesis processing on a plurality of images continuously obtained from the image sensor.

23. A method for controlling an imaging apparatus comprising the steps of:

Images