Imaging device, method of operating the imaging device, and operating program of the imaging device

Abstract

The present invention provides an imaging device, an operating method for the imaging device, and an operating program for the imaging device that enable the return time to a predetermined position of a moving object under predetermined conditions to be shortened. [Solution] The imaging device is equipped with a processor, which acquires displacement information including the direction and magnitude of the displacement, and position information of the moving object that moves for blur correction. If the displacement information satisfies predetermined conditions and the position of the moving object is not at a predetermined position, the processor determines the amount of correction for the moving object by using a second correction function, which has a shorter return time to the predetermined position of the moving object than the first correction function, instead of the first correction function.

Description

Technical Field

[0001] The technology of the present disclosure relates to an imaging device, a method for operating the imaging device, and an operation program for the imaging device.

Background Art

[0002] Patent Document 1 describes a control device that controls shake correction by driving a first image shake correction means for moving an optical element included in a photographing optical system and a second image shake correction means for moving an imaging element. The control device includes a determination means for determining the intensity of shake correction, a calculation means for calculating a target correction amount of at least one of the first image shake correction means and the second image shake correction means based on the intensity of shake correction determined by the determination means and the shake amount of the imaging device, and a control means for controlling the first image shake correction means and the second image shake correction means in a plurality of methods including at least a first control method and a second control method. The determination means determines the intensity of shake correction based on the position information of the optical element when controlling in the first control method and based on the position information of the imaging element when controlling in the second control method.

[0003] Patent Document 2 describes an imaging device having a first detection unit for detecting shake of the imaging device, a second detection unit for detecting movement of an image between different frames before a predetermined still image is taken, a subject angular velocity detection unit for detecting a subject angular velocity before a still image exposure period from detection results of the first detection unit and the second detection unit, a subject angular acceleration inflection point determination unit for determining an inflection point of a subject angular acceleration before a still image exposure period based on the subject angular velocity before the still image exposure period, and a subject angular velocity prediction unit for predicting a subject angular velocity during the still image exposure period based on the inflection point and the subject angular velocity before the still image exposure period, and a shake correction unit for performing shake correction of the subject based on the subject angular velocity predicted by the subject angular velocity prediction unit.

Prior Art Documents

Patent Documents

[0004]

Patent Document 1

Patent Document 2

Summary of the Invention

Problems to be Solved by the Invention

[0005] One embodiment of the technology according to the present disclosure provides an imaging device, a method of operating the imaging device, and an operating program for the imaging device that can shorten the return time to a predetermined position of a moving object under predetermined conditions.

Means for Solving the Problems

[0006] In order to achieve the above object, an imaging device according to the technology of the present disclosure includes a processor. The processor acquires displacement information including the direction and magnitude of displacement, and position information of a moving object that moves for blur correction. When the displacement information satisfies predetermined conditions and the position of the moving object is not at a predetermined position, instead of a first correction function, a second correction function in which the return time to the predetermined position of the moving object is shorter than the first correction function is used to determine the correction amount of the moving object.

[0007] The predetermined conditions may include that the panning operation or the tilt operation has ended and a preset time has elapsed.

[0008] During the panning operation or the tilt operation, the processor may determine the correction amount using the first correction function.

[0009] When the moving object returns to the predetermined position, the processor may return the second correction function to the first correction function.

[0010] The predetermined conditions may include that it is during the panning operation or the tilt operation.

[0011] The predetermined conditions may include that the displacement associated with the operation intended by the user has ended, or that the displacement associated with the operation intended by the user continues for a certain period of time during the operation intended by the user.

[0012] The predetermined conditions may include the determination that the imaging device is stationary.

[0013] The processor may continue using the second correction function even after the object has returned to its predetermined position, and may switch back to the first correction function if the displacement exceeds a predetermined threshold.

[0014] Both the first and second correction functions may be functions whose correction strength decreases as the position of the object being moved moves further away from a predetermined position.

[0015] The first correction function is a function in which the correction strength decreases as the position of the moving object moves away from a predetermined position, and the second correction function may have a smaller change in correction strength depending on the position of the moving object than the first correction function.

[0016] The object being moved may be the image sensor if the image stabilization method is sensor shift type, the lens if the image stabilization method is lens shift type, or the image cropping position if the image stabilization method is electronic stabilization type.

[0017] The method for operating an imaging device according to the technology of this disclosure is a method for operating an imaging device equipped with a processor, wherein the processor acquires displacement information including the direction and magnitude of the displacement, and position information of a moving object that moves for image stabilization, and when the displacement information satisfies predetermined conditions and the position of the moving object is not at a predetermined position, it determines the amount of correction for the moving object using a second correction function, which has a shorter return time to the predetermined position of the moving object than the first correction function, instead of a first correction function.

[0018] The operating program for an imaging device according to the technology of this disclosure is an operating program for an imaging device equipped with a processor, which causes the processor to perform the following processes: acquiring displacement information including the direction and magnitude of the displacement, and position information of a moving object that moves for image stabilization; and, if the displacement information satisfies predetermined conditions and the position of the moving object is not at a predetermined position, determining the amount of correction for the moving object using a second correction function, which has a shorter return time to the predetermined position of the moving object than the first correction function, instead of a first correction function. [Brief explanation of the drawing]

[0019] [Figure 1] This is a schematic perspective view of the imaging device. [Figure 2] This is a diagram showing an example of the internal configuration of an imaging device. [Figure 3] This is a block diagram showing an example of a processor's functional configuration. [Figure 4] This diagram shows an example of the configuration of the image stabilization control unit. [Figure 5] This is a diagram illustrating an example of electronic vibration isolation treatment. [Figure 6] This figure shows an example of angular velocity signal and recording area movement in the case of camera shake. [Figure 7] This figure shows an example of angular velocity signal and recording area movement during panning operation. [Figure 8] This diagram schematically illustrates an example of how the recording area changes during panning. [Figure 9] This figure shows examples of the first and second correction functions. [Figure 10] This figure shows the change in correction intensity corresponding to the first and second correction functions. [Figure 11] This diagram conceptually illustrates an example of image stabilization when the first correction function is applied. [Figure 12] This figure conceptually shows an example of image blur correction when a correction function comparable to that in Figure 11 is applied. [Figure 13] This diagram conceptually illustrates an example of the return time when the first correction function is applied. [Figure 14] This diagram conceptually illustrates an example of the return time when the second correction function is applied. [Figure 15] This is a flowchart illustrating an example of image stabilization. [Figure 16] This figure shows the second correction function for the first modified example. [Figure 17] This figure shows the change in correction intensity corresponding to the second correction function of the first modified example. [Figure 18] This figure shows an example of a flowchart for the second modified example. [Figure 19] This diagram schematically illustrates an example where the recording area does not change during panning. [Figure 20] This is a flowchart of the third modified example. [Modes for carrying out the invention]

[0020] An example of an embodiment relating to the technology of this disclosure will be described with reference to the attached drawings.

[0021] (Configuration of the imaging device) As a first embodiment of the imaging device, the technology of this disclosure will be explained using a lens-interchangeable digital camera as an example. However, the technology of this disclosure is not limited to lens-interchangeable cameras, but can also be applied to lens-integrated digital cameras.

[0022] Figure 1 shows a perspective view of the imaging device 10. As shown in Figure 1, the imaging device 10 is a lens-interchangeable digital camera. The imaging device 10 consists of a main body 11 and an imaging lens 12 that is interchangeably mounted on the main body 11. The imaging lens 12 is attached to the front surface 11C of the main body 11 via a camera-side mount 11A and a lens-side mount 12A (see Figure 2). The imaging lens 12 is an example of a lens according to the technology of this disclosure.

[0023] On the upper surface of the main body 11, a dial 13 and a release button 14 that constitute an operation unit 42 (see FIG. 2) are provided. The dial 13 is operated when setting the operation mode or the like. As the operation modes of the imaging device 10, for example, a still image shooting mode, a moving image shooting mode, and an image display mode are included. The release button 14 is operated by the user when starting to execute still image shooting or moving image shooting.

[0024] Further, a finder 17 is provided on the main body 11. Here, the finder 17 is a hybrid finder (registered trademark). The hybrid finder refers to a finder in which, for example, an optical viewfinder (hereinafter referred to as "OVF (Optical View Finder)") and an electronic viewfinder (hereinafter referred to as "EVF (Electronic View Finder)") are selectively used.

[0025] The Z-axis A shown in FIG. 1 Z corresponds to the optical axis of the imaging lens 12. The X-axis A X and the Y-axis A Y are orthogonal to each other and orthogonal to the Z-axis A Z The X-axis A X and the Y-axis A Y correspond to the pitch axis and the yaw axis according to the technology of the present disclosure. In the following description, the rotation direction around the Z-axis A Z is referred to as the roll direction. Also, the rotation direction around the X-axis A X is referred to as the pitch direction. Also, the rotation direction around the Y-axis A Y is referred to as the yaw direction. Also, the X-axis A X direction is referred to as the X direction, and the Y-axis A Y direction is referred to as the Y direction. Note that "orthogonal" includes being substantially orthogonal in the sense including the errors generally allowed in the technical field to which the technology of the present disclosure belongs, in addition to being orthogonal at an angle of 90°.

[0026] Furthermore, the rear of the main body 11 of the imaging device 10 is provided with a display 15, an indicator key (not shown), and a viewfinder eyepiece (not shown). The display 15 shows images based on the image signal obtained by imaging, as well as various menu screens, etc.

[0027] The instruction keys also constitute the operation unit 42 (see Figure 2) and receive various instructions. Here, "various instructions" include, for example, instructions to display a menu screen in which various menus can be selected, instructions to select one or more menus, instructions to confirm the selection, instructions to delete the selection, autofocus mode, manual focus mode, and various other instructions such as frame-by-frame advance. In addition, the main unit 11 is also provided with a power switch and the like.

[0028] The viewfinder eyepiece selectively displays either the optical image visible through the optical viewfinder (OVF) or the live view image, which is the electronic image visible through the electronic viewfinder (EVF). The user can observe the optical image or the live view image of the subject through the viewfinder eyepiece.

[0029] Figure 2 shows an example of the internal configuration of the imaging device 10. The main body 11 and the imaging lens 12 are electrically connected by contact between an electrical contact 11B provided on the camera-side mount 11A and an electrical contact 12B provided on the lens-side mount 12A.

[0030] The imaging lens 12 includes an objective lens 30, a focusing lens 31, a rear end lens 32, and an aperture 33. These optical elements are aligned with the optical axis (i.e., the Z-axis A) of the imaging lens 12. Z Along the ) the lenses are arranged in the following order from the objective side: objective lens 30, aperture 33, focusing lens 31, and rear end lens 32. The objective lens 30, focusing lens 31, and rear end lens 32 constitute the imaging optical system. The type, number, and arrangement order of the lenses constituting the imaging optical system are not limited to the example shown in Figure 2.

[0031] The imaging lens 12 also includes a lens drive control unit 34 and memory (not shown). The lens drive control unit 34 is composed of, for example, a CPU (Central Processing Unit), RAM (Random Access Memory), and ROM (Read Only Memory). The lens drive control unit 34 is electrically connected to the processor 40 in the main unit 11 via electrical contacts 12B and 11B.

[0032] The lens drive control unit 34 drives the focus lens 31 and aperture 33 based on control signals transmitted from the processor 40. The lens drive control unit 34 controls the drive of the focus lens 31 based on focus control control signals transmitted from the processor 40 in order to adjust the focus position of the imaging lens 12. The processor 40 performs focus control, for example, using a phase difference method.

[0033] The aperture 33 has an aperture whose diameter is variable around the optical axis. The lens drive control unit 34 controls the drive of the aperture 33 based on an aperture adjustment control signal transmitted from the processor 40 in order to adjust the amount of light incident on the light-receiving surface 20A of the image sensor 20.

[0034] Furthermore, the imaging lens 12 is provided with memory (not shown). The memory is a non-volatile memory such as flash memory. The memory stores, for example, lens data for identifying the type of imaging lens 12. This lens data includes, for example, information representing the focal length (i.e., zoom magnification) of the imaging lens 12.

[0035] The main unit 11 includes an imaging sensor 20, a processor 40, an image processing unit 41, an operation unit 42, and a display 15. The imaging sensor 20, image processing unit 41, operation unit 42, blur detection sensor 44, and display 15 are controlled by the processor 40. The processor 40 is composed of, for example, a CPU, RAM, and ROM. In this case, the processor 40 executes various processes based on an operation program 45A stored in the memory 45. The processor 40 may also be composed of an assembly of multiple IC (Integrated Circuit) chips.

[0036] The imaging sensor 20 is, for example, a CMOS (Complementary Metal Oxide Semiconductor) type image sensor. The imaging sensor 20 has the Z axis A as the optical axis. Z The axis is perpendicular to the light-receiving surface 20A, and the Z-axis A Z The sensor is positioned so as to be at the center of the light-receiving surface 20A. Light that has passed through the imaging lens 12 is incident on the light-receiving surface 20A. Multiple pixels are formed on the light-receiving surface 20A, which generate an image signal by performing photoelectric conversion. The imaging sensor 20 generates and outputs an image signal by performing photoelectric conversion on the light incident on each pixel.

[0037] The shake detection sensor 44 detects shake applied to the main body 11 that houses the imaging sensor 20. Shake includes hand shake when the imaging device 10 is held by hand. The shake detection sensor 44 is a 5-axis shake detection sensor that detects shake in the roll direction, yaw direction, pitch direction, X direction, and Y direction, for example. Hereinafter, shake in the roll direction will be called rotational shake. Shake in the yaw and pitch directions will be called angular shake. Shake in the X and Y directions will be called translational shake.

[0038] The shake detection sensor 44 is composed of, for example, a gyro sensor and an accelerometer. The gyro sensor detects rotational shake and angular shake. The accelerometer detects translational shake.

[0039] The image processing unit 41 is composed of, for example, a DSP (Digital Signal Processor). The image processing unit 41 generates image data in a predetermined file format (for example, JPEG (Joint Photographic Experts Group) format) by applying various image processing operations to the image signal.

[0040] The display 15 displays images based on image data generated by the image processing unit 41. Images include still images, videos, and live view images. Live view images are images displayed on the display 15 in real time by sequentially outputting image data generated by the image processing unit 41 to the display 15.

[0041] Image data generated by the image processing unit 41 can be stored in the internal memory (not shown) built into the main unit 11, or in a storage medium (e.g., a memory card) that can be attached to or removed from the main unit 11.

[0042] The processor 40 controls each part within the main unit 11 and the lens drive control unit 34 within the imaging lens 12 in response to the operation of the operation unit 42.

[0043] Furthermore, when the imaging lens 12 is connected to the main unit 11, the processor 40 acquires lens data via the lens drive control unit 34.

[0044] The front surface 11C of the main body 11 is provided with a camera-side mount 11A. The imaging lens 12 is provided with a lens-side mount 12A on its rear end. By attaching the lens-side mount 12A to the camera-side mount 11A, the imaging lens 12 is connected to the main body 11.

[0045] The image sensor 20 has a light-receiving surface 20A that is exposed through the opening of the camera-side mount 11A. When the imaging lens 12 is attached to the main body 11, the imaging lens 12 images light from the subject onto the light-receiving surface 20A of the image sensor 20. The image sensor 20 generates and outputs an image signal by capturing the light imaged onto the light-receiving surface 20A.

[0046] Figure 3 shows an example of the functional configuration of the processor 40. The processor 40 realizes various functional units by executing processing according to the operating program 45A stored in the memory 45. As shown in Figure 3, for example, the processor 40 realizes a main control unit 50, an imaging control unit 51, and a blur correction control unit 54.

[0047] The main control unit 50 comprehensively controls the operation of the image sensor 20 based on instruction signals input from the operation unit 42. The image control unit 51 controls the imaging operation of the image sensor 20. The image control unit 51 drives the image sensor 20 in still image imaging mode or video imaging mode.

[0048] The user can select between still image capture mode and video capture mode, and make various settings for the capture mode by operating the control unit 42. The image capture control unit 51 executes a drive process to drive the image sensor 20 according to the selected capture mode and selected settings.

[0049] The electronic vibration isolation control unit 53 controls the image processing unit 41 to perform electronic vibration isolation processing to correct rotational and translational blur. As will be described in detail later, the electronic vibration isolation processing corrects rotational and translational blur by changing the recording area RA (see Figure 5) for recording the image signal from the imaging area 20B of the imaging sensor 20 between frames. The electronic vibration isolation processing corresponds to the blur correction method of the "electronic correction method" related to the technology of this disclosure. The electronic vibration isolation processing is a blur correction process that corrects blur by moving the recording area RA within the imaging area 20B. The recording area RA is an example of the "moving object" related to the technology of this disclosure. Furthermore, the image processing unit 41 generates image data by image processing the signal corresponding to the recording area from the image signal. That is, the recording area RA is the cropping position within the imaging area 20B of the image signal that generates the image data, and is an example of the "image cropping position" related to the technology of this disclosure. Changing the recording area RA includes rotation and translation of the recording area RA. This electronic image stabilization process reduces the degradation of image quality caused by shaking applied to the main unit 11.

[0050] In the shake detection sensor 44, the gyro sensor is an angular velocity sensor that detects rotational shake and angular shake, and outputs an angular velocity signal as the detected value. The gyro sensor outputs an angular velocity signal B representing rotational shake. R And, angular velocity signal B representing angular deviation Y ,B P Outputs angular velocity signal B. Y This represents the angular deviation in the yaw direction. Angular velocity signal B P This represents angular shake in the pitch direction. In addition, the shake detection sensor 44 outputs an acceleration signal as a detected value of translational shake. The acceleration sensor outputs an acceleration signal representing translational shake in the X direction and an acceleration signal representing translational shake in the Y direction. The angular velocity signal and acceleration signal output by the shake detection sensor 44 are examples of displacement information related to the technology of this disclosure. The displacement information includes the direction and magnitude of the displacement of the imaging device 10. The displacement of the imaging device 10 also includes vibration.

[0051] Angular velocity signal B output from the gyro sensorR ,B Y ,B P The acceleration signal output from the acceleration sensor is input to the image stabilization control unit 54 via the AFE (Analog Front End) 48, which consists of an A / D converter and an amplifier.

[0052] In this embodiment, the shake detection axes are five axes: roll direction, yaw direction, pitch direction, X direction, and Y direction, while the shake correction axes are three axes: roll direction, X direction, and Y direction. Therefore, for the yaw direction and pitch direction, the angular velocity signal B representing angular shake is used. Y ,B P It is not possible to directly correct angular runout based on this. In this embodiment, angular runout in the yaw direction is corrected by including it in translational runout in the X direction, and angular runout in the pitch direction is corrected by including it in translational runout in the Y direction.

[0053] Of these five axes of shake, the following explanation will primarily focus on yaw shake. Yaw shake can be caused by camera shake, as well as by panning, a camera movement in which the user intentionally moves the imaging device 10. As is well known, panning is an operation in which the shooting direction of the imaging device 10 is changed at a nearly constant speed in one direction (left or right) while keeping the height of the imaging device 10 nearly constant. Panning is a camera movement performed, for example, to take panoramic shots of landscapes (see Figure 8) or to pan shots of moving objects such as vehicles.

[0054] Memory 45 stores the lookup table (hereinafter referred to as LUT) 55. LUT 55 is a table that records the correction function used to derive the correction amount in image stabilization.

[0055] Figure 4 shows an example of the configuration of the shake correction control unit 54. Figure 4 shows the configuration for correction of angular shake in the yaw direction. The shake correction control unit 54 receives the yaw direction angular velocity signal B Y Based on this, the correction amount V in the yaw direction YIt includes a correction amount calculation unit 61 that calculates the correction amount and a condition determination unit 62.

[0056] The correction amount calculation unit 61 calculates the angular velocity signal B, which represents the angular deviation in the yaw direction. Y V represents the correction amount V that indicates the angle information. Y It converts and outputs the result. The correction amount calculation unit 61 includes, for example, a subtractor 61A, a high-pass filter (hereinafter referred to as HPF) 61B, a multiplier 61C, and an integrator 61D.

[0057] Subtractor 61A receives angular velocity signal B Y Offset correction is performed by subtracting the zero-point correction value. The zero-point correction value is the output value from the gyro sensor when the gyro sensor is stationary. HPF61B removes at least a portion of the remaining DC component that could not be completely removed by the offset correction using subtractor 61A.

[0058] Furthermore, as will be explained in more detail later, the cutoff frequency for removing DC components in the HPF61B is not constant. Instead, the cutoff frequency of the HPF61B is changed according to the determination result of the condition determination unit 62 and the correction function stored as LUT55.

[0059] The multiplier 61C performs gain correction by multiplying the output signal from the HPF 61B by a gain value. The gain value is determined by the focal length of the imaging lens 12 and / or the sensitivity of the gyro sensor. For example, even if the angle of blur is the same, the amount of correction within the imaging area 20B will differ if the focal length of the imaging lens 12 changes. In the case of rotational blur in the roll direction, the gain value does not depend on the focal length of the imaging lens 12. The integrator 61D calculates the correction amount V representing the angle information by integrating the output signal from the multiplier 61C. Y The correction amount calculation unit 61 generates and outputs the calculated correction amount V Y This is output to the electronic vibration isolation control unit 53.

[0060] Correction amount V YThis corresponds to the angle in the yaw direction. The electronic vibration isolation control unit 53 corrects the angular shake in the yaw direction to the translational shake in the X direction, so the correction amount V Y The correction amount V in the X direction SX Convert to.

[0061] As shown in Figure 5, the imaging area 20B includes the recording area RA, which is the image extraction area from which image data is extracted, and is larger in size in the X and Y directions than the recording area RA. Electronic vibration isolation control is a control method that suppresses blur by changing the position of the recording area RA within the imaging area 20B according to the magnitude and direction of the blur. In the initial state, the center O of the imaging area 20B and the center P of the recording area RA are RA They match. To correct for yaw-direction angular deviation, shift the position of the recording area RA in the X direction. Correction amount V SX This corresponds to the amount of shift that shifts the position of the recording area RA in the X direction within the imaging area 20B. In Figure 5, L X1 This indicates the maximum shift amount that the recording area RA can be shifted by. The electronic vibration isolation control unit 53 also feeds back the current position of the recording area RA to the correction amount calculation unit 61.

[0062] In the following, we will use the expression that the recording area RA is located at the center O, but this refers to the center P of the recording area RA. RA This means that it coincides with the center O of the imaging area 20B. Also, if the position of the recording area RA is not at the center O, then the center P of the recording area RA is... RA This means that it does not coincide with the center O of the imaging region 20B, and is located away from the center O.

[0063] In Figure 4, the memory 45 stores a first correction function F1 and a second correction function F2 in the form of LUTs 55, respectively, as correction functions for deriving the correction amount in shake correction. The shake correction control unit 54 determines the correction amount for the recording area RA by using the second correction function F2, which has a shorter return time TR than the first correction function F1, instead of the first correction function F1, when the displacement information regarding the shake angle output by the shake detection sensor 44 satisfies predetermined conditions and the position of the recording area RA, which is the object of movement, is not at the center O.

[0064] The condition determination unit 62 determines the conditions for applying the second correction function F2. The condition determination unit 62 outputs an H signal if the preset conditions are met and the position of the recording area RA is not at the center O, and outputs an L signal otherwise. The correction amount calculation unit 61 selects the first correction function F1 while an L signal is input, and selects the second correction function F2 instead of the first correction function F1 when an H signal is input. As will be described later, the condition determination unit 62 uses the angular velocity signal B, which is an example of displacement information of the imaging device 10. Y The condition is determined based on the angular velocity signal B. Y This is also input to the condition determination unit 62.

[0065] The following explains how these first and second correction functions, F1 and F2, function in image stabilization, and why they are used to perform image stabilization.

[0066] First, Figures 6 to 8 will be used to explain camera shake and panning motion, which are related to angular wobble in the yaw direction. Figure 6 shows the angular velocity signal B in the yaw direction in the case of camera shake. Y And the corresponding correction amount V for the recording area RA. SX This is shown. Figure 7 shows the yaw angular velocity signal B in the case of panning operation. Y And the corresponding correction amount V for the recording area RA. SX This shows the angular velocity signal B in the case of camera shake, as shown in Figures 6 and 7. Y In contrast, the angular velocity is small, but the frequency is high, and conversely, the angular velocity signal B in the case of panning operation YIn this case, the angular velocity is high and the frequency is low. Also, in the case of hand shake, the direction of displacement changes and becomes vibration, but in the case of panning, the period during which the direction of displacement is unidirectional is longer. Therefore, the angular velocity signal B in the case of panning Y This results in a higher DC component.

[0067] Therefore, as shown in Figure 6, the correction amount V for image stabilization in the case of camera shake. SX This is relatively small and occurs in both the positive and negative directions in the X direction. On the other hand, as shown in Figure 7, the correction amount V for blur correction in the case of panning operation SX It is relatively large and occurs in one direction, either positive or negative, in the X direction.

[0068] Figure 8 conceptually illustrates the panning operation and image stabilization when capturing panoramic video of a mountain landscape. Figure 8 shows three frames, from frame n to frame n+2, which switch over time during the panning operation. During the panning operation, the detected angular velocity increases, thus requiring a correction amount V. SX As the amount of shift increases, the shift amount of the recording area RA is more likely to reach the maximum shift amount during panning. When the shift amount reaches the maximum shift amount, it means that the recording area RA has reached its correction limit and can no longer be corrected further. In video recording mode, when the recording area RA reaches its correction limit, the video motion may become unnatural, such as becoming less smooth.

[0069] Figure 9 shows an example of the first correction function F1 and the second correction function F2. As described above, the imaging device 10 achieves blur correction by moving the recording area RA within the imaging area 20B. The first correction function F1 and the second correction function F2 are functions that change the cutoff frequency of the HPF61B in accordance with the change in the position of the recording area RA, which is the object of movement in blur correction. Figure 10 shows the first correction curve CI1 and the second correction curve CI2, which represent the change in correction intensity corresponding to the first correction function F1 and the second correction function F2, respectively. The cutoff frequency of the HPF61B has a negative correlation with the correction intensity of blur correction; the higher the cutoff frequency, the lower the correction intensity, and the lower the cutoff frequency, the higher the correction intensity. Both the first correction function F1 and the second correction function F2 are functions in which the correction intensity decreases as the position of the recording area RA, which is the object of movement, approaches the correction limit (indicated by the sign LMT in Figure 9) from the center O, in other words, as it moves away from the center O of the imaging area 20B.

[0070] Furthermore, a higher correction strength indicates that the signal is less likely to return to the center O of the recording area RA. Therefore, the magnitude of the cutoff frequencies in the first correction function F1 and the second correction function F2 indicates how easily the signal returns to the center O.

[0071] Using such a correction function, for example, the angular velocity signal B in the yaw direction can be analyzed. Y Even if the size is the same, when the position of the recording area RA is close to the center O of the imaging area 20B, as in the n frames shown in Figure 8, the amount of correction becomes larger, whereas when the position of the recording area RA approaches the correction limit, as in the n+2 frames, the amount of correction can be reduced.

[0072] Figure 11 shows the correction amount V near the correction limit when the first correction function F1 is applied during panning. SX1 This shows the change. As shown in Figure 11, when the displacement angle CA of the imaging device 10, which represents the yaw shake angle, increases, the angular velocity signal B in the yaw direction changes. YThe magnitude of becomes larger. Therefore, for example, in the initial stages when the panning operation of the imaging device 10 is started, that is, when the position of the recording area RA is close to the center O, the correction amount V is applied to the change in the displacement angle CA. SX1 It changes relatively linearly. However, as the recording area RA approaches the correction limit, the correction amount V SX1 The slope of the change gradually becomes gentler. This makes the motion in the video smoother.

[0073] Figure 12 shows the correction amount V when a correction function F0 with a constant cutoff frequency is applied regardless of the position of the recording area RA. SX0 This shows the change. When a correction function F0 with a constant cutoff frequency is applied, in panning operation, if the slope of the displacement angle CA is constant from the time the position of the recording area RA changes from the center O to the correction limit, the correction amount V SX0 The slope of the change also becomes constant. In this case, the recording area RA is more likely to reach its correction limit, resulting in motion that is not smooth and appears unnatural.

[0074] As shown in Figure 11, by performing motion correction using the first correction function F1, the motion of the video near the correction limit can be smoothed. However, using only this first correction function F1 results in the following disadvantages.

[0075] Figure 13 shows the correction amount V when the first correction function F1 is applied, similar to Figure 11. SX1 The changes are shown, but in Figure 13, the correction amount V is calculated from the point EP when the panning operation is completed until the recording area RA returns to the center O of the imaging area 20B. SX1The reduction in this area is shown. The first correction function F1 is a function in which the correction strength increases as the recording area RA approaches the center O. Conversely, this means that the closer the recording area RA is to the center O, the more difficult it becomes to return to the center O, and the return time TR for the recording area RA to return to the center O from the point EP when the panning operation is completed becomes longer. When considering shake correction caused by camera shake, it is preferable that the position of the recording area RA is as close to the center O as possible, and that a movable shift amount is secured. For this reason, it is preferable that the return time TR for the recording area RA to return to the center O be as short as possible.

[0076] Thus, as shown in Figure 11, the first correction function F1 has the advantage of smoothing the motion of the video when the recording area RA approaches the correction limit, but as shown in Figure 13, it has the disadvantage of increasing the return time TR when the recording area RA returns to the center O. To compensate for this disadvantage of the first correction function F1, the imaging device 10 has a second correction function F2 in addition to the first correction function F1.

[0077] As shown in Figure 14, the second correction function F2 is a function in which the return time TR to the center O of the recording area RA, which is the object being moved, is shorter than that of the first correction function F1. Similar to the first correction function F1, the second correction function F2 is a function in which the correction strength decreases as the position of the recording area RA moves away from the center O. However, the cutoff frequency of the second correction function F2 is relatively higher than that of the first correction function F1 across the entire range from the center O to the correction limit, and as a result, the correction strength is also lower than that of the first correction function F1. A lower correction strength means that it is easier to return to the center O. Therefore, the correction amount V of the second correction function F2 SX2 The slope at which the reduction occurs is greater than that of the first correction function F1, and the return time TR is shorter with the second correction function F2.

[0078] As described above, the shake correction control unit 54 determines the correction amount of the recording area RA using a second correction function F2, which has a shorter return time TR than the first correction function F1, instead of the first correction function F1, when the displacement information regarding the shake angle satisfies predetermined conditions and the position of the recording area RA, which is the object to be moved, is not at the center O. The second correction function F2 is used when it is desired to shorten the return time TR, so the predetermined conditions are, for example, that the panning operation has finished and a predetermined time TD has elapsed.

[0079] The operation of the above configuration will be explained with reference to the flowchart shown in Figure 15. For simplicity, the flowchart in Figure 15 will use yaw-direction angular shake as an example. When the video imaging mode is executed with electronic vibration damping correction enabled, in step S100, the processor 40 starts acquiring displacement information of the imaging device 10 from the shake detection sensor 44. Furthermore, in step S110, it starts acquiring the current position of the recording area RA, which is the object of movement. In the case of yaw-direction angular shake, the displacement information is the angular velocity signal B Y The current position is the position of the recording area RA in the X direction within the imaging area 20B.

[0080] In step S121, the processor 40 receives the angular velocity signal B, which is displacement information. Y Based on this, it is determined whether or not the panning operation has started. As shown in Figures 6 and 7, the angular velocity signal B in the case of panning operation Y In the case of camera shake, the angular velocity is greater, and the period of time when the angular velocity is high is relatively longer. Therefore, as a method for determining panning, for example, panning may be determined when the angular velocity is above a predetermined threshold and continues for a period of time equal to or greater than the predetermined threshold. Alternatively, since panning differs from camera shake in that the displacement is in one direction, panning may be determined when the angular velocity occurring in that direction is above a predetermined threshold and continues for a period of time equal to or greater than the predetermined threshold.

[0081] If the processor 40 determines that it is not a panning operation (NO in step S121), it proceeds to step S130 and performs blur correction using the first correction function F1. By performing blur correction using the first correction function F1, blur caused by camera shake is appropriately corrected. Furthermore, as shown in Figure 11, the motion of the video can be smoothed when the position of the recording area RA approaches the correction limit.

[0082] On the other hand, if the processor 40 determines that a panning operation is being performed (YES in step S121), it proceeds to step S122 to determine whether the panning operation has ended. The end of the panning operation is determined, for example, by the angular velocity signal B that was at a certain level during the panning operation. Y This is determined when the value begins to continuously decrease. After determining that the panning operation is complete, the processor 40 proceeds to step S123. In step S123, the processor 40 starts the timer from the time EP when it is determined that the panning operation is complete, and determines whether a predetermined time TD has elapsed. If the predetermined time TD has elapsed (YES in step S123), the processor 40 proceeds to step S124. In step S124, the processor 40 determines whether the position of the recording area RA is at the center O of the imaging area 20B. If the position of the recording area RA is not at the center O (NO in step S124), the processor 40 proceeds to step S125 and performs blur correction using the second correction function F2.

[0083] Steps S122 to S124 are steps to determine the conditions for applying the second correction function F2. If these conditions are not met (NO in step S122, NO in step S123, or YES in step S124), the process proceeds to step S130, and blur correction using the first correction function F1 continues.

[0084] While shake correction using the second correction function F2 is being performed, the processor 40 monitors in step S126 whether the current position of the recording area RA has returned to the center O. If the processor 40 determines in step S126 that the current position of the recording area RA has not returned to the center (NO in step S126), it performs shake correction using the second correction function F2. In this way, shake correction is performed using the second correction function F2 instead of the first correction function F1, so the time TR for the recording area RA to return to the center O is shorter compared to when the first correction function F1 is used, as shown in Figure 14.

[0085] In step S126, if it is determined that the recording area RA has returned to the center O, the processor 40 proceeds to step S130 and returns the second correction function F2 to the first correction function F1. In this way, by returning to the first correction function F1 when the panning operation is completed and the recording area RA returns to the center O, camera shake can be appropriately corrected.

[0086] In step S140, the processor 40 determines the conditions for ending image stabilization, such as the end of the video recording mode or the turning off image stabilization, and repeats the processes from step S121 to step S130 until the conditions for ending image stabilization are met.

[0087] As described above, the imaging device 10 according to the technology of this disclosure is equipped with a processor 40. The processor 40 acquires displacement information, including the direction and magnitude of the displacement, and position information of a recording area RA (an example of a moving object) that moves for image stabilization. When the displacement information satisfies predetermined conditions and the position of the moving object is not at the center O (an example of a predetermined position), the processor 40 determines the amount of correction for the recording area RA using a second correction function F2 instead of a first correction function F1, the second correction function F2 having a shorter return time TR to the center O of the recording area RA than the first correction function F1. This makes it possible to shorten the return time to the predetermined position of the moving object under preset conditions.

[0088] Furthermore, in the above embodiment, the predetermined conditions include the completion of the panning operation and the elapsed of a predetermined time. Since the completion of the panning operation is considered an example of a situation where image stabilization should not be performed, it is possible to quickly return the object being moved for image stabilization to its predetermined position in such a case.

[0089] Furthermore, in the above embodiment, the processor 40 determines the correction amount using the first correction function F1 during the panning operation. Therefore, the correction intensity can be increased until the panning operation is completed.

[0090] The processor 40 resets the second correction function F2 to the first correction function F1 when the recording area RA (an example of a moving object) returns to the center O (an example of a predetermined position). Therefore, after the panning operation is completed, the first correction function F1 can be corrected when the recording area RA returns to the center O.

[0091] Both the first correction function F1 and the second correction function F2 are functions in which the correction strength decreases as the position of the recording area RA (an example of a moving object) moves away from the center O (an example of a predetermined position). Therefore, when performing image stabilization, the movement of the recording area RA becomes smoother as it approaches the correction limit, thus making the motion of the video smoother.

[0092] (First variation: Variation of the second correction function) In the above embodiment, both the first correction function F1 and the second correction function F2 were described as functions whose correction strength decreases as the position of the recording area RA (an example of a moving object) moves away from the center O (an example of a predetermined position). However, as shown in Figure 16, the second correction function F2 may be a function whose cutoff frequency is constant regardless of the position of the recording area RA. Figure 17 shows the change in correction strength CI2 corresponding to the second correction function F2 shown in Figure 16. Since the cutoff frequency of the second correction function F2 is constant, the correction strength CI2 is also constant. The correction strength of the second correction function F2 is weaker than that of the first correction function F1. Therefore, by using the second correction function F2, the return time TR can be shortened compared to the first correction function F1.

[0093] The second correction function F2 shown in Figure 16 is an example of a function in which the amount of change in correction intensity according to the position of the recording area RA is smaller than that of the first correction function F1. As shown in Figure 16, the second correction function F2 does not need to be a function in which the cutoff frequency is constant regardless of the position of the recording area RA, but it is sufficient that the amount of change in correction intensity according to the position of the recording area RA is smaller than that of the first correction function F1.

[0094] (Second variation: Variation 1 of the conditions for applying the second correction function) In the above embodiment, the conditions for applying the second correction function F2 were described as the completion of the panning operation and the elapsed of a predetermined time TD, but other conditions are also acceptable. The second correction function F2 is a function that should not be used to correct blur caused by camera shake. An example of a situation where blur caused by camera shake should not be corrected is when the user moves from holding the imaging device 10 by hand to fixing it to a tripod or the like. When the imaging device 10 is fixed to a tripod or the like, camera shake will basically not occur in the imaging device 10, but when moving from a handheld state, the position of the recording area RA may not be at the center O due to the blur correction performed in the handheld state. In such cases, it is better to quickly return the recording area RA to the center O.

[0095] In this case, the processor 40 executes the process shown in Figure 18. The difference between the flowchart in Figure 18 and the flowchart in Figure 15 is that steps S121 to S124 in Figure 15, which are related to determining the application conditions of the second correction function F2, have been changed to steps S221 to S225 in Figure 18. Only the differences will be explained below.

[0096] In step S221, the processor 40 monitors the displacement information and determines whether the imaging device 10 is stationary. If the imaging device 10 is handheld, the imaging device 10 moves. Therefore, as displacement information indicating this movement, the angular velocity signal B is used for angular deviation in the yaw direction. YThe following is output. On the other hand, if the imaging device 10 is fixed to a tripod or the like, the imaging device 10 remains stationary, and the corresponding displacement information is output. Angular velocity signal B when stationary Y The displacement information, including this displacement, becomes smaller than the displacement information when the device is being held. The processor 40 determines whether the imaging device 10 is stationary or not based on this difference in displacement information.

[0097] If the processor 40 determines in step S221 that the imaging device 10 is not stationary (NO in step S221), the processor 40 proceeds to step S130 and performs blur correction using the first correction function F1.

[0098] On the other hand, if the processor 40 determines in step S221 that the imaging device 10 has come to a standstill (YES in step S221), it proceeds to step S222 to determine whether the current position of the recording area RA is at the center O. If the processor 40 determines that the current position of the recording area RA is not at the center O (NO in step S222), it proceeds to step S223 to perform blur correction using the second correction function F2 instead of the first correction function F1. Then, in step S224, the processor 40 monitors whether the position of the recording area RA has returned to the center O and continues blur correction using the second correction function F2 until it returns. This makes it possible to shorten the return time TR of the recording area RA.

[0099] If the processor 40 determines in step S224 that the recording area RA has returned to the center O (YES in step S224), it proceeds to step S225. In step S225, the processor 40 monitors whether there is any displacement exceeding a threshold for the imaging device 10. For example, if the imaging device 10 is removed from the tripod, the imaging device 10 will start moving again from a stationary state, causing a displacement exceeding a preset threshold. If the processor 40 determines in step S225 that there is a displacement exceeding the threshold (YES in step S225), it switches back from the second correction function F2 to the first correction function F1. Also, if the processor 40 determines in step S225 that there is no displacement exceeding the threshold (NO in step S225), it continues blur correction using the second correction function F2.

[0100] Thus, in this second modification, the predetermined conditions for applying the second correction function F2 include the determination that the imaging device 10 is stationary. This makes it possible to quickly return the moving object to a predetermined position when camera shake correction is unnecessary, such as when the imaging device 10 is fixed on a tripod or the like and stationary.

[0101] Furthermore, in the second modified example, the processor 40 continues to use the second correction function F2 even after the recording area RA (an example of a moving object) returns to the center O (an example of a predetermined position), and when the displacement exceeds a predetermined threshold, it switches the second correction function F2 back to the first correction function F1. This enables appropriate blur correction when the imaging device 10 requires blur correction due to camera shake.

[0102] (Third variation: Variation 2 of the conditions for applying the second correction function) Furthermore, during the panning operation, unlike in the case of camera shake, the correction strength of the image stabilization can be considered to be low. For example, as shown in Figure 19, if no camera shake occurs during the panning operation, the position of the recording area RA can always be located at the center O of the imaging area 20B. Rather, during the panning operation, it is easier to properly perform image stabilization caused by camera shake if the recording area RA is located at the center O of the imaging area 20B. Moreover, the closer the recording area RA is to the center O, the shorter the return time TR of the recording area RA will naturally be.

[0103] Therefore, as shown in the flowchart in Figure 20, if the processor 40 determines that the panning operation has started, it may switch to the second correction function F2 without waiting for the panning operation to finish. The difference between the flowchart in Figure 20 and the flowchart in Figure 15 is that steps S122 and S123, which were present in Figure 15, have been removed. That is, in the flowchart in Figure 20, the pre-set condition for applying the second correction function F2 is that the panning operation is in progress. If the processor 40 determines in step S121 that the panning operation has started, and in step S124 determines that the current position of the recording area RA is not at the center O, it proceeds to step S125 and performs blur correction using the second correction function F2. As a result, the correction strength of the blur correction is weaker throughout the entire period of the panning operation than if the first correction function F1 were applied. Therefore, the angular velocity signal B Y Even when the value is large, the amount of correction is suppressed, so the position of the recording area RA does not move away from the center O. Consequently, the return time TR to the center O after the panning operation is completed is also shortened.

[0104] Thus, in this third modification, the predetermined conditions for applying the second correction function F2 include the fact that panning is in progress. This allows the moving object to be quickly returned to its predetermined position when a correction strength as strong as that required for camera shake is not needed.

[0105] Furthermore, although the above embodiments and their modifications were described using panning as an example, the technology of this disclosure can also be applied to tilt operations, which are camera movements that rotate the imaging direction of the imaging device 10 in the vertical direction, in addition to panning operations. In tilt operations, angular shake occurs in the pitch direction, so the displacement information is the angular velocity signal B in the pitch direction. X This is the result.

[0106] Furthermore, in the technology disclosed herein, panning or tilting is an example of a situation where correction strength as that required for image stabilization due to camera shake is not necessary. In addition to panning or tilting, other camera movements include translational movements that move the imaging device 10 in the left-right or up-down direction without rotation. The technology disclosed herein may also be applied to such translational movements.

[0107] In other words, the predetermined conditions for applying the second correction function F2 include the completion of displacement associated with user-intentional actions such as camera work, or the continuation of displacement associated with user-intentional actions for a certain period of time. In user-intentional actions such as camera work, a correction strength as that of image stabilization is often unnecessary. In this case, it is preferable to shorten the return time TR to the center O of the recording area RA, which is the object of movement, by applying the technology of this disclosure.

[0108] Furthermore, in the above embodiment, the center O of the imaging region 20B was described as an example of a "predetermined position" relating to the technology of this disclosure, but it does not have to be the center O.

[0109] Furthermore, although the example was explained using the cutoff frequency of HPF61B as the variable for the first correction function F1 and the second correction function F2, functions with the gain of the multiplier 61C or integrator 61D as the variable may also be used. In other words, the variable is not limited as long as it is a function that can change the correction strength according to the position of the moving object. Also, the first correction function F1 and the second correction function F2 do not have to be in the form of LUT55, but may be in the form of calculation formulas.

[0110] Furthermore, although the above embodiment described electronic vibration isolation as an example of a vibration correction method, the vibration correction method may also be mechanical vibration isolation, or a combination of electronic and mechanical vibration isolation. Also, as is well known, for mechanical vibration isolation, the imaging sensor 20 is positioned along the optical axis A Z A sensor shift method that moves in a direction perpendicular to the optical axis A, and the lens of the imaging lens 12 moves along the optical axis A Z There is a lens shift method that shifts in a direction orthogonal to the image stabilization method. Either of these methods can be used for image stabilization. When the image stabilization method is the sensor shift method, the object being moved is the image sensor 20, and when the image stabilization method is the lens shift method, the object being moved is the lens.

[0111] The above embodiments and their various modifications can be combined with each other, as long as no contradictions arise.

[0112] The above embodiments further disclose the following additional information. [Additional note 1] It has a processor, The processor is, Displacement information, including the direction and magnitude of the displacement, and position information of the moving object for shake correction are obtained. If the displacement information satisfies predetermined conditions and the object being moved is not in the predetermined position, the correction amount for the object being moved is determined using a second correction function, which has a shorter return time to the predetermined position of the object being moved than the first correction function, instead of the first correction function. Imaging device. [Additional note 2] The predetermined conditions include the completion of the panning or tilting operation and the elapsed of a predetermined time. The imaging device described in Appendix 1. [Additional note 3] The processor determines the correction amount using a first correction function during panning or tilting operations. The imaging device described in Appendix 2. [Additional note 4] The processor resets the second correction function back to the first correction function when the object being moved returns to its predetermined position. The imaging device described in Appendix 2 or Appendix 3. [Additional note 5] The predetermined conditions include being in a panning or tilting motion. The imaging device described in Appendix 1. [Additional note 6] The predetermined conditions include the completion of the displacement associated with the user's intended action, or the continuation of the displacement associated with the user's intended action for a certain period of time. The imaging device described in Appendix 1. [Additional note 7] The predetermined conditions include the determination that the imaging device is stationary. The imaging device described in Appendix 1. [Additional note 8] The processor continues to use the second correction function even after the object has returned to its predetermined position, and switches back to the first correction function if the displacement exceeds a predetermined threshold. The imaging device described in Appendix 7. [Additional note 9] Both the first and second correction functions are functions whose correction strength decreases as the position of the object being moved moves further away from its predetermined position. An imaging device as described in any one of the appendices 1 to 8. [Additional Note 10] The first correction function is a function in which the correction strength decreases as the position of the object being moved moves further away from a predetermined position. The second correction function has a smaller change in correction intensity depending on the position of the moving object compared to the first correction function. An imaging device as described in any one of the appendices 1 to 8. [Additional Note 11] The targets of the move are: If the image stabilization method is sensor shift type, it is the image sensor. If the image stabilization method is lens shift type, then it is the lens. If the image stabilization method is electronic stabilization, this is the image cropping position. An imaging device as described in any one of the appendices 1 to 10. [Additional Note 12] A method for operating an imaging device equipped with a processor, The processor is, Displacement information, including the direction and magnitude of the displacement, and position information of the moving object for image stabilization are obtained. If the displacement information satisfies predetermined conditions and the object being moved is not in the predetermined position, the correction amount for the object being moved is determined using a second correction function, which has a shorter return time to the predetermined position of the object being moved than the first correction function, instead of the first correction function. How to operate the imaging device. [Additional Note 13] An operating program for an imaging device equipped with a processor, To acquire displacement information including the direction and magnitude of the displacement, and position information of the moving object for image stabilization. If the displacement information satisfies predetermined conditions and the position of the object being moved is not at the predetermined position, the correction amount for the object being moved is determined by using a second correction function, which has a shorter return time to the predetermined position of the object being moved than the first correction function, instead of the first correction function. An operating program for an imaging device that causes the processor to perform a process including [specific details].

[0113] In the above embodiment, each process is executed on any computer. Furthermore, any computer may execute these processes using a processor as hardware, a program as software, or a combination thereof. In that case, the processor is configured to work in cooperation with the program to execute the various processes in this embodiment, and can function as a unit or means in this embodiment. Also, the execution order of the processes by the processor is not limited to the order described and may be changed as appropriate.

[0114] Any computer may be a general-purpose computer, a computer designed for a specific purpose, a workstation, or any other system capable of performing each process. The processor may consist of one or more hardware components, and the type of hardware is not limited. For example, the processor may consist of hardware such as a CPU (Central Processing Unit), MPU (Micro Processing Unit), FPGA (Field Programmable Gate Array) or other programmable logic devices, ASIC (Application Specific Integrated Circuit) or other dedicated circuits for performing specific processes, GPU (Graphic Processing Unit), or NPU (Neural Processing Unit). Furthermore, the type of hardware may be a combination of different types of hardware. When multiple hardware components are configured to perform one or more processes of a given processor, these multiple hardware components may reside in physically separate devices or in the same device. Also, in any embodiment, the order of each process performed by the processor is not limited to the order described above and may be changed as appropriate. Hardware is composed of electrical circuits (circuitry) that combine circuit elements such as semiconductor elements.

[0115] Furthermore, the program may be firmware or software such as microcode. Alternatively, the program may be, for example, a set of program modules, each function of which may be implemented by a processor configured to perform its respective function. The program may be program code or multiple code segments stored on one or more non-temporary computer-readable media (e.g., storage media or other storage). The program may be divided and stored on multiple non-temporary computer-readable media located on physically separate devices. Program code or code segments may represent any combination of procedures, functions, subprograms, routines, subroutines, modules, software packages, classes, or instructions, data structures, or program statements. Program code or code segments may be connected to other code segments or hardware circuits by sending and receiving information, data, arguments, parameters, or memory contents.

[0116] The technology of this disclosure can be appropriately combined with the various embodiments and / or variations described above. Furthermore, it is understood that various configurations can be adopted without departing from the gist of the invention, and the invention is not limited to the embodiments described above. In addition, the technology of this disclosure extends to storage media for storing programs non-temporarily. The storage media are computer-readable non-temporarily storage media such as USB (Universal Serial Bus) memory, flexible disks, and CD-ROMs (Compact Disc Read Only Memory). Programs may also be provided online via a network such as the Internet. Furthermore, the technology of this disclosure extends to program products in addition to programs. Program products include all forms of products for providing programs. Like programs, program products may be stored and provided on computer-readable non-temporarily storage media, or they may be provided online.

[0117] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[0118] In this specification, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0119] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference. [Explanation of Symbols]

[0120] 10 Imaging device 11 Main unit 11A Camera-side mount 11B Electrical Contact 11C Front 12 imaging lenses 12A lens-side mount 12B Electrical Contact 13 Dials 14. Release button 15 displays 17 Finder 20 Imaging sensors 20A light receiving surface 20B Imaging area 30 objective lenses 31 Focus Lens 32 Rear lens 33 aperture 34 Lens drive control unit 40 processors 41 Image Processing Unit 42 Operation section 44. Motion detection sensor 45 memory 45A Operating Program 50 Main control unit 51 Imaging control unit 52 Mechanical Vibration Isolation Control Unit 53 Electronic Vibration Isolation Control Unit 54 Image stabilization control unit 61 Correction amount calculation section 61A Subtractor 61B HPF 61C Multiplier 61D Integrator 62 Condition judgment section RA recording area TD time TR return time

Claims

1. It has a processor, The aforementioned processor, Displacement information, including the direction and magnitude of the displacement, and position information of the moving object for shake correction are obtained. If the displacement information satisfies predetermined conditions and the position of the object being moved is not at a predetermined position, the correction amount for the object being moved is determined using a second correction function instead of the first correction function, the second correction function having a shorter return time to the predetermined position of the object being moved than the first correction function. Imaging device.

2. The aforementioned predetermined conditions include the completion of the panning or tilting operation and the elapsed of a predetermined time. The imaging apparatus according to claim 1.

3. During panning or tilting operations, the processor determines the correction amount using the first correction function. The imaging apparatus according to claim 2.

4. The processor returns the second correction function to the first correction function when the moving object returns to the predetermined position. The imaging apparatus according to claim 2.

5. The aforementioned predetermined conditions include being in the middle of a panning or tilting operation. The imaging apparatus according to claim 1.

6. The aforementioned predetermined conditions include the completion of the displacement associated with the user's intended action, or the continuation of the displacement associated with the user's intended action for a certain period of time. The imaging apparatus according to claim 1.

7. The aforementioned predetermined conditions include the determination that the imaging device is stationary. The imaging apparatus according to claim 1.

8. The processor continues to use the second correction function even after the moving object returns to the predetermined position, and if the displacement exceeds a predetermined threshold, it reverts the second correction function back to the first correction function. The imaging apparatus according to claim 7.

9. Both the first and second correction functions are functions whose correction strength decreases as the position of the moving object moves away from the predetermined position. The imaging apparatus according to claim 1.

10. The first correction function is a function in which the correction strength decreases as the position of the moving object moves away from the predetermined position, The second correction function has a smaller change in correction intensity depending on the position of the moving object than the first correction function. The imaging apparatus according to claim 1.

11. The aforementioned moving object is, If the image stabilization method is sensor shift type, it is the image sensor. If the image stabilization method is lens shift type, then it is the lens. If the image stabilization method is electronic stabilization, this is the image cropping position. The imaging apparatus according to claim 1.

12. A method for operating an imaging device equipped with a processor, The aforementioned processor, Displacement information, including the direction and magnitude of the displacement, and position information of the moving object for image stabilization are obtained. If the displacement information satisfies predetermined conditions and the position of the object being moved is not at a predetermined position, the correction amount for the object being moved is determined using a second correction function instead of the first correction function, the second correction function having a shorter return time to the predetermined position of the object being moved than the first correction function. How to operate the imaging device.

13. An operating program for an imaging device equipped with a processor, To acquire displacement information including the direction and magnitude of the displacement, and position information of the moving object for image stabilization. If the displacement information satisfies predetermined conditions and the position of the object to be moved is not at a predetermined position, the correction amount of the object to be moved is determined by using a second correction function, instead of the first correction function, which has a shorter return time to the predetermined position of the object to be moved than the first correction function. An operating program for an imaging device that causes the processor to perform a process including the above.

Images