Signal processing device, imaging device, and lens device

The signal processing device addresses offset removal in shake detection sensors by extracting and integrating features to calculate and subtract offsets, ensuring accurate camera shake correction despite sensor and environmental variations.

JP7577118B2Active Publication Date: 2024-11-01FUJIFILM CORP
View PDF 9 Cites 0 Cited by

Patent Information

Application Number
JP2022518020
Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
Priority Date
2020-04-28
Filing Date
2021-04-23
Publication Date
2024-11-01
Estimated Expiration
2041-04-23

AI Technical Summary

Technical Problem

Existing signal processing devices struggle to accurately remove offsets from the output signals of shake detection sensors, which leads to errors in camera shake correction due to individual sensor differences and environmental variations.

Method used

A signal processing device that utilizes a processor to extract first and second features from the shake detection sensor output, integrates the signal, calculates an offset based on these features, and subtracts it to accurately remove the offset, incorporating a storage unit to store and update the offset values.

Benefits of technology

The solution enables precise removal of offsets, ensuring accurate camera shake correction by using a combination of feature extraction and subtraction processes, effectively handling sensor variations and environmental changes.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007577118000001
    Figure 0007577118000001
  • Figure 0007577118000002
    Figure 0007577118000002
  • Figure 0007577118000003
    Figure 0007577118000003
Patent Text Reader

Abstract

Provided are a signal processing device, a signal processing method, a signal processing program, an image-capturing device, and a lens device which can accurately remove an offset from an output signal from a blur detection sensor. The present invention comprises a blur detection sensor and a processor, wherein the processor executes: a process for extracting a first feature amount pertaining to an offset from an output signal from the blur detection sensor; a process for integrating the output signal; a process for extracting a second feature amount pertaining to the offset from the value obtained by integrating the output signal; and a process for calculating the offset on the basis of the first feature amount and the second feature amount; and a process for subtracting the calculated offset from the output signal.
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present invention relates to a signal processing device. , taken Signal processing device for processing output signals from a motion detection sensor, particularly a lens device , taken The present invention relates to an imaging device and a lens device. [Background technology]

[0002] When an offset exists in the output signal of the shake detection sensor, a process is carried out to remove the offset from the output signal (for example, see Patent Documents 1 and 2). [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2008-283443 A [Patent Document 2] JP 2018-197772 A Summary of the Invention

[0004] One embodiment of the technology disclosed herein is a signal processing device capable of accurately removing an offset from an output signal of a shake detection sensor. , taken An imaging system and a lens system are provided. [Means for solving the problem]

[0005] (1) A signal processing device comprising a shake detection sensor and a processor, the processor executing a process of extracting a first feature related to an offset from an output signal of the shake detection sensor, a process of integrating the output signal, a process of extracting a second feature related to the offset from a value obtained by integrating the output signal, a process of calculating an offset based on the first feature and the second feature, and a process of subtracting the calculated offset from the output signal.

[0006] (2) A signal processing device according to (1), wherein the processor defines, as the second feature, an amount calculated from the slope of the cumulative integral value of the output signal.

[0007] (3) A signal processing device according to (1) or (2), wherein the processor defines the amount of DC components calculated from the output signal as the first characteristic amount.

[0008] (4) A signal processing device according to any one of (1) to (3), further comprising a memory unit for storing the calculated offset, wherein the processor stores the calculated offset in the memory unit based on the first feature and the second feature, and executes a process of subtracting the stored offset from the output signal.

[0009] (5) A signal processing device according to any one of (1) to (4), wherein the processor further executes a process of calculating an absolute value of a difference between a first feature and a second feature, and a process of measuring a time during which the absolute value of the difference between the first feature and the second feature becomes equal to or less than a first threshold, and a process of storing an offset when the time during which the state becomes equal to or less than the first threshold becomes equal to or greater than a second threshold.

[0010] (6) Any one of the signal processing devices (1) to (5), wherein the processor calculates half the sum of the first feature amount and the second feature amount as the offset.

[0011] (7) A signal processing device according to any one of (1) to (6), wherein the processor further executes a process of calculating an amount of change in the second feature, and when the calculated amount of change in the second feature exceeds a third threshold, initializes a process relating to the calculation of the offset.

[0012] (8) A signal processing device according to any one of (1) to (7), wherein the processor further executes a process of determining a stationary state based on the output signal, and if the stationary state is determined, executes a process related to calculating an offset.

[0013] (9) The signal processing device according to any one of (4) to (8), wherein the processor further executes a process of acquiring information on the temperature at which the offset is calculated, and stores the calculated offset for each temperature.

[0014] (10) An imaging device comprising: a shake detection sensor provided in a device body; and a signal processing device according to any one of (1) to (9) for processing an output signal from the shake detection sensor.

[0015] (11) A lens device comprising: a shake detection sensor provided in a device body; and a signal processing device according to any one of (1) to (9) for processing an output signal from the shake detection sensor.

[0016] (12) A signal processing method for processing an output signal of a shake detection sensor, comprising: a step of extracting a first feature related to an offset from the output signal; a step of integrating the output signal; a step of extracting a second feature related to the offset from a value obtained by integrating the output signal; a step of calculating an offset based on the first feature and the second feature; and a step of subtracting the calculated offset from the output signal.

[0017] (13) A signal processing program for processing an output signal of a shake detection sensor, the signal processing program causing a computer to execute the following processes: extracting a first feature related to an offset from the output signal; integrating the output signal; extracting a second feature related to the offset from the integrated value of the output signal; calculating an offset based on the first feature and the second feature; and subtracting the calculated offset from the output signal. [Brief description of the drawings]

[0018] [Figure 1] Block diagram showing the schematic configuration of a digital camera [Diagram 2] Conceptual diagram of correction lens movement [Diagram 3] FIG. 1 is a diagram showing a schematic configuration of a correction lens driving unit; [Figure 4] FIG. 2 is a diagram showing a schematic configuration of a first detection unit and a second detection unit; [Diagram 5] Block diagram of functions realized by the system control unit regarding image stabilization control [Figure 6] Block diagram of the offset correction unit [Figure 7] Block diagram of functions of a first correction amount calculation unit [Figure 8] Block diagram of functions of the second offset calculation unit [Figure 9] A conceptual diagram of a process for extracting second features performed by a second feature extraction unit. [Figure 10] Block diagram of functions of a second offset calculation unit [Figure 11] FIG. 1 is a conceptual diagram of a calculation process of a second offset performed by a second offset calculation unit; [Figure 12] 1 is a flowchart showing a procedure for image stabilization control. [Figure 13] A flowchart showing a procedure for calculating a second offset. [Figure 14] FIG. 13 is a diagram showing an example of an output signal of a gyro sensor in a stationary state; [Figure 15] FIG. 11 is a diagram showing the extraction result of the first feature amount. [Figure 16] A diagram showing the calculation results of integral values [Figure 17] A diagram showing the changes over time of the first and second features [Figure 18] FIG. 13 is a diagram showing an example of an output signal of a gyro sensor when a momentary vibration occurs in a stationary state. [Figure 19] FIG. 11 is a diagram showing the extraction result of the first feature amount. [Figure 20] A diagram showing the calculation results of integral values [Figure 21] A diagram showing the changes over time of the first and second features [Figure 22] FIG. 13 is a diagram showing an example of an output signal of a gyro sensor in a stationary state; [Figure 23] FIG. 11 is a diagram showing the extraction result of the first feature amount. [Figure 24] A diagram showing the calculation results of integral values [Diagram 25] A diagram showing the changes over time of the first and second features [Figure 26] FIG. 13 is a diagram showing the estimation accuracy of the offset calculated by the method of the present invention. [Figure 27] Block diagram of main functions involved in the calculation of the second offset [Figure 28] FIG. 13 is a diagram showing an example of an output signal of a gyro sensor when the offset changes midway in a stationary state; [Figure 29] FIG. 29 is a diagram showing a result of extracting a first feature amount from an output signal of the gyro sensor shown in FIG. 28. [Diagram 30] FIG. 29 is a diagram showing a result of integrating the output signal of the gyro sensor shown in FIG. 28. [Diagram 31] A diagram showing the changes over time of the first and second features [Diagram 32] Block diagram of functions of the second offset calculation unit [Diagram 33] 1 is a flowchart showing a procedure of a determination process performed by an initialization determination unit. [Diagram 34] A diagram showing the extraction results of the first feature when the cutoff frequency is changed stepwise. [Diagram 35] A diagram showing the changes over time in the first and second features when the first feature is extracted by gradually switching the cutoff frequency. [Diagram 36] Block diagram of functions of the second offset calculation unit [Figure 37] Block diagram of the function related to offset correction when performing offset correction according to temperature [Figure 38] 1 is a flowchart showing a procedure for updating a second offset according to temperature. [Figure 39] 1 is a flowchart showing a procedure for processing offset correction according to temperature. [Diagram 40] 11 is a flowchart showing a procedure of a process for calculating a second offset when the power is turned off. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0019] Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.

[0020] [First embodiment] Here, an example will be described in which a gyro sensor detects the shake (vibration) of a digital camera body equipped with an image stabilization function (also called an image blur correction function). A digital camera is an example of an imaging device. A gyro sensor is an example of a shake detection sensor.

[0021] When detecting shake with a gyro sensor, the amount of shake (angular shake) is found by integrating the output signal (angular velocity signal) of the gyro sensor. However, the output signal of the gyro sensor contains an error called an offset. An offset is a reference value deviation (zero point deviation) that prevents the output signal from becoming 0 even when the angular velocity is 0 [deg / s]. If the amount of shake is calculated with the output signal including an offset, an error occurs in the amount of shake, making it impossible to perform correct correction. Therefore, it is necessary to remove the offset from the output signal of the gyro sensor. However, the offset varies from gyro sensor to gyro sensor, and also varies depending on the environmental temperature and changes over time, so it cannot be removed with a fixed value. Therefore, when detecting shake with a gyro sensor, it is important to determine and remove the offset as accurately as possible.

[0022] [Digital camera configuration] FIG. 1 is a block diagram showing a schematic configuration of a digital camera.

[0023] Digital camera 1 of this embodiment is a digital camera equipped with a so-called lens-shift type image stabilization function. A lens-shift type image stabilization mechanism corrects camera shake by moving a correction lens provided in an imaging optical system.

[0024] As shown in FIG. 1, the digital camera 1 includes an imaging optical system 10, an angular velocity detection unit 20, an image sensor 30, a main memory unit 40, a digital signal processing unit 41, an auxiliary memory unit 42, a display unit 43, an operation unit 44, and a system control unit 50.

[0025] The imaging optical system 10 includes a zoom lens 11, a focus lens 12, a correction lens 13, and an aperture 14.

[0026] The zoom lens 11 is a lens for adjusting the focal length. The focal length of the imaging optical system 10 is adjusted by moving the zoom lens 11 back and forth along the optical axis. The zoom lens 11 is driven by a zoom lens driving unit 15 to operate.

[0027] The focus lens 12 is a lens for adjusting focus. The focus of the imaging optical system 10 is adjusted by moving the focus lens 12 back and forth along the optical axis. The focus lens 12 is driven by a focus lens driver 16 to operate.

[0028] The correction lens 13 is a lens for correcting camera shake. The correction lens 13 moves within a plane perpendicular to the optical axis to correct camera shake.

[0029] FIG. 2 is a conceptual diagram of the movement of the correction lens.

[0030] The optical axis is the z-axis, the axis perpendicular to the z-axis is the x-axis, and the axis perpendicular to the z-axis and x-axis is the y-axis. The x-axis is the horizontal (horizontal) axis. The y-axis is the vertical (vertical) axis. The correction lens 13 moves along a plane (xy plane) defined by the x-axis and y-axis. This plane (xy plane) is parallel to the light receiving surface of the image sensor 30.

[0031] When correcting camera shake, the correction lens 13 is moved in a direction to cancel out the shake. The correction lens 13 is driven by a correction lens drive unit 17 to operate.

[0032] FIG. 3 is a diagram showing a schematic configuration of the correction lens driving unit.

[0033] The correction lens driver 17 has a first driver 17x and a second driver 17y. The first driver 17x moves the correction lens 13 along the x-axis. The second driver 17y moves the correction lens 13 along the y-axis.

[0034] The diaphragm 14 is, for example, an iris diaphragm. The amount of light passing through the imaging optical system 10 is adjusted by the diaphragm 14. The diaphragm 14 is driven by a diaphragm driver 18 to operate.

[0035] 2, the angular velocity detection unit 20 includes a first detection unit 20A and a second detection unit 20B. The first detection unit 20A detects the angular velocity of the digital camera body (device body) in the yaw direction Yaw. The second detection unit 20B detects the angular velocity of the digital camera body in the pitch direction Pit.

[0036] Here, the yaw direction Yaw is the rotation direction around the y axis as shown in Fig. 2. The yaw direction Yaw is the horizontal (lateral) rotation direction in the digital camera body.

[0037] Moreover, the pitch direction Pit is the rotation direction around the x-axis as shown in Fig. 2. The pitch direction Pit is the rotation direction in the vertical direction (lengthwise direction) in the digital camera body.

[0038] FIG. 4 is a diagram showing a schematic configuration of the first detection unit and the second detection unit.

[0039] The first detection unit 20A and the second detection unit 20B each include a gyro sensor 21A, 21B and an ADC (Analog to Digital Converter) 22A, 22B. The signals (angular velocity signals) output from the gyro sensors 21A, 21B are converted into digital signals by the ADCs 22A, 22B and input to the system control unit 50.

[0040] The image sensor 30 is, for example, a CMOS (Complementary Metal Oxide Semiconductor) MetalThe image sensor 30 is configured with a color image sensor of a photodiode (Pb-oxide semiconductor) type. In the digital camera 1 of this embodiment, the image sensor 30 is configured to include a drive section, an ADC (Analog to Digital Converter), a signal processing section, and the like. In this case, the image sensor 30 is driven by the built-in drive section to operate. The signal of each pixel is converted into a digital signal by the built-in ADC. Furthermore, the signal of each pixel is subjected to processes such as correlated double sampling, gain processing, and correction processing by the built-in signal processing section. The signal processing can be configured to be performed on the analog signal of each pixel, or can be configured to be performed on the digital signal of each pixel.

[0041] The imaging element 30 can be configured with an image sensor of an XY address type, a CCD (Charged Coupled Device) type, or the like, in addition to a CMOS type image sensor.

[0042] The main storage unit 40 is used as a temporary storage area for data. The signal (image signal) output from the imaging element 30 is stored in the main storage unit 40 for each frame. The main storage unit 40 is formed of, for example, a semiconductor memory.

[0043] The digital signal processing unit 41 performs signal processing such as offset processing, gamma correction processing, demosaic processing, RGB / YCrCb conversion processing, etc. on the image signal obtained by imaging to generate image data. The digital signal processing unit 41 is formed of, for example, a microprocessor.

[0044] The auxiliary storage unit 42 functions as a storage unit for various data. The auxiliary storage unit 42 is composed of a non-volatile semiconductor memory such as an EEPROM (Electrically Erasable Programmable Read-only Memory). The data recorded in the auxiliary storage unit 42 includes image data obtained by shooting, as well as data required for control (for example, offset information, which will be described later).

[0045] The display unit 43 is used as a monitor for playing back captured images, and is also used as a monitor for live view, displaying live view images during image capture. It is also used as a monitor for settings when performing various settings. The display unit 43 is configured with a display such as an LCD (Liquid Crystal Display) or an OLED (Organic Light Emitting Diode).

[0046] The operation unit 44 is configured to include various operation members for operating the digital camera 1. The operation members include a power button, a shutter button, and various other operation buttons. If the display unit 43 is configured with a touch panel, the operation members constituting the operation unit 44 include the touch panel. The operation unit 44 outputs a signal according to the operation of each operation member to the system control unit 50.

[0047] The system control unit 50 performs overall control of the digital camera 1. The system control unit 50 also calculates various physical quantities necessary for control. The system control unit 50 is configured, for example, by a microcomputer equipped with a processor and a memory. The processor is configured, for example, by a CPU (Central Processing Unit) or the like. The memory is configured, for example, by a RAM (Ramdom Access Memory) and a ROM (Read Only Memory) or the like. The memory stores programs executed by the processor (for example, signal processing programs, etc.) and various data. The control performed by the system control unit 50 includes control of image stabilization.

[0048] [System configuration for image stabilization control] FIG. 5 is a block diagram of functions implemented by the system control unit regarding control of image stabilization.

[0049] As shown in the figure, the system control unit 50 functions as offset correction units 60A, 60B, a first correction amount calculation unit 70A, a second correction amount calculation unit 70B, a first drive control unit 80A, a second drive control unit 80B, second offset calculation units 100A, 100B, and second offset storage control units 110A, 110B, etc., with regard to the control of image stabilization. These functions are realized by a processor constituting the system control unit 50 executing a predetermined control program.

[0050] The offset correction unit 60A performs a process (offset correction process) for removing an offset from the signal (angular velocity signal in the yaw direction) output from the first detection unit 20A, based on the information stored in the offset storage unit 90A.

[0051] FIG. 6 is a block diagram of functions of the offset correction unit.

[0052] As shown in the figure, the offset correction section 60A has the functions of a first subtraction section 60A1 and a second subtraction section 60A2.

[0053] The first subtraction unit 60A1 subtracts a first offset from the output signal of the first detection unit 20A. The first offset is a standard offset and is a fixed value. The first offset is set, for example, at the time of shipment from the factory. In this case, for example, the offset is detected at the time of shipment from the factory, and the detected offset is set as the first offset.

[0054] The second subtraction unit 60A2 subtracts a second offset from the signal after the first offset has been subtracted. The second offset is the latest offset. The second offset is an example of an offset of the present invention. The second offset is calculated by the second offset calculation unit 100A. The second offset calculation unit 100A calculates the second offset based on the signal after the first offset has been subtracted. Details of the second offset calculation unit 100A will be described later.

[0055] The offset storage unit 90A is configured with the auxiliary storage unit 42. The offset storage unit 90A stores information on the first offset and the second offset used by the offset correction unit 60A. Information on the second offset calculated by the second offset calculation unit 100A is stored in the offset storage unit 90A by the second offset storage control unit 110A. The offset storage unit 90A is an example of a storage unit.

[0056] The offset correction unit 60B performs a process of removing an offset from the signal (angular velocity signal in the pitch direction) output from the second detection unit 20B based on the information stored in the offset storage unit 90B. The configuration of the offset correction unit 60B is the same as that of the offset correction unit 60A. Therefore, a detailed description thereof will be omitted.

[0057] The offset memory unit 90B is configured with the auxiliary memory unit 42. The offset memory unit 90B stores information on the first offset and the second offset used by the offset correction unit 60B. The second offset is calculated by the second offset calculation unit 100B. The second offset calculation unit 100B calculates the second offset based on the signal from which the first offset has been subtracted. Information on the calculated second offset is stored in the offset memory unit 90B by the second offset storage control unit 110B. The offset memory unit 90B is an example of a memory unit.

[0058] In this embodiment, the configuration including the offset correction units 60A and 60B, the second offset calculation units 100A and 100B, the second offset storage control units 110A and 110B, and the offset storage units 90A and 90B is an example of a signal processing device.

[0059] The first correction amount calculation unit 70A calculates the correction amount in the x-axis direction of the correction lens 13 based on the yaw direction angular velocity signal after the offset has been removed by the offset correction unit 60A. In other words, it calculates the movement amount in the x-axis direction of the correction lens 13 for correcting shake in the yaw direction.

[0060] FIG. 7 is a block diagram of functions of the first correction amount calculation unit.

[0061] As shown in the figure, the first correction amount calculation section 70A has the functions of a high-pass filter (HPF) 71A, a sensitivity correction section 72A, an integration section 73A, and a correction amount calculation section 74A.

[0062] The high-pass filter 71A performs processing to remove low-frequency components from the yaw-direction angular velocity signal after the offset has been removed.

[0063] The sensitivity correction unit 72A multiplies the angular velocity signal after the high-pass filter process by the high-pass filter 71A by the sensitivity. The sensitivity is a unitless coefficient that is uniquely determined using the focus lens position and the focal length (zoom lens position) as variables. Therefore, if the focus lens position and focal length change from moment to moment, the sensitivity also changes from moment to moment.

[0064] The integrator 73A integrates the angular velocity signal after the sensitivity has been corrected by the sensitivity corrector 72A, thereby calculating the amount of shaking in the yaw direction.

[0065] Correction amount calculation section 74A calculates the correction amount in the x-axis direction of correction lens 13 based on the amount of shake in the yaw direction calculated by integration section 73A. In other words, it calculates the amount of movement in the x-axis direction of correction lens 13 that is necessary to offset the shake in the yaw direction.

[0066] The second correction amount calculation unit 70B calculates the correction amount in the y-axis direction of the correction lens 13 based on the pitch-direction angular velocity signal after the offset has been removed by the offset correction unit 60B. That is, it calculates the amount of movement in the y-axis direction of the correction lens 13 required to offset the shake in the pitch direction. The configuration of the second correction amount calculation unit 70B is the same as the configuration of the first correction amount calculation unit 70A. Therefore, detailed explanations thereof will be omitted.

[0067] The first drive control unit 80A controls the drive of the first drive unit 17x to control the movement in the x-axis direction of the correction lens 13. The first drive control unit 80A controls the drive of the first drive unit 17x based on the correction amount in the x-axis direction of the correction lens 13 calculated by the first correction amount calculation unit 70A.

[0068] The second drive control unit 80B controls the driving of the second drive unit 17y to control the movement in the y-axis direction of the correction lens 13. The second drive control unit 80B controls the driving of the second drive unit 17y based on the correction amount in the y-axis direction of the correction lens 13 calculated by the second correction amount calculation unit 70B.

[0069] The control of the image stabilization is executed in the following procedure. First, the offset correction units 60A and 60B perform a process of removing the offset from the signals (angular velocity signals) output from the first detection unit 20A and the second detection unit 20B. Next, the first correction amount calculation unit 70A and the second correction amount calculation unit 70B calculate the correction amounts in the x-axis direction and the y-axis direction of the correction lens 13 based on the signals from which the offset has been removed. Next, the first drive unit 17x and the second drive unit 17y are driven by the first drive control unit 80A and the second drive control unit 80B based on the calculated correction amounts. As a result, the correction lens 13 is moved so as to cancel out the shake, and the image stabilization is corrected.

[0070] [Second offset calculation section] As described above, the second offset is calculated by the second offset calculation units 100A and 100B. The functions of the second offset calculation units 100A and 100B are described below. The second offset calculation units 100A and 100B have the same configuration. Therefore, only the second offset calculation unit 100A will be described here, and a description of the second offset calculation unit 100B will be omitted.

[0071] FIG. 8 is a block diagram of functions included in the second offset calculation unit.

[0072] As shown in the figure, the second offset calculation section 100A has the functions of a first feature amount extraction section 101A, an integration section 102A, a second feature amount extraction section 103A, and a second offset calculation section 104A.

[0073] The first feature extraction unit 101A performs a process of extracting a first feature related to the second offset from the output signal of the first detection unit 20A after the first offset has been removed. Specifically, the first feature extraction unit 101A performs a process of calculating a direct current (DC) component amount from the output signal of the first detection unit 20A after the first offset has been removed, and outputs the calculated direct current component amount as the first feature amount. The first feature extraction unit 101A calculates the direct current component amount, which is the first feature amount, by performing low-pass filter (LPF) or band-pass filter (BPF) processing on the output signal of the first detection unit 20A after the first offset has been removed. This point will be described below.

[0074] Let f(t) be the random noise generated by the gyro sensor, g(t) be the angular velocity signal generated by the gyro sensor, and O be the offset (constant) generated by the gyro sensor. The output ω_OUT from the gyro sensor is expressed by the following equation (1).

[0075] ω_OUT=f(t)+O+g(t)…(1) The offset O generated by the gyro sensor is the first characteristic quantity to be determined. Since the offset O is a DC component, the components f(t) and g(t) can be removed by applying a low-pass filter or a band-pass filter to the above formula (1). Therefore, the first characteristic quantity can be extracted by applying a low-pass filter process or a band-pass filter process to the output signal of the first detection unit 20A after the first offset is removed.

[0076] The integrating section 102A performs a process of integrating the output signal of the first detecting section 20A after the first offset has been removed, and an angle signal is obtained by this process.

[0077] The angle signal deg_out is calculated by integrating the above equation (1) using the following equation (2).

[0078] deg_out = ∫(ω_OUT)dt =∫(g(t))dt+∫(f(t))dt+Ot+C…(2) C: Integral constant The second feature extraction unit 103A performs a process of extracting a second feature related to the offset from the output of the integrator 102A. That is, the second feature is extracted from a value (angle signal) obtained by integrating the output signal of the first detector 20A. Specifically, the second feature is calculated as the second feature by calculating the slope of the cumulative integral from the output of the integrator 102A. For example, the second feature extraction unit 103A obtains a linear approximation curve of the cumulative integral, calculates the slope, and extracts the second feature. That is, according to the above formula (2), if Ot>>∫(g(t))dt+∫(f(t))dt after a sufficient time has passed, it is possible to estimate the offset O from the slope of the linear approximation curve of deg_out.

[0079] FIG. 9 is a conceptual diagram of the extraction process of the second feature amount performed by the second feature amount extraction unit.

[0080] Let ∫(g(t))dt = G[t], ∫(f(t))dt = F[t], and the integral value be deg_out[t], then the integral value deg_out[t] is deg_out[t] ≒ G[t] + F[t] + Ot.

[0081] The initial value is the integral value when starting the calculation of the second feature amount (the slope of the cumulative integral value). The initial value is deg_out[0].

[0082] The timer count is incremented by 1 every control period.Then, it is multiplied by the control period (Ts) [s].

[0083] Time_out = time_count * (Ts) If the second feature amount (slope of the cumulative integral value) is O2, O2 is calculated by the following formula.

[0084] O2=(deg_out[t]-deg_out[0]) / Time_out The second offset calculation unit 104A calculates the second offset based on the first feature amount and the second feature amount extracted by the first feature amount extraction unit 101A and the second feature amount extraction unit 103A. Specifically, it is determined whether the first feature amount and the second feature amount satisfy a certain condition, and if the condition is satisfied, it calculates 1 / 2 of the sum of the two as the second offset. In other words, it calculates the arithmetic mean of the two as the second offset. The condition that the first feature amount and the second feature amount should satisfy is that the absolute value of the difference between the first feature amount and the second feature amount is equal to or less than a threshold value, and the state of being equal to or less than the threshold value continues for a specified time or more.

[0085] FIG. 10 is a block diagram of functions included in the second offset calculation unit.

[0086] As shown in the figure, second offset calculation section 104A has the functions of difference calculation section 104A1, determination section 104A2, and calculation section 104A3.

[0087] The difference calculation section 104A1 calculates the absolute value of the difference between the first feature amount and the second feature amount.

[0088] The determination unit 104A2 determines whether the absolute value of the difference between the first feature amount and the second feature amount calculated by the difference calculation unit 104A1 becomes equal to or less than the threshold value and whether this state continues for a specified time or more. In this case, the determination unit 104A2 first determines whether the absolute value of the difference between the first feature amount and the second feature amount becomes equal to or less than the threshold value. If it is determined that the absolute value is equal to or less than the threshold value, the determination unit 104A2 determines whether the state of being equal to or less than the threshold value continues for a specified time or more. Therefore, when the absolute value of the difference between the first feature amount and the second feature amount becomes equal to or less than the threshold value, the determination unit 104A2 counts (measures) the duration. The threshold value is an example of a first threshold value. The specified time is an example of a second threshold value. The threshold value and the specified time are determined in advance and stored in a memory.

[0089] When the determination unit 104A2 determines that the above condition is satisfied, the calculation unit 104A3 calculates a second offset based on the first feature amount and the second feature amount. Specifically, the calculation unit 104A3 calculates half the sum of the first feature amount and the second feature amount at the time when the determination unit 104A2 determines that the above condition is satisfied, to calculate the second offset.

[0090] FIG. 11 is a conceptual diagram of the calculation process of the second offset performed by the second offset calculation unit.

[0091] The first feature amount extracted by the first feature amount extraction unit 101A is O1, and the second feature amount extracted by the second feature amount extraction unit 103A is O2. threshold Let us assume that.

[0092] First, the absolute value of the difference between the first feature amount O1 and the second feature amount O2 (|O2-O1|) is calculated.

[0093] In counting, |O2-O1| threshold and |O2-O1|≦ threshold If so, increase the count by +1. |O2-O1|> threshold If so, set the count to 0.

[0094] If the count>thresh_time, the second offset is calculated based on the first feature amount O1 and the second feature amount O2 at that time point. That is, the second offset is calculated by executing the following calculation.

[0095] Second offset = (O1 + O2) / 2 When the second offset is calculated, the process related to the calculation of the second offset is initialized (reset). That is, in the first feature extraction unit 101A, the filter process is reset. Also, in the second feature extraction unit 103A, the start position of the calculation is initialized. Specifically, t is returned to 0, and the initial value deg_out[0] is updated.

[0096] Furthermore, when the second offset is calculated, information on the calculated second offset is stored in the offset storage unit 90A by the second offset storage control unit 110A. That is, the information on the second offset stored in the offset storage unit 90A is updated. This keeps the information on the second offset stored in the offset storage unit 90A up to date. The initial value of the second offset stored in the offset storage unit 90A is 0.

[0097] In this manner, in this embodiment, two feature amounts (first feature amount and second feature amount) related to the offset are extracted from the output signal of the first detection unit 20A, and if the two extracted feature amounts satisfy a certain condition, the second offset is obtained from the two feature amounts. That is, if the two feature amounts are almost the same, 1 / 2 of the sum is calculated to obtain the second offset. The determination made by the determination unit 104A2 is to determine whether the first feature amount and the second feature amount are the same. That is, if the absolute value of the difference between the first feature amount and the second feature amount is equal to or less than a threshold value (equal to or less than the first threshold value) and this state continues for a specified time or more (equal to or more than the second threshold value), the first feature amount and the second feature amount are considered to be the same, and the second offset is calculated.

[0098] In this way, the second offset can be calculated accurately by calculating two feature amounts and then calculating the second offset. That is, it is difficult to calculate the second offset accurately using only one feature amount, but the second offset can be calculated accurately by using two feature amounts.

[0099] For example, consider a case where the second offset is calculated from only the first feature amount. In this case, since there is variation in the signal after filtering, it is difficult to accurately estimate the second offset.

[0100] Similarly, consider the case where the second offset is calculated only from the second feature amount. As shown in the above formula (2), the angle signal contains ∫(g(t))dt and ∫(f(t))dt as functions of time t. Therefore, if the second offset (slope of the cumulative integral value) is calculated only from the angle signal, an accurate value may not be calculated due to the effect of the function of time t [∫(g(t))dt+∫(f(t))dt].

[0101] However, if the two values ​​are almost the same, it is considered that they show an accurate offset value. Therefore, by calculating the second offset from the two feature amounts, the second offset can be calculated accurately.

[0102] The first feature is extracted by applying a filter to the output signal (angular velocity signal) of the first detection unit 20A, because applying a filter to the integral value (angle signal) of the output signal of the first detection unit 20A may change the value of the offset O, which is the feature to be obtained.

[0103] [Image stabilization processing] FIG. 12 is a flowchart showing a procedure for the camera shake correction control process.

[0104] When a shake occurs in the digital camera body, the first detection unit 20A and the second detection unit 20B detect an angular velocity corresponding to the amount of shake (step S1). The first detection unit 20A and the second detection unit 20B detect the angular velocities in the yaw direction and the pitch direction using gyro sensors 21A and 21B. The angular velocity signals detected by the gyro sensors 21A and 21B are converted into digital signals by the ADCs 22A and 22B and output.

[0105] First, the first offset is subtracted from the signals output from the first detection unit 20A and the second detection unit 20B (step S2). As described above, the first offset is a standard offset that does not take into account changes over time, etc.

[0106] The signal from which the first offset has been subtracted is then subtracted from which the second offset (step S3). The second offset is the latest offset. In other words, it is an offset that takes into account changes over time, etc. By removing the second offset, an accurate angular velocity signal that reflects the current situation can be obtained.

[0107] The signal from which the first and second offsets have been subtracted is then subjected to high-pass filtering (step S4). The high-pass filtered signal is then multiplied by sensitivity to perform sensitivity correction (step S5). The signal after sensitivity correction is integrated to calculate the amount of shake in the yaw and pitch directions (step S6).

[0108] When the amount of shake in the yaw and pitch directions is calculated, the amount of correction for the x-axis and y-axis directions of the correction lens 13 is calculated based on the calculated amount of shake in each direction (step S7). Based on the calculated amount of correction, the first driving unit 17x and the second driving unit 17y are driven to correct the shake (step S8).

[0109] [Calculation of the second offset] FIG. 13 is a flowchart showing a processing procedure for calculating the second offset.

[0110] First, a first feature amount O1 and a second feature amount O2 are extracted from the output signals of the first detection unit 20A and the second detection unit 20B (steps S11 and S12). Note that the output signals here are output signals after the first offset is removed.

[0111] The first feature amount O1 is extracted by performing a predetermined filter process on the output signals of the first detection unit 20A and the second detection unit 20B. That is, the first feature amount O1 is extracted by performing a low-pass filter process or a band-pass filter process on the output signals of the first detection unit 20A and the second detection unit 20B and calculating the amount of DC components.

[0112] The second characteristic amount O2 is extracted by integrating the output signals of the first detection section 20A and the second detection section 20B and determining the slope of the cumulative integral value.

[0113] Next, the absolute value (|O1-O2|) of the difference between the extracted first feature amount O1 and second feature amount O2 is calculated, and a threshold value ( threshold That is, it is determined whether the absolute value of the difference between the first feature amount O1 and the second feature amount O2 (|O1-O2|) is equal to or smaller than a threshold value (step S13).

[0114] When it is determined that the absolute value of the difference (|O1-O2|) between the first feature amount O1 and the second feature amount O2 is equal to or less than the threshold, the duration is counted (step S14). Then, it is determined whether the counted duration is equal to or greater than a specified time (step S15).

[0115] If it is determined that the state below the threshold has lasted for a specified time or more, the first characteristic amount O1 and the second characteristic amount O2 are deemed to match, and a second offset is calculated (step S16). That is, half the sum of the first characteristic amount O1 and the second characteristic amount O2 at the time when it is determined that the state has lasted for a specified time or more is calculated and used as the value of the second offset.

[0116] When the second offset is calculated, the calculated second offset value is stored in the offset storage units 90A and 90B (step S17). More specifically, the second offset information already stored in the offset storage units 90A and 90B is rewritten. This process updates the second offset information stored in the offset storage units 90A and 90B.

[0117] When the calculated second offset value is stored in the offset storage units 90A and 90B, the process related to the calculation of the second offset is initialized (step S18). That is, the filter process is reset for the calculation of the first feature amount, and the start position of the calculation is initialized for the calculation of the second feature amount.

[0118] The above series of processes are repeated at regular intervals during operation of the digital camera. If the second offset is not calculated during one calculation cycle (if the difference between the first feature amount and the second feature amount does not satisfy the condition), the calculation process is initialized and calculation is performed in the next cycle. In this case, the second offset maintains the value that has already been detected.

[0119] As described above, in the present embodiment, two feature amounts (a first feature amount and a second feature amount) related to the offset are extracted, and the two feature amounts are compared to determine the second offset, so that the second offset can be determined with high accuracy.

[0120] [Example] (1) Example 1 FIG. 14 is a diagram showing an example of an output signal of the gyro sensor in a stationary state.

[0121] The figure shows the output signal of the gyro sensor when the offset is 0.02 [dps]. Note that the unit [dps] stands for "degree per second."

[0122] Fig. 15 is a diagram showing the extraction result of the first feature amount. That is, it shows the result of extracting the DC component amount from the output signal of the gyro sensor shown in Fig. 14. In this example, the cutoff frequency is set to 0.1 [Hz], and low-pass filter processing is performed on the output signal to extract the first feature amount (DC component amount). As shown in the figure, it is difficult to accurately characterize the offset using only the first feature amount.

[0123] Fig. 16 is a diagram showing the calculation result of the integral value. That is, it shows the result of integrating the output signal of the gyro sensor shown in Fig. 14. The angle is calculated by integrating the output signal of the gyro sensor. The unit of angle [deg] means "degree". The second feature amount is calculated by calculating the slope of the graph shown in the figure.

[0124] 17 is a diagram showing changes over time in the first feature amount and the second feature amount. In the figure, the symbol O1 indicates the change over time in the first feature amount. Also, the symbol O2 indicates the change over time in the second feature amount.

[0125] As shown in the figure, it can be confirmed that the offset can be accurately identified by comparing the first feature amount O1 and the second feature amount O2. In other words, it can be confirmed that the offset can be accurately identified by detecting a state in which the two match. The fact that the two match can be determined by detecting that the absolute value of the difference between the two continues to be equal to or less than a threshold value for a specified period of time or more. For example, in FIG. 17, the fact that the two match can be detected by detecting the state of the area S surrounded by the dashed line.

[0126] (2) Example 2 Here, we verify whether or not the offset can be accurately detected even when momentary vibration occurs.

[0127] FIG. 18 is a diagram showing an example of an output signal of the gyro sensor when a momentary vibration occurs in a stationary state.

[0128] The figure shows the output signal of the gyro sensor when the offset is 0.02 [dps].

[0129] Fig. 19 is a diagram showing the extraction result of the first feature amount. That is, it shows the result of extracting the DC component amount from the output signal of the gyro sensor shown in Fig. 18. As in Example 1, the cutoff frequency was set to 0.1 [Hz], and the output signal was subjected to low-pass filtering to extract the first feature amount. As shown in the figure, it is difficult to accurately characterize the offset using only the first feature amount.

[0130] Fig. 20 is a diagram showing the calculation result of the integral value. That is, it shows the result of integrating the output signal of the gyro sensor shown in Fig. 14. The second feature amount is calculated by calculating the slope of the graph shown in the figure.

[0131] 21 is a diagram showing changes over time in the first feature amount and the second feature amount. In the figure, the symbol O1 indicates the change over time in the first feature amount. Also, the symbol O2 indicates the change over time in the second feature amount.

[0132] As shown in the figure, even if a momentary vibration occurs, it can be confirmed that the offset can be accurately identified by comparing the first feature amount O1 and the second feature amount O2. In other words, it can be confirmed that the offset can be accurately identified by detecting a state in which the two match. In this example, for example, it can be detected that the two match by detecting the state of the area S surrounded by the dashed line.

[0133] (3) Example 3 Here, the effect of the cutoff frequency when extracting the first feature amount will be examined.

[0134] FIG. 22 is a diagram showing an example of an output signal of the gyro sensor in a stationary state.

[0135] The figure shows the output signal of the gyro sensor when the offset is 0.02 [dps]. The difference from the output signal in the first embodiment is the output period of the signal. While the first embodiment shows an output signal for a period of 10 [s], this embodiment shows an output signal for a period of 60 [s].

[0136] FIG. 23 is a diagram showing the extraction result of the first feature amount. That is, it shows the result of extracting the DC component amount from the output signal of the gyro sensor shown in FIG. 22. In this example, the cutoff frequency is set to 0.01 [Hz], and the output signal is subjected to low-pass filter processing to extract the first feature amount. That is, compared to Example 1, the cutoff frequency is lowered to extract the first feature amount. As shown in the figure, by lowering the cutoff frequency, the first feature amount smoothly converges. On the other hand, it can be seen that it takes time for the convergence.

[0137] Fig. 24 is a diagram showing the calculation result of the integral value. That is, it shows the result of integrating the output signal of the gyro sensor shown in Fig. 22. The second feature amount O2 is calculated by calculating the slope of the graph shown in the figure.

[0138] 25 is a diagram showing changes over time in the first feature amount and the second feature amount. In the figure, the symbol O1 indicates the change over time in the first feature amount. Also, the symbol O2 indicates the change over time in the second feature amount.

[0139] As shown in the figure, when the cutoff frequency is lowered, it takes time for the first feature amount to converge, and as a result, it takes time to detect a state in which the first feature amount O1 and the second feature amount O2 match.

[0140] Comparing Example 1 and Example 3, it is apparent that increasing the cutoff frequency is effective in quickly detecting a matching state between the first feature amount and the second feature amount.

[0141] On the other hand, if the cutoff frequency is increased, it becomes difficult to accurately detect a match state. This can be addressed by optimizing the threshold and the specified time that the state below the threshold must satisfy. To shorten the specified time, set the threshold narrower. To widen the threshold, set the specified time longer.

[0142] (4) Example 4 FIG. 26 is a diagram showing the estimation accuracy of the offset calculated by the method of the present invention.

[0143] The figure shows that the offset is 0.01[dps]~ 0.1 The offset is calculated under the following conditions:

[0144] Cutoff frequency of the low-pass filter when extracting the first feature: 0.1 [Hz] Threshold for the absolute value of the difference between the first feature and the second feature: 0.001 [dps] Duration of state below threshold (prescribed time): 10 [ms] As shown in the figure, it can be confirmed that the offset can be calculated with an error of less than 0.001 [dps].

[0145] [Second embodiment] In the digital camera of this embodiment, a stationary state of the digital camera body is detected, and when a stationary state is detected, a calculation process of the second offset is executed.

[0146] FIG. 27 is a block diagram of main functions related to calculation of the second offset.

[0147] As shown in the figure, the digital camera according to the first embodiment differs from the digital camera according to the first embodiment in that it further includes still-state determination units 120A and 120B. The functions of the still-state determination units 120A and 120B are realized by a system control unit 50.

[0148] The still state determination units 120A and 120B determine the still state based on the output signals of the first detection unit 20A and the second detection unit 20B. That is, they determine whether the digital camera body is still or not. In this embodiment, the offset correction units 60A and 60B perform low-pass filter processing or band-pass filter processing on the output signals of the first detection unit 20A and the second detection unit 20B after the first offset has been subtracted, thereby determining the still state. That is, they detect that the signals after the filter processing have been below a threshold for a certain period of time, and determine that the digital camera is still.

[0149] When the stationary state is determined by the stationary state determination units 120A and 120B, the second offset calculation units 100A and 100B execute a calculation process of a second offset.

[0150] In this way, when it is determined that the vehicle is in a stationary state, the process related to the calculation of the second offset is executed, whereby the second offset can be calculated stably.

[0151] It is also possible to configure the device to execute the storage process when the device is determined to be in a stationary state. That is, the device can be configured to constantly execute the calculation process of the second offset, and to store (update) the calculated second offset in the offset storage units 90A and 90B when the device is determined to be in a stationary state. In this case, it is preferable to initialize (reset) the process related to the calculation of the second offset and start the calculation when the device is determined to be in a stationary state.

[0152] [Variations] The second offset calculation process may be always performed, and when it is determined that the vehicle is in a stationary state, the cutoff frequency of the low-pass filter used to extract the first feature may be switched to perform the second offset calculation process. For example, in a normal (non-stationary state), the first feature extraction unit performs low-pass filter processing at the first cutoff frequency to extract the first feature. On the other hand, when it is determined that the vehicle is in a stationary state, the low-pass filter processing is performed at a second cutoff frequency higher than the first cutoff frequency to extract the first feature. When it is determined that the vehicle is in a stationary state, a stable signal is output, so that the first feature can be stably extracted even if the cutoff frequency is set to a high frequency. This allows the second offset to be calculated earlier.

[0153] [Third embodiment] The offset may change during the calculation of the offset. For example, if the digital camera receives an impact due to being dropped, the offset may change. Here, we will explain how to deal with the case where the offset changes for some reason during the calculation of the offset.

[0154] FIG. 28 is a diagram showing an example of an output signal of the gyro sensor when the offset changes midway in a stationary state.

[0155] The figure shows the output signal of the gyro sensor when the offset changes from 0.02 [dps] to 0.04 [dps] midway in a stationary state.

[0156] Fig. 29 is a diagram showing the result of extracting the first feature from the output signal of the gyro sensor shown in Fig. 28. In this example, the cutoff frequency is set to 0.1 [Hz], and the output signal is subjected to low-pass filtering to extract the first feature. As shown in the figure, when the offset changes midway, it can be seen that the signal gradually converges toward the offset after the change.

[0157] FIG. 30 is a diagram showing the result of integrating the output signal of the gyro sensor shown in FIG. 28. As shown in the figure, if the offset changes midway, the inclination also changes midway. As described above, the second feature amount O2 is calculated by O2=(deg_out[t]-deg_out[0]) / Time_out. Therefore, if the inclination changes midway, the second feature amount cannot be calculated accurately.

[0158] 31 is a diagram showing changes over time in the first feature amount and the second feature amount. In the figure, symbol O1 indicates changes over time in the first feature amount. Symbol O2 indicates changes over time in the second feature amount. As shown in the figure, if the offset changes midway, the second feature amount O2 cannot be calculated accurately.

[0159] Therefore, if the offset changes during the offset calculation, it is preferable to initialize the process related to the offset calculation at that point in time and redo the offset calculation process.

[0160] In the digital camera of this embodiment, the second offset calculation units 100A and 100B have a calculation initialization function. Note that, except for the fact that the second offset calculation units 100A and 100B have an initialization function, the digital camera is the same as the digital camera of the first or second embodiment. The functions of the two second offset calculation units 100A and 100B are the same. Therefore, only the functions of the second offset calculation unit 100A will be described here.

[0161] FIG. 32 is a block diagram of functions of the second offset calculation unit of the present embodiment.

[0162] As shown in the figure, a second offset calculation section 100A of this embodiment further has a function of an initialization determination section 105A.

[0163] The initialization determination unit 105A determines whether or not initialization of the process related to the calculation of the second offset is required based on the second feature extracted by the second feature extraction unit 103A. The amount of change in the second feature (slope of the cumulative integral value) extracted by the second feature extraction unit 103A is calculated, and if the calculated amount of change exceeds a threshold, the initialization determination unit 105A determines that initialization is required. The amount of change in the second feature is calculated by differentiating the second feature. The initialization determination unit 105A determines that initialization is required if the value obtained by differentiating the second feature exceeds a threshold (third threshold) after being continuously converted within a certain range.

[0164] FIG. 33 is a flowchart showing a procedure of the determination process performed by the initialization determination unit.

[0165] First, the second feature amount extracted by the second feature amount extraction unit 103A is differentiated (step S21), whereby the amount of change in the second feature amount is calculated.

[0166] Next, it is determined whether the calculated derivative value of the second feature amount is equal to or less than a first specified value (step S22). If the calculated derivative value of the second feature amount is equal to or less than the first specified value, the duration is counted (step S23). That is, the time during which the state in which the value is equal to or less than the first specified value continues is counted. Then, it is determined whether the counted duration is equal to or more than a predetermined specified time (step S24). That is, it is determined whether the value has changed continuously within a certain range.

[0167] If it is determined that the state where the second characteristic amount is equal to or less than the first specified value continues for a specified time or longer, it is determined whether the differential value of the second characteristic amount exceeds a second specified value (step S25). The second specified value is an example of a third threshold value.

[0168] The case where the differential value of the second feature exceeds the second specified value means that the amount of change in the second feature is equal to or greater than a threshold value (third threshold value), which means that the offset has changed.

[0169] Therefore, when the differential value of the second feature amount exceeds the second specified value, it is determined that initialization of the process related to the calculation of the second offset is necessary (step S26).

[0170] When the initialization determination unit 105A determines that the initialization of the process related to the calculation of the second offset is necessary, the calculation process of the first feature extraction unit 101A and the second feature extraction unit 103A is initialized. That is, the filter process is reset for the calculation of the first feature. Also, the start position of the calculation is initialized for the calculation of the second feature.

[0171] This makes it possible to prevent the second offset from being updated with an incorrect value even if the offset changes during the calculation of the offset. Also, when the offset changes, the calculation process is immediately initialized and recalculation is started, so that the change can be quickly dealt with.

[0172] In this embodiment, the change in the second offset is detected from the change in the second feature amount, but the method of detecting the change in the second offset is not limited to this. For example, as shown in the graph of Fig. 31, when the offset changes, the values ​​of the first feature amount and the second feature amount change in different ways. Therefore, the change in the offset can be estimated from the change in the two feature amounts.

[0173] [Fourth embodiment] As described above, the first feature quantity converges in a different way depending on the cutoff frequency used for extraction. That is, when the cutoff frequency is lowered, the first feature quantity converges smoothly. On the other hand, the convergence takes time (see FIGS. 15 and 23).

[0174] In the digital camera according to the present embodiment, when extracting the first feature amount, the cutoff frequency is changed in stages, more specifically, the cutoff frequency is lowered in stages to extract the first feature amount.

[0175] Fig. 34 is a diagram showing the extraction result of the first feature amount when the cutoff frequency is switched stepwise. This figure shows an example of the case where the cutoff frequency is switched stepwise for the output signal of the gyro sensor shown in Fig. 14 and the first feature amount is extracted. In this example, the cutoff frequency is lowered stepwise at a certain time interval to extract the first feature amount. Specifically, the cutoff frequency is lowered stepwise in the order of 0.5 [Hz], 0.1 [Hz], 0.05 [Hz], and 0.01 [Hz] to extract the first feature amount.

[0176] As shown in the figure, by extracting the first feature amount while gradually lowering the cutoff frequency, it is possible to speed up convergence, although it is rough.

[0177] 35 is a diagram showing the change over time of the first feature amount and the second feature amount when the first feature amount is extracted by stepwise switching the cutoff frequency. In the figure, the symbol O1 indicates the change over time of the first feature amount. Also, the symbol O2 indicates the change over time of the second feature amount.

[0178] As described above, by extracting the first feature by gradually lowering the cutoff frequency, the first feature can be roughly converged quickly. Therefore, when extracting the first feature by gradually lowering the cutoff frequency as in this example, it can be used to extract the offset quickly and roughly.

[0179] FIG. 36 is a block diagram of functions of the second offset calculation unit of the present embodiment.

[0180] Since the functions of the two second offset calculation units 100A, 100B are the same, only the functions of the second offset calculation unit 100A will be described here.

[0181] As shown in FIG. 36, the second offset calculation section 100A of the present embodiment further has a function of an LPF switching section 106A (LPF: Low-pass filter).

[0182] The LPF switching unit 106A switches the low-pass filter used in the first feature extraction unit 101A. More specifically, it switches the cutoff frequency in the low-pass filter processing performed by the first feature extraction unit 101A. The switching is performed stepwise at predetermined time intervals. The cutoff frequency to be switched is determined in advance and set to decrease stepwise.

[0183] According to the second offset calculation unit 100A of the present embodiment configured as above, the cutoff frequency is switched stepwise in the first feature extraction unit 101A to extract the first feature. The number of times of switching is not particularly limited. It is sufficient to switch at least once.

[0184] [Fifth embodiment] As described above, the offset of the gyro sensor also varies depending on the environmental temperature. In the digital camera of this embodiment, the offset is managed for each temperature. Therefore, in the digital camera of this embodiment, when calculating the offset, temperature information is acquired, and the calculated offset is stored for each temperature. In addition, when correcting the offset, the correction process is performed using the offset according to the temperature.

[0185] FIG. 37 is a block diagram of functions related to offset correction when the offset is corrected according to temperature.

[0186] Note that the case where the output signal of the first detection section 20A is offset-corrected is the same as the case where the output signal of the second detection section 20B is offset. Therefore, only the case where the output signal of the first detection section 20A is offset-corrected will be described here, and the description of the case where the output signal of the second detection section 20B is omitted.

[0187] 37, the digital camera of this embodiment further includes a function of an offset selection unit 130A for offset correction. The function of the offset selection unit 130A is realized by the system control unit 50.

[0188] The offset selection unit 130A reads out information on a first offset and a second offset according to temperature from the offset storage unit 90A, and applies the information to the first subtraction unit 60A1 and the second subtraction unit 60A2.

[0189] Here, the temperature information is acquired from the first detection unit 20A. More specifically, the temperature information is acquired from the gyro sensor 21A provided in the first detection unit 20A. The gyro sensor 21A outputs temperature information together with the angular velocity. Note that this type of gyro sensor (a gyro sensor having a function of detecting temperature) is well known, and therefore detailed description thereof will be omitted.

[0190] The offset selection unit 130A acquires temperature information from the first detection unit 20A, and reads out information on the first offset and the second offset corresponding to the acquired temperature from the offset storage unit 90A.

[0191] The offset storage unit 90A stores information on the first offset and the second offset in a table format. The table that stores information on the first offset is referred to as the first offset storage table, and the table that stores information on the second offset is referred to as the second offset storage table. The first offset storage table stores information on the first offset for each temperature. The second offset storage table stores information on the second offset for each temperature. Note that "for each temperature" here means for each certain temperature range. For example, when storing in units of 1°C, the temperature is rounded down to the nearest whole number.

[0192] The first offset storage table is a fixed table. On the other hand, the second offset storage table is a table that is updated from time to time. When the second offset calculated by the second offset calculation unit 100A is stored in the offset storage unit 90A, the second offset storage control unit 110A acquires temperature information from the first detection unit 20A and updates the information in the second offset storage table. That is, the second offset information stored at the position of the acquired temperature is rewritten with the calculated second offset value. This allows the value of the second offset to be updated for each temperature.

[0193] FIG. 38 is a flowchart showing a procedure for updating the second offset depending on the temperature.

[0194] First, a calculation process of the second offset is performed (step S31). Then, it is determined whether the second offset has been calculated (step S32). If the second offset has been calculated, temperature information is acquired (step S33). The second offset is stored in the offset storage unit according to the acquired temperature (step S34). That is, the information of the second offset storage table stored in the offset storage unit is updated. In this case, the information of the second offset stored at the position of the acquired temperature is rewritten.

[0195] Thereafter, it is determined whether the calculation process of the second offset is completed (step S35). The calculation process of the second offset is completed, for example, when the power supply of the digital camera is turned off. When the calculation process of the second offset is completed, the update process is also completed.

[0196] On the other hand, if the calculation process of the second offset is continuing, the calculation-related process is initialized (step S36), and the calculation process is performed in the next calculation cycle.

[0197] FIG. 39 is a flowchart showing a procedure for the process of offset correction according to temperature.

[0198] First, temperature information is acquired (step S41). Next, a first offset is selected based on the acquired temperature (step S42). As a result, the first offset according to the temperature is set. Similarly, a second offset is selected based on the acquired temperature (step S43). As a result, the second offset according to the temperature is set. Thereafter, the output signals of the first detection unit 20A and the second detection unit 20B are offset-corrected by the set first and second offsets. That is, first, the first offset is subtracted from the output signal, and the first offset correction is performed (step S44). Next, the second offset is subtracted from the output signal after the first offset is subtracted, and the second offset correction is performed (step S45). As a result, the offset is removed from the output signals of the first detection unit 20A and the second detection unit 20B.

[0199] In this way, according to the digital camera of the present embodiment, the offset correction is performed in response to the temperature. Also, the second offset is updated in response to the temperature. This allows the offset to be corrected with greater accuracy.

[0200] In this embodiment, a gyro sensor having a temperature detection function is used to acquire temperature information from the gyro sensor, but the means for acquiring temperature information is not limited to this. For example, the temperature can be detected by a temperature sensor separately provided in the digital camera body.

[0201] [Sixth embodiment] Regarding the calculation process of the second offset, in the above embodiment, the calculation is performed constantly while the digital camera is in operation (while the power is on), or the calculation is performed when it is determined that the digital camera is in a stationary state.

[0202] In this embodiment, the calculation process of the second offset is executed at a predetermined timing, for example, when the power of the digital camera is turned off.

[0203] FIG. 40 is a flowchart showing a procedure of the process for calculating the second offset when the power is turned off.

[0204] First, it is determined whether or not the power supply to the digital camera has been turned off (step S51). More specifically, it is determined whether or not an operation to turn off the power supply has been performed.

[0205] When the power supply of the digital camera is turned off, a calculation process of the second offset is performed (step S52). Note that this process also includes a process of storing the calculated second offset in the offset storage unit.

[0206] When the calculation process of the second offset is completed, the power supply (so-called main power supply) of the digital camera is turned off (step S53).

[0207] In this manner, by configuring the system to execute the calculation process of the second offset when the power is turned off, the load of system control can be reduced.

[0208] Alternatively, the calculation process of the second offset may be executed when, for example, no operation is performed for a predetermined period of time.

[0209] The process may also be executed while the digital camera is powered off. In this case, the process may be executed periodically at a predetermined time, for example.

[0210] In addition, when the calculation process of the second offset is executed, it is preferable to combine it with the determination process of the stationary state and execute the calculation process when it is determined that the vehicle is in the stationary state, thereby making it possible to calculate the second offset with higher accuracy.

[0211] [Other embodiments] (1) Another embodiment of calculation of second feature amount The second feature value, which is the slope of the cumulative integral value of the output signal of the gyro sensor, may be configured to widen the dynamic range by using a bit shift in order to perform long-term integration. In this case, it is preferable to determine the dynamic range so that a calculation can be performed to obtain the slope with a resolution equivalent to that of the gyro sensor itself. More preferably, a range that can measure a deviation of at least 1 [mdps] is used.

[0212] For example, assume that the output from the gyro sensor is always 1 LSB (n [mdps]) and the control period is N [Hz].

[0213] The integral of the output of the gyro sensor is calculated by the following formula.

[0214] INTEG[k]=(INTEG[k-1]+GYRO[k]*(1 / n))*(1 / nn) GYRO: Gyro sensor output INTEG: Integral output The slope of the cumulative integral value is calculated by the following formula.

[0215] OUT[k]=(INTEG[k]-OUT_INIT)*(1 / (COUNT*(1 / N))) OUT: Slope (second feature) OUT_INIT: Initial value of integral at the start of calculation COUNT: A value that is incremented by 1 every control cycle from the start of calculation (initial value is 0) The calculations of GYRO[k]*(1 / N), *(1 / (COUNT*(1 / N))), and *(1 / NN) are reproduced so that the slope can be extracted in n[mdps] by bit shifting, depending on the values ​​of n and N.

[0216] (2) Apparatus to which the present invention is applied In the above embodiment, the present invention is applied to a digital camera equipped with an image stabilization function, but the application of the present invention is not limited to this. The present invention can also be applied to various imaging devices equipped with an image stabilization function, such as video cameras, television cameras, and cine cameras.

[0217] The imaging device of the present invention includes not only a standalone imaging device, but also an imaging device that is integrated into a device having a function other than imaging. For example, the imaging device includes an imaging device integrated into a smartphone, a personal computer, etc.

[0218] Furthermore, for example, in a lens-interchangeable digital camera, when an interchangeable lens is provided with an image stabilization function, the present invention can be applied to the interchangeable lens. In this case, for example, a system control unit provided in the interchangeable lens realizes the function of a signal processing device. The interchangeable lens in this case is an example of a lens device.

[0219] Furthermore, the present invention can be widely applied to devices equipped with an image stabilization function other than image capture devices, such as optical devices such as binoculars equipped with an image stabilization function.

[0220] In addition, the present invention is not limited to the so-called lens shift type of image stabilization, and can also be applied to the case where an image sensor shift type is adopted. The image sensor shift type is an image stabilization function that corrects image stabilization by moving an image sensor (imaging element) in response to camera shake. Furthermore, the present invention can also be applied to the case where a so-called electronic type of image stabilization is adopted.

[0221] The present invention can also be applied to applications other than image stabilization. However, image stabilization of an imaging device or the like requires high accuracy in detecting shake, so the present invention is particularly effective when applied to detection of shake for image stabilization.

[0222] (3) Shake detection sensor In the above embodiment, the case where the output signal of a gyro sensor is processed has been described as an example, but the application of the present invention is not limited to this. The present invention can be applied to the case where the output signal of a sensor containing an offset, in particular, the output signal of a sensor in which the offset cannot be removed by a fixed value, is processed.

[0223] (4) Offset correction In the above embodiment, the offset is removed in two separate steps, but it is also possible to remove only the second offset, i.e., the step of removing the first offset can be omitted.

[0224] (5) System configuration Processors that realize each function of a signal processing device include a CPU (Central Processing Unit), which is a general-purpose processor, a Programmable Logic Device (PLD), which is a processor whose circuit configuration can be changed after manufacture such as an FPGA (Field Programmable Gate Array), and a dedicated electrical circuit, which is a processor having a circuit configuration designed specifically to execute a specific process such as an ASIC (Application Specific Integrated Circuit).

[0225] Each function of the signal processing device may be realized by one of these various processors, or by two or more processors of the same or different types (e.g., multiple FPGAs, or a combination of a CPU and an FPGA).

[0226] Also, each function of the signal processing device may be realized by one processor. As an example of realizing each function of the signal processing device by one processor, first, there is a form in which one processor is configured by combining one or more CPUs and software, and this processor realizes each function of the signal processing device. Second, there is a form in which a processor that realizes the entire function of the signal processing device by one IC (Integrated Circuit) chip is used, as typified by System On Chip (SoC).

[0227] In this way, each function of the signal processing device is realized as a hardware structure using one or more of the above-mentioned various processors.

[0228] Furthermore, the hardware structure of these various processors is, more specifically, an electric circuit that combines circuit elements such as semiconductor elements. [Explanation of symbols]

[0229] 1. Digital camera 10. Imaging optical system 11 Zoom Lens 12 Focus Lens 13 Corrective lenses 14 Aperture 15 Zoom lens drive unit 16 Focus lens drive unit 17 Correction lens drive unit 17x 1st drive unit 17y 2nd Drive Unit 18 Aperture drive unit 20 Angular velocity detector 20A First detection section 20B Second detection section 21A Gyro sensor 21B Gyro sensor 22A, 22B ADC 30 Image sensor 40 Main memory 41 Digital signal processing section 42 Auxiliary storage 43 Display section 44 Control section 50 System control section 60A Offset correction section 60A1 First subtraction section 60A2 Second subtraction section 60B Offset correction section 70A 1st correction amount calculation section 70B Second correction amount calculation section 71A High Pass Filter 72A Sensitivity correction section 73A Integral section 74A Correction amount calculation section 80A First drive control section 80B Second drive control section 90A Offset memory section 90B Offset memory section 100A Second offset calculation section 100B Second offset calculation unit 101A First feature extraction unit 102A Integral section 103A Second feature extraction unit 104A Second offset calculation unit 104A1 Difference calculation unit 104A2 Judgment section 104A3 Calculation part 105A Initialization judgment section 106A LPF switching section 110A Second offset storage control unit 110B second offset storage control unit 120A Stationary Judgment Unit 120B Stationary judgment section 130A Offset Selection Section O Offset O1 First feature O2 Second feature Pit Pitch direction Yaw Yaw direction S1~S8 Image stabilization control procedure S11 to S18: Procedure for calculating the second offset S21 to S26: Procedure of determination process performed by the initialization determination unit S31 to S36 Procedure for updating the second offset according to temperature S41~SS45 Temperature-dependent offset correction process procedure S51 to S53: Procedure for calculating the second offset when the power is turned off

Claims

1. A shake detection sensor; A processor; A storage unit; Equipped with The processor, A process of calculating a DC component amount from an output signal of the shake detection sensor and extracting a first characteristic amount related to an offset; integrating the output signal; a process of calculating a slope of an accumulated integral value from a value obtained by integrating the output signal, and extracting a second feature amount related to the offset; a process of calculating half of a sum of the first feature amount and the second feature amount to calculate the offset; A process of calculating an absolute value of a difference between the first feature amount and the second feature amount; a process of measuring a time during which an absolute value of a difference between the first feature amount and the second feature amount remains equal to or less than a first threshold value when the absolute value of the difference between the first feature amount and the second feature amount becomes equal to or less than a first threshold value; storing the offset in the storage unit when the duration of the state in which the offset is equal to or less than the first threshold value becomes equal to or greater than a second threshold value; and subtracting the offset stored in the storage unit from the output signal, The processor, A process of calculating a change amount of the second characteristic amount during one calculation period is executed; when the amount of change in the second characteristic amount exceeds a third threshold after a state in which the amount of change in the second characteristic amount is equal to or less than a specified value continues for a specified time or more, the process of calculating the offset is initialized and resumed. Signal processing device.

2. The processor, Further performing a process of determining a stationary state based on the output signal; When it is determined that the vehicle is in a stationary state, a process for calculating the offset is executed. The signal processing device according to claim 1 .

3. The processor, Further performing a process of determining a stationary state based on the output signal; When it is determined that the motion is not stationary, the output signal is subjected to a low-pass filter process at a first cutoff frequency to extract the first characteristic amount; When it is determined that the vehicle is in a stationary state, a low-pass filter process is performed on the output signal at a second cutoff frequency higher than the first cutoff frequency to extract the first characteristic amount. The signal processing device according to claim 1 .

4. the processor initializes a process related to the calculation of the offset and executes a process in a next calculation cycle when an absolute value of a difference between the first feature amount and the second feature amount does not become equal to or less than the first threshold value during one calculation cycle and when a time during which the state in which the difference is equal to or less than the first threshold value continues does not become equal to or more than the second threshold value. The signal processing device according to any one of claims 1 to 3.

5. The processor, A process of acquiring information on a temperature at which the offset is calculated is further performed; storing the calculated offset for each temperature; The signal processing device according to any one of claims 1 to 4.

6. A shake detection sensor provided in the device body; a signal processing device according to any one of claims 1 to 5, which processes an output signal of the shake detection sensor; An imaging device comprising:

7. A shake detection sensor provided in the device body; a signal processing device according to any one of claims 1 to 5, which processes an output signal of the shake detection sensor; A lens device comprising:

Citation Information

Patent Citations

  • Photograph lens, and camera system

    JP2005043780A

  • Blur detecting device and method, and imaging apparatus

    JP2008145523A

  • Imaging device

    JP2008283443A

  • Image shake correction device and control method for the same, lens barrel, optical device and imaging device

    JP2015031779A

  • Imaging device

    JP2017138493A