Jitter correction method and device, storage medium and electronic equipment

Abstract

The embodiment of the invention provides a jitter correction method and device, a storage medium and electronic equipment. The method comprises the following steps: acquiring a jitter parameter of the electronic equipment; optical jitter correction is carried out on the jitter components with the jitter parameters larger than a set jitter threshold value; performing electronic jitter correction on the residual jitter component after the optical jitter correction to generate visual data; wherein, when it is detected that the electronic device performs a controlled motion, optical shake correction and electronic shake correction are stopped, and a return parameter for returning a shake correction mechanism for optical shake correction to the center is set to a value less than a set shake threshold. In the technical scheme provided by the embodiment of the invention, when the electronic jitter correction is carried out when the moving image is shot, the jitter in one frame can be reduced even if the exposure time is prolonged in order to improve the signal-to-noise ratio at low brightness or the jitter of the movement which is fast enough is generated, so that the image is blurred in one frame; and the quality of visual data is improved.

Description

Technical Field

[0001] This invention relates to the field of optical technology, and more particularly to a jitter correction method, apparatus, storage medium, and electronic device. Background Technology

[0002] When shooting video or capturing still images continuously using a handheld electronic device, camera operators are prone to hand tremors, resulting in blurry images. Electronic devices typically employ two methods to correct image sag: Optical Image Stabilization (OIS) and Electronic Image Stabilization (EIS).

[0003] In recent years, regarding image shake correction in motion photography, in relatively bright shooting environments, electronic image shake correction using shorter exposure times yields very stable and high-quality images. However, in darker shooting environments, maintaining shorter exposure times requires increasing the sensitivity of the image sensor, which can easily lead to a decrease in the image's signal-to-noise ratio (S / N). Furthermore, even when extending the exposure time to avoid a decrease in S / N, if the photographer's hand shakes, visual data will still be blurred, even with electronic image shake correction. Summary of the Invention

[0004] In view of this, embodiments of the present invention provide a jitter correction method, apparatus, storage medium, and electronic device for improving the quality of visual data in motion image photography in low-light environments or where jitter from sufficiently fast motion causes image blurring within a single frame.

[0005] On one hand, embodiments of the present invention provide a jitter correction method, including: Obtain the jitter parameters of the electronic device; Optical jitter correction is performed on jitter components whose jitter parameters exceed a set jitter threshold. Electronic jitter correction is performed on the remaining jitter components after optical jitter correction to generate visual data; Specifically, when controlled movement of the electronic device is detected, optical jitter correction and electronic jitter correction are stopped, and the return parameter of the optical jitter correction mechanism is set to a value less than the set jitter threshold.

[0006] Optionally, the jitter parameters include: jitter frequency, jitter angular velocity, or jitter displacement velocity; The controlled motion includes: panning, the lens orientation of electronic devices, movement speed, or changes in motion state.

[0007] Optionally, when the jitter parameter includes jitter frequency, the set jitter threshold is a lower limit value of the frequency of the optical jitter correction mechanism operation. The lower limit value of the frequency includes the frequency at which the jitter amount within 1 frame on the image sensor is suppressed to less than 0.5 pixels or suppressed to less than a set pixel jitter amount, as determined by optical characteristics, exposure time, jitter frequency, and jitter amplitude.

[0008] Optionally, when the jitter parameter includes jitter frequency, the return parameter is the upper limit value of the frequency returned to the center by the jitter correction mechanism of optical jitter correction. The upper limit value of the frequency includes the frequency at which the amount of jitter in 1 frame on the image sensor is suppressed to less than 0.5 pixels or to less than the allowable amount of pixel jitter, as determined by optical characteristics, exposure time, jitter frequency and jitter amplitude.

[0009] Optionally, when the jitter parameter includes jitter angular velocity, the set jitter threshold is the lower limit of the angular velocity of the jitter correction mechanism of optical jitter correction. The lower limit of the angular velocity includes the angular velocity on the image sensor where the amount of jitter within 1 frame is suppressed to less than 0.5 pixels or to less than a set pixel jitter amount, as determined by optical characteristics, exposure time, jitter frequency, and jitter amplitude.

[0010] Optionally, when the jitter parameter includes jitter angular velocity, the return parameter is the upper limit of the angular velocity returned to the center by the jitter correction mechanism of optical jitter correction. The upper limit of the angular velocity includes the angular velocity on the image sensor where the amount of jitter within 1 frame is suppressed to less than 0.5 pixels or to less than the allowable amount of pixel jitter, as determined by optical characteristics, exposure time, jitter frequency, and jitter amplitude.

[0011] Optionally, when the jitter parameter includes jitter displacement speed, the set jitter threshold is the lower limit value of the displacement speed of the jitter correction mechanism of optical jitter correction. The lower limit value of displacement speed includes the displacement speed on the image sensor where the jitter amount within 1 frame is suppressed to less than 0.5 pixels or suppressed to less than a set pixel jitter amount, which is determined by optical characteristics, exposure time, jitter frequency and jitter amplitude. The return parameter is the upper limit of the displacement speed of the optical jitter correction mechanism returning to the center. The upper limit of the displacement speed includes the displacement speed at which the amount of jitter in one frame on the image sensor is suppressed to less than 0.5 pixels or to less than the allowable amount of pixel jitter, as determined by optical characteristics, exposure time, jitter frequency, and jitter amplitude.

[0012] On the other hand, embodiments of the present invention provide a jitter correction device, comprising: The acquisition module is used to acquire the jitter parameters of the electronic device; The first correction module is used to perform optical jitter correction on jitter components whose jitter parameters are greater than a set jitter threshold. The second correction module is used to perform electronic jitter correction on the remaining jitter components after the optical jitter correction, and generate visual data. The centering module is used to stop optical jitter correction and electronic jitter correction when controlled motion of the electronic device is detected, and to set the return parameter of the optical jitter correction mechanism to the center to a value less than the set jitter threshold.

[0013] On the other hand, embodiments of the present invention provide a storage medium including a stored program, wherein the program controls the device where the storage medium is located to execute the above-described jitter correction method during runtime.

[0014] On the other hand, embodiments of the present invention provide an electronic device, including a memory and a processor. The memory is used to store information including program instructions, and the processor is used to control the execution of the program instructions. When the program instructions are loaded and executed by the processor, the steps of the above-described jitter correction method are implemented.

[0015] In the technical solution provided by this invention, jitter parameters of an electronic device are acquired; optical jitter correction is performed on jitter components whose jitter parameters exceed a set jitter threshold; electronic jitter correction is performed on the remaining jitter components after optical jitter correction to generate visual data; wherein, when controlled motion of the electronic device is detected, optical jitter correction and electronic jitter correction are stopped, and the return parameter of the optical jitter correction mechanism is set to a value less than the set jitter threshold. In the technical solution provided by this invention, when performing electronic jitter correction by capturing moving images, even if the exposure time is extended to improve the signal-to-noise ratio at low brightness or if sufficiently fast jitter is generated, causing image blurring within one frame, jitter within one frame can be reduced, and the quality of visual data can be improved. Attached Figure Description

[0016] To more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0017] Figure 1 A schematic diagram of an electronic device provided according to an embodiment of the present invention; Figure 2 A flowchart of a jitter correction method provided in an embodiment of the present invention; Figure 3A This is a schematic diagram of a jitter correction method implemented when an electronic device is subjected to a jitter frequency of 2Hz and a jitter angle of 1.7 degrees, according to an embodiment of the present invention. Figure 3B This is a schematic diagram of a jitter correction method implemented when an electronic device is subjected to a jitter frequency of 4Hz and a jitter angle of 0.85 degrees, according to an embodiment of the present invention. Figure 4A This is a schematic diagram of a jitter correction method implemented when an electronic device is subjected to a jitter frequency of 2Hz and a jitter displacement of 0.4m, according to an embodiment of the present invention. Figure 4B This is a schematic diagram of a jitter correction method implemented when an electronic device is subjected to a jitter frequency of 4Hz and a jitter displacement of 0.2m, according to an embodiment of the present invention. Figure 5 This is a schematic diagram of the operation of the jitter correction mechanism returning to the center frequency according to an embodiment of the present invention; Figure 6 This is a schematic diagram of a jitter correction device provided in an embodiment of the present invention. Detailed Implementation

[0018] To better understand the technical solution of the present invention, the embodiments of the present invention will be described in detail below with reference to the accompanying drawings.

[0019] It should be understood that the described embodiments are merely some, not all, of the embodiments of the present invention. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without inventive effort are within the scope of protection of the present invention.

[0020] The terminology used in the embodiments of this invention is for the purpose of describing particular embodiments only and is not intended to limit the invention. The singular forms “a,” “the,” and “the” as used in the embodiments of this invention and the appended claims are also intended to include the plural forms unless the context clearly indicates otherwise.

[0021] It should be understood that the term "and / or" used in this article is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, or B existing alone. Additionally, the character " / " in this article generally indicates that the preceding and following related objects have an "or" relationship.

[0022] In this embodiment of the invention, optical image stabilization is a camera image stabilization technology mainly used in camera and mobile device shooting scenarios. Its principle is to detect shake signals using a gyroscope sensor, then calculate and drive an actuator integrated with the lens assembly to perform reverse displacement compensation, thereby achieving image stabilization by correcting the optical axis displacement. Electronic image stabilization is a technology that detects the device's movement state using a gyroscope sensor and uses algorithms to adjust the image signal to eliminate image shake.

[0023] In this embodiment of the invention, if optical jitter correction reduces jitter within one frame of exposure during image sensor exposure, and the actuator for optical jitter correction returns to the center during the period from the end of exposure to the start of the next frame's exposure, optical jitter correction is used in motion images and coordinated with electronic jitter correction, thereby capturing motion images with less jitter. However, if the exposure time is extended to one frame in low brightness, there is not enough time to return the actuator for optical jitter correction to the center, and optical jitter correction cannot function effectively.

[0024] To solve the aforementioned technical problems, the jitter parameters of the electronic device are obtained. Optical jitter correction is performed on vibration components whose jitter parameters exceed a set jitter threshold. Electronic jitter correction is performed on the remaining jitter components after optical jitter correction to generate visual data. Here, when the electronic device detects that it is undergoing controlled motion, optical jitter correction and electronic jitter correction are stopped, and the return parameter of the jitter correction mechanism on the optical jitter correction side is set to a value smaller than the set jitter threshold. In the technical solution of this embodiment of the invention, when electronic jitter correction is performed during dynamic image capture, even if the exposure time is extended to improve the signal-to-noise ratio at low brightness or if rapid motion jitter sufficient to blur the image occurs within one frame, jitter within one frame can be reduced, thereby improving the quality of visual data.

[0025] One embodiment of the present invention provides an electronic device that may include: cameras for smartphones, action cameras, automotive cameras, industrial cameras, cameras mounted on robots, cameras for virtual reality (VR), augmented reality (AR), mixed reality (MR), and all other cameras equipped with actuators for optical image correction. Furthermore, the optical image correction includes a gimbal.

[0026] Figure 1 This is a schematic diagram of an electronic device provided in an embodiment of the present invention, as shown below. Figure 1As shown, the electronic device includes: an image sensor 1, an image processing + EIS processing module 2, a proportional-integral-derivative (PID) control loop 6, and a centering processing module 8. The PID control loop 6 may include: a lens, an OIS actuator 3, a driver + OIS control module 4, a jitter detection module 5, and a Hall sensor 7. The image sensor 1 is connected to the image processing + EIS processing module 2, the lens is connected to the OIS actuator 3, the OIS actuator 3 is connected to the driver + OIS control module 4, and the jitter detection module 5 is connected to the driver + OIS control module 4, the Hall sensor 7, the centering processing module 8, and the image processing + EIS processing module 2.

[0027] The lens contains an OIS actuator 3, and the position of the OIS actuator 3 relative to the lens is constantly captured by a Hall sensor 7. The position signal obtained from the Hall sensor 7 is compared with a jitter correction signal that has been detected and processed by the jitter detection module 5, forming a PID control loop 6 that drives the OIS actuator 3 via a driver + OIS control module 4 to ensure the difference is zero. Furthermore, when the jitter detection module 5 detects the controlled motion state, a centering processing module 8 returns the position of the OIS actuator 3 to the center. The image after jitter correction by the OIS actuator 3 is converted into a digital signal by the image sensor 1, and then imaged after EIS processing by the image processing + EIS processing module 2.

[0028] The electronic device provided in this embodiment of the invention includes a memory and a processor. The memory is used to store information including program instructions, and the processor is used to control the execution of the program instructions. When the program instructions are loaded and executed by the processor, they implement the steps of the following jitter correction method embodiments. For a detailed description, please refer to the following jitter correction method embodiments.

[0029] Based on the aforementioned electronic device, one embodiment of the present invention provides a jitter correction method. Figure 2 A flowchart of a jitter correction method provided in an embodiment of the present invention is shown below. Figure 2 As shown, the method includes: Step 102: Obtain the jitter parameters of the electronic device.

[0030] In this embodiment of the invention, each step is performed by an electronic device.

[0031] In this embodiment of the invention, when the cameraman holds the electronic device to shoot video or continuously capture still images, the electronic device can obtain the shaking parameters of the electronic device.

[0032] In this embodiment of the invention, the jitter parameters may include: jitter degree parameters (values ​​determined by jitter frequency and amplitude), jitter angular velocity, or jitter displacement velocity.

[0033] Step 104: Is controlled motion of the electronic device detected? If yes, proceed to step 106; if no, proceed to step 108.

[0034] Step 106: Stop optical jitter correction, set the return parameter of the optical jitter correction mechanism to the center to a value less than the set jitter threshold, and control the jitter correction mechanism to return to the center, then return to step 102.

[0035] In this embodiment of the invention, the controlled motion may include: panning, the lens orientation of the electronic device, movement speed, or a change in motion state.

[0036] In this embodiment of the invention, the jitter correction mechanism includes an OIS actuator 3.

[0037] In this embodiment of the invention, when the controlled motion of the electronic device is detected, the actuator can be returned to the center at a speed determined by the optical characteristics, jitter frequency and amplitude, or a speed below the jitter angular velocity or jitter displacement velocity.

[0038] In this embodiment of the invention, when the jitter parameter includes the jitter frequency, the returned parameter is the upper limit value of the frequency returned to the center by the jitter correction mechanism of the optical jitter correction. The upper limit value of the frequency includes the frequency at which the jitter amount within 1 frame on the image sensor is suppressed to less than 0.5 pixels or to less than the allowable pixel jitter amount, which is determined by the optical characteristics, exposure time, jitter frequency and jitter amplitude.

[0039] In this embodiment of the invention, when the jitter parameter includes jitter angular velocity, the return parameter is the upper limit value of the angular velocity returned to the center by the jitter correction mechanism of optical jitter correction. The upper limit value of angular velocity includes the angular velocity on the image sensor where the amount of jitter within 1 frame is suppressed to less than 0.5 pixels or to less than the allowable amount of pixel jitter, as determined by optical characteristics, exposure time, jitter frequency and jitter amplitude.

[0040] In this embodiment of the invention, when the jitter parameter includes jitter displacement speed, the return parameter is the upper limit value of the displacement speed of the optical jitter correction mechanism returning to the center. The upper limit value of the displacement speed includes the displacement speed on the image sensor where the jitter amount within 1 frame is suppressed to less than 0.5 pixels or to less than the allowable pixel jitter amount, as determined by optical characteristics, exposure time, jitter frequency, and jitter amplitude.

[0041] Step 108: Perform optical jitter correction on jitter components whose jitter parameters are greater than the set jitter threshold.

[0042] In this embodiment of the invention, the jitter threshold can be set according to the actual situation. For example, when the jitter parameter includes jitter frequency, the jitter threshold is set as the lower limit of the frequency at which the optical jitter correction mechanism operates. The lower limit of the frequency includes the frequency at which the jitter amount within one frame on the image sensor is suppressed to less than 0.5 pixels or to less than a set pixel jitter amount, as determined by optical characteristics, exposure time, jitter frequency, and jitter amplitude.

[0043] For example, when the jitter parameter includes jitter angular velocity, the jitter threshold is set as the lower limit of the angular velocity of the jitter correction mechanism of optical jitter correction. The lower limit of angular velocity includes the angular velocity on the image sensor where the amount of jitter within 1 frame is suppressed to less than 0.5 pixels or to less than the set pixel jitter amount, which is determined by optical characteristics, exposure time, jitter frequency and jitter amplitude.

[0044] Step 110: Perform electronic jitter correction on the remaining jitter components after optical jitter correction to generate visual data, and return to step 102.

[0045] In this embodiment of the invention, the visual data can be a motion image with reduced jitter.

[0046] In this embodiment of the invention, a method for jitter correction of an optical system with a set exposure time can be described. Optical jitter correction (OIS) corrects jitter at values ​​determined by frequency and amplitude, or angular velocity, or displacement velocity. Then, electronic jitter correction (EIS) corrects the residual jitter of optical jitter correction (OIS). Image signals whose jitter within one frame is suppressed to less than 0.5 pixels or to an acceptable pixel jitter level are subjected to electronic jitter correction (EIS) processing, and for image signals with sufficiently low movement speeds, jitter can be reduced through this embodiment of the invention.

[0047] In this embodiment of the invention, when controlled motion of the electronic device is detected, optical jitter correction and electronic jitter correction can be stopped, and the return parameter of the optical jitter correction mechanism returning to the center can be set to a value less than the set jitter threshold.

[0048] In this embodiment of the invention, when controlled movement of the electronic device is detected, the actuator of the optical jitter correction (OIS) is brought back to the center at a sufficiently low moving speed that does not affect the electronic jitter correction (EIS) processing.

[0049] Figure 3A This is a schematic diagram illustrating a jitter correction method implemented when an electronic device experiences a jitter frequency of 2Hz and a jitter angle of 1.7 degrees, according to an embodiment of the present invention. Optical jitter correction is performed on jitter components whose jitter angular velocity exceeds a set jitter threshold. Figure 3A As shown, the two dashed lines on the vertical axis represent the set jitter threshold when the jitter parameter is the jitter angular velocity. Input jitter (deg) represents the jitter input to the electronic device at a jitter frequency of 2Hz and a jitter angle of 1.7 degrees relative to the optical axis, with other conditions set as follows: exposure time 0.65ms, actual focal length 5mm, and pixel size 2μm. The ideal parameter is to set the jitter amount on the image sensor within one frame to a maximum of 0.5 pixels. However, in practice, the exposure time can be extended to accommodate the jitter amount within one frame, depending on the actual usage conditions and required quality. Angular velocity (deg / s) is the angular velocity signal obtained by differentiating the input jitter (deg) and converting it into speed. The pixel error W / O algorithm (pix) represents the amount of jitter on the image sensor for this jitter input, taking into account parameters such as optical characteristics and exposure time. The ideal OIS implemented to suppress the signal magnitude to below 0.5 is the pixel error W algorithm (pix), where the jitter on the image sensor is a waveform with an amplitude of less than 0.5 pixels. Figure 3A In the example, as a condition for performing OIS, the angular velocity (deg / s) of the jitter signal can be input as 17.6 deg / s or higher. The actuator position (deg) represents the final displacement of OIS, and it can be seen that under this condition, it is limited to a range of ±1 deg, which becomes a setting that limits the correction range of conventional optical jitter correction.

[0050] Figure 3B This is a schematic diagram illustrating a jitter correction method implemented when an electronic device is input with a jitter frequency of 4Hz and a jitter angle of 0.85 degrees, according to an embodiment of the present invention. The jitter angular velocity is greater than... Figure 3A With the same jitter threshold set at 17.6 deg / s, optical jitter correction was performed on the jitter components, such as... Figure 3B As shown, the two dashed lines on the vertical axis represent the set jitter threshold when the jitter parameter is the jitter angular velocity. Even in Figure 3A When the jitter angle of the input jitter is set to half and the jitter frequency is set to twice, the Pix Error W / O algorithm (pix) suppresses the amount of jitter on the image sensor to less than 0.5 pixels for this jitter input, taking into account parameters such as optical characteristics and exposure time. Moreover, it does not depend on the input amplitude or input frequency, but only on the angular velocity (deg / s) of the input jitter signal, and can set the amount of jitter on the image sensor to less than 0.5 pixels.

[0051] For example, when the jitter parameter includes jitter displacement speed, the jitter threshold is set as the lower limit of the displacement speed of the jitter correction mechanism of optical jitter correction. The lower limit of displacement speed includes the displacement speed on the image sensor where the amount of jitter within 1 frame is suppressed to less than 0.5 pixels or suppressed to less than a set pixel jitter amount, which is determined by optical characteristics, exposure time, jitter frequency and jitter amplitude.

[0052] Figure 4A This is a schematic diagram illustrating a jitter correction method implemented when an electronic device experiences a jitter frequency of 2Hz and a jitter displacement of 0.4m, according to an embodiment of the present invention. Optical jitter correction is performed on jitter components whose jitter displacement velocity exceeds a set jitter threshold. Figure 4A The image shows the simulation results for a jitter frequency of 2Hz perpendicular to the optical axis and a jitter displacement of 0.4m. The jitter input (μm) on the imager represents the conversion of the jitter displacement input to the electronic device into the displacement result on the image sensor. Other conditions are set as follows: exposure time 0.65ms, actual focal length 5mm, pixel size 2μm, and distance to the subject 14m. The jitter amount within one frame on the image sensor is set to an ideal parameter of a maximum of 0.5 pixels. However, in practice, the jitter amount within one frame can be increased by extending the exposure time, etc., depending on the actual usage conditions and required quality. Displacement velocity (m / s) is the displacement velocity signal obtained by differentiating the original jitter signal input to the imager and converting it into velocity. The pixel error W / O algorithm (pix) represents the jitter amount on the image sensor for this jitter input, considering parameters such as optical characteristics and exposure time. The ideal optical jitter correction (OIS) implemented to suppress the signal magnitude to below 0.5 is the Pix Error W algorithm (pix), where the jitter on the image sensor is a waveform with an amplitude of less than 0.5 pixels. Figure 4A In the example, as a condition for optical jitter correction, the displacement velocity of the jitter signal can be 4.3 m / s or higher. The actuator position (μm) represents the displacement (μm) of the actuator for the final optical jitter correction. It can be seen that under this condition, it is limited to a range of ±100 μm, which is the setting that limits the correction range of conventional optical jitter correction.

[0053] Figure 4B This is a schematic diagram of a jitter correction method implemented when an electronic device is subjected to a jitter frequency of 4Hz and a jitter displacement of 0.2m, according to an embodiment of the present invention. The jitter displacement velocity is greater than... Figure 4A With the same jitter threshold set at 4.3 m / s, optical jitter correction was performed on the jitter components, such as... Figure 4B As shown, even in Figure 4A When the jitter displacement (μm) on the imager is set to half and the jitter frequency is set to twice, the pixel error W algorithm (pix) suppresses the jitter on the image sensor to less than 0.5 pixels for this jitter input, taking into account parameters such as optical characteristics and exposure time. It does not depend on the input amplitude or input frequency, but only on the displacement velocity of the input jitter signal, and the jitter on the image sensor is less than 0.5 pixels.

[0054] Figure 5 This is a schematic diagram illustrating the action of a jitter correction mechanism returning to the center frequency according to an embodiment of the present invention, as shown below. Figure 5 As shown, when the actuator angle of the OIS exceeds the set jitter threshold and is detected as controlled movement (panning) of the electronic device, the panning detection waveform of the electronic device is shown in the figure. Using the jitter correction method in this embodiment, after the optical jitter correction mechanism returns to the center for processing, the centering waveform and centering return parameters of the electronic device are shown in the following waveforms. If the controlled movement (panning) of the electronic device ends, the centering process stops, and the device resets to the normal mode.

[0055] In the technical solution provided by this invention, jitter parameters of an electronic device are acquired; optical jitter correction is performed on jitter components whose jitter parameters exceed a set jitter threshold; electronic jitter correction is performed on the remaining jitter components after optical jitter correction to generate visual data; wherein, when controlled motion of the electronic device is detected, optical jitter correction and electronic jitter correction are stopped, and the return parameter of the optical jitter correction mechanism is set to a value less than the set jitter threshold. In the technical solution provided by this invention, when performing electronic jitter correction by capturing moving images, even if the exposure time is extended to improve the signal-to-noise ratio at low brightness or if sufficiently fast jitter is generated, causing image blurring within one frame, jitter within one frame can be reduced, and the quality of visual data can be improved.

[0056] It should be noted that the above effects are not necessarily limiting effects, and may be used together with or in place of the above effects to achieve any of the effects shown in this specification, or to achieve other effects that can be understood from this specification.

[0057] One embodiment of the present invention provides a jitter correction device. Figure 6 This is a schematic diagram of a jitter correction device according to an embodiment of the present invention, as shown below. Figure 6As shown, the device includes: an acquisition module 11, a first correction module 12, a second correction module 13, and a centering module 14.

[0058] The acquisition module 11 is used to acquire the jitter parameters of the electronic device.

[0059] The first correction module 12 is used to perform optical jitter correction on jitter components whose jitter parameters are greater than the set jitter threshold.

[0060] The second correction module 13 is used to perform electronic jitter correction on the remaining jitter components after optical jitter correction, and generate visual data.

[0061] The centering module 14 is used to stop optical jitter correction and electronic jitter correction when controlled motion of the electronic device is detected, and to set the return parameter of the optical jitter correction mechanism to the center to a value less than the set jitter threshold.

[0062] In this embodiment of the invention, the jitter parameters include: jitter frequency, jitter angular velocity, or jitter displacement velocity; the controlled motion includes: panning, the lens orientation of the electronic device, movement speed, or movement that changes the motion state.

[0063] In this embodiment of the invention, when the jitter parameter includes jitter frequency, the jitter threshold is set as the lower limit of the frequency of the jitter correction mechanism of optical jitter correction. The lower limit of the frequency includes the frequency at which the jitter amount within 1 frame on the image sensor is suppressed to less than 0.5 pixels or suppressed to less than a set pixel jitter amount, which is determined by optical characteristics, exposure time, jitter frequency and jitter amplitude.

[0064] In this embodiment of the invention, when the jitter parameter includes the jitter frequency, the returned parameter is the upper limit value of the frequency returned to the center by the jitter correction mechanism of the optical jitter correction. The upper limit value of the frequency includes the frequency at which the jitter amount within 1 frame on the image sensor is suppressed to less than 0.5 pixels or to less than the allowable pixel jitter amount, which is determined by the optical characteristics, exposure time, jitter frequency and jitter amplitude.

[0065] In this embodiment of the invention, when the jitter parameter includes jitter angular velocity, the jitter threshold is set as the lower limit of the angular velocity of the jitter correction mechanism of optical jitter correction. The lower limit of angular velocity includes the angular velocity on the image sensor where the jitter amount within 1 frame is suppressed to less than 0.5 pixels or suppressed to less than a set pixel jitter amount, which is determined by optical characteristics, exposure time, jitter frequency and jitter amplitude.

[0066] In this embodiment of the invention, when the jitter parameter includes jitter angular velocity, the return parameter is the upper limit value of the angular velocity returned to the center by the jitter correction mechanism of optical jitter correction. The upper limit value of angular velocity includes the angular velocity on the image sensor where the amount of jitter within 1 frame is suppressed to less than 0.5 pixels or to less than the allowable amount of pixel jitter, as determined by optical characteristics, exposure time, jitter frequency and jitter amplitude.

[0067] In this embodiment of the invention, when the jitter parameter includes jitter displacement speed, the jitter threshold is set as the lower limit value of the displacement speed of the jitter correction mechanism of optical jitter correction. The lower limit value of the displacement speed includes the displacement speed at which the jitter amount within one frame on the image sensor is suppressed to less than 0.5 pixels or suppressed to less than a set pixel jitter amount, as determined by optical characteristics, exposure time, jitter frequency, and jitter amplitude. The return parameter is the upper limit value of the displacement speed at which the jitter correction mechanism of optical jitter correction returns to the center. The upper limit value of the displacement speed includes the displacement speed at which the jitter amount within one frame on the image sensor is suppressed to less than 0.5 pixels or suppressed to less than an allowable pixel jitter amount, as determined by optical characteristics, exposure time, jitter frequency, and jitter amplitude.

[0068] In the technical solution provided by this invention, jitter parameters of an electronic device are acquired; optical jitter correction is performed on jitter components whose jitter parameters exceed a set jitter threshold; electronic jitter correction is performed on the remaining jitter components after optical jitter correction to generate visual data; wherein, when controlled motion of the electronic device is detected, optical jitter correction and electronic jitter correction are stopped, and the return parameter of the optical jitter correction mechanism is set to a value less than the set jitter threshold. In the technical solution provided by this invention, when performing electronic jitter correction by capturing moving images, even if the exposure time is extended to improve the signal-to-noise ratio at low brightness or if sufficiently fast jitter is generated, causing image blurring within one frame, jitter within one frame can be reduced, and the quality of visual data can be improved.

[0069] The jitter correction device provided in this embodiment of the invention can be used to achieve the above. Figure 2 For a detailed description of the jitter correction method, please refer to the embodiments of the jitter correction method described above, which will not be repeated here.

[0070] This invention provides a storage medium that includes a stored program. When the program runs, it controls the device where the storage medium is located to execute the steps of the above-described jitter correction method. For a detailed description, please refer to the embodiments of the above-described jitter correction method.

[0071] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of the present invention should be included within the scope of protection of the present invention.

Claims

1. A jitter correction method, characterized in that, include: Obtain the jitter parameters of the electronic device; Optical jitter correction is performed on jitter components whose jitter parameters exceed a set jitter threshold. Electronic jitter correction is performed on the remaining jitter components after optical jitter correction to generate visual data; Specifically, when controlled movement of the electronic device is detected, optical jitter correction and electronic jitter correction are stopped, and the return parameter of the optical jitter correction mechanism is set to a value less than the set jitter threshold.

2. The method according to claim 1, characterized in that, The jitter parameters include: jitter frequency, jitter angular velocity, or jitter displacement velocity; The controlled motion includes: panning, the lens orientation of electronic devices, movement speed, or changes in motion state.

3. The method according to claim 2, characterized in that, When the jitter parameter includes jitter frequency, the set jitter threshold is the lower limit of the frequency at which the jitter correction mechanism of optical jitter correction operates. The lower limit of frequency includes the frequency at which the jitter amount within 1 frame on the image sensor is suppressed to less than 0.5 pixels or to less than a set pixel jitter amount, as determined by optical characteristics, exposure time, jitter frequency, and jitter amplitude.

4. The method according to claim 2, characterized in that, When the jitter parameter includes jitter frequency, the return parameter is the upper limit of the frequency returned to the center by the optical jitter correction mechanism. The upper limit of the frequency includes the frequency at which the jitter amount within 1 frame on the image sensor is suppressed to less than 0.5 pixels or to less than the allowable pixel jitter amount, as determined by optical characteristics, exposure time, jitter frequency, and jitter amplitude.

5. The method according to claim 2, characterized in that, When the jitter parameter includes jitter angular velocity, the set jitter threshold is the lower limit of the angular velocity of the jitter correction mechanism of optical jitter correction. The lower limit of the angular velocity includes the angular velocity on the image sensor where the jitter amount within 1 frame is suppressed to less than 0.5 pixels or suppressed to less than a set pixel jitter amount, as determined by optical characteristics, exposure time, jitter frequency and jitter amplitude.

6. The method according to claim 2, characterized in that, When the jitter parameter includes jitter angular velocity, the return parameter is the upper limit of the angular velocity returned to the center by the jitter correction mechanism of optical jitter correction. The upper limit of the angular velocity includes the angular velocity on the image sensor where the amount of jitter within 1 frame is suppressed to less than 0.5 pixels or to less than the allowable amount of pixel jitter, as determined by optical characteristics, exposure time, jitter frequency, and jitter amplitude.

7. The method according to claim 2, characterized in that, When the jitter parameter includes jitter displacement speed, the set jitter threshold is the lower limit value of the displacement speed of the jitter correction mechanism of optical jitter correction. The lower limit value of displacement speed includes the displacement speed on the image sensor where the jitter amount within 1 frame is suppressed to less than 0.5 pixels or suppressed to less than the set pixel jitter amount, which is determined by optical characteristics, exposure time, jitter frequency and jitter amplitude. The return parameter is the upper limit of the displacement speed of the optical jitter correction mechanism returning to the center. The upper limit of the displacement speed includes the displacement speed at which the amount of jitter in one frame on the image sensor is suppressed to less than 0.5 pixels or to less than the allowable amount of pixel jitter, as determined by optical characteristics, exposure time, jitter frequency, and jitter amplitude.

8. A jitter correction device, characterized in that, include: The acquisition module is used to acquire the jitter parameters of the electronic device; The first correction module is used to perform optical jitter correction on jitter components whose jitter parameters are greater than a set jitter threshold. The second correction module is used to perform electronic jitter correction on the remaining jitter components after the optical jitter correction, and generate visual data. The centering module is used to stop optical jitter correction and electronic jitter correction when controlled motion of the electronic device is detected, and to set the return parameter of the optical jitter correction mechanism to the center to a value less than the set jitter threshold.

9. A storage medium, characterized in that, The storage medium includes a stored program, wherein, when the program is executed, it controls the device containing the storage medium to perform the jitter correction method according to any one of claims 1 to 7.

10. An electronic device comprising a memory and a processor, the memory for storing information including program instructions, and the processor for controlling the execution of the program instructions, characterized in that, When the program instructions are loaded and executed by the processor, they implement the steps of the jitter correction method according to any one of claims 1 to 7.

Images