Anti-shake control method and device, electronic equipment and medium
By calculating and executing the second reset distance of the image stabilization component within the vertical blanking time, the problem of insufficient stabilization stroke in the prior art is solved, the image stabilization effect is improved, motion blur is reduced, and it is applicable to a variety of optical image stabilization mechanisms.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- VIVO MOBILE COMM CO LTD
- Filing Date
- 2026-04-17
- Publication Date
- 2026-06-16
AI Technical Summary
In scenarios involving long exposures or long image sensor readout times, existing technologies suffer from insufficient vertical blanking time, which prevents the image stabilization components from fully resetting and affects the image stabilization effect.
By obtaining the position of the image stabilization component at the end of the image exposure, its second reset distance is calculated, and the image stabilization component is reset according to this distance during the vertical blanking time to ensure that it returns to the center position as much as possible, leaving more stabilization travel for the next frame image.
It improves image stabilization, reduces motion blur, and expands the effective scenarios for vertical blanking time reset, especially in high frame rate mode, improving recording quality.
Smart Images
Figure CN122227077A_ABST
Abstract
Description
Technical Field
[0001] This application belongs to the field of image processing technology, specifically relating to a stabilization control method, device, electronic device, and medium. Background Technology
[0002] In image stabilization technology, to allow sufficient stabilization travel for the next frame and improve stabilization performance, the Optical Image Stabilization (OIS) component needs to be reset at an appropriate time, returning it to its initial center position. Current technologies typically perform OIS reset during vertical blanking (VB). However, in scenarios with long exposures or long image sensor readout times, the VB time is usually very short. In such cases, existing technologies may determine that the VB duration is insufficient and therefore not perform the OIS reset, resulting in a shorter stabilization travel for the next frame and affecting the final image stabilization performance. Summary of the Invention
[0003] The purpose of this application is to provide a stabilization control method, device, electronic device, and medium that can solve the problems of short stabilization stroke and poor image stabilization effect in the prior art.
[0004] In a first aspect, embodiments of this application provide a stabilization control method, the method comprising: Obtain the first position of the image stabilization component at the end of the exposure of the Nth frame image, where N is a positive integer; Based on the first position and the first reset distance of the image stabilization component in the current shooting mode, determine the second reset distance of the image stabilization component; During the vertical blanking VB time between the Nth frame and the N+1th frame, the image stabilization component is reset according to the second reset distance.
[0005] Secondly, embodiments of this application provide a shake stabilization control device, including: The acquisition module is used to obtain the first position of the image stabilization component at the end of the exposure of the Nth frame image, where N is a positive integer; The first determining module is used to determine the second reset distance of the image stabilization component based on the first position and the first reset distance of the image stabilization component in the current shooting mode; The reset module is used to reset the image stabilization component according to the second reset distance during the vertical blanking VB time between the Nth frame image and the N+1th frame image.
[0006] Thirdly, embodiments of this application provide an electronic device including a processor and a memory, wherein the memory stores programs or instructions executable on the processor, and the programs or instructions, when executed by the processor, implement the steps of the method described in the first aspect.
[0007] Fourthly, embodiments of this application provide a readable storage medium on which a program or instructions are stored, which, when executed by a processor, implement the steps of the method described in the first aspect.
[0008] Fifthly, embodiments of this application provide a chip, the chip including a processor and a communication interface, the communication interface being coupled to the processor, the processor being used to run programs or instructions to implement the method as described in the first aspect.
[0009] In a sixth aspect, embodiments of this application provide a computer program product stored in a storage medium, which is executed by at least one processor to implement the method described in the first aspect.
[0010] In this embodiment, the first position of the image stabilization component at the end of the exposure of the Nth frame image is obtained, where N is a positive integer. Based on the first position and the first reset distance of the image stabilization component in the current shooting mode, a second reset distance of the image stabilization component is determined. During the vertical blanking time (VB) between the Nth and N+1th frames, the image stabilization component is reset according to the second reset distance. Thus, this embodiment fully utilizes the VB time for reset regardless of whether a complete reset is possible within the VB time. After calculating the reset distance based on the current position, the image stabilization component is controlled to reset, allowing it to return to the center position as much as possible, thus providing more stabilization travel for the next frame. Compared to existing technologies that do not reset at all within a short VB time, this improves the stabilization effect and reduces motion blur. Attached Figure Description
[0011] Figure 1 This is one of the flowcharts of the anti-shake control method provided in the embodiments of this application; Figure 2 This is a schematic diagram of the maximum reset distance provided in the embodiments of this application; Figure 3 This is one of the schematic diagrams of resetting from the current position provided in the embodiments of this application; Figure 4 This is a second schematic diagram of resetting from the current position provided in the embodiments of this application; Figure 5 This is a timing diagram of the anti-shake control provided in an embodiment of this application; Figure 6This is the second flowchart of the anti-shake control method provided in the embodiments of this application; Figure 7 This is an overall flowchart of the image stabilization strategy used in shooting provided in the embodiments of this application; Figure 8 This is a structural diagram of the anti-shake control device provided in the embodiments of this application; Figure 9 This is a structural diagram of the electronic device provided in the embodiments of this application; Figure 10 This is a hardware structure diagram of the electronic device provided in the embodiments of this application. Detailed Implementation
[0012] The technical solutions of the embodiments of this application will be clearly described below with reference to the accompanying drawings. Obviously, the described embodiments are only some, not all, of the embodiments of this application. All other embodiments obtained by those skilled in the art based on the embodiments of this application are within the scope of protection of this application.
[0013] The terms "first," "second," etc., used in the specification and claims of this application are used to distinguish similar objects and not to describe a specific order or sequence. It should be understood that such terms can be used interchangeably where appropriate so that embodiments of this application can be implemented in orders other than those illustrated or described herein, and the objects distinguished by "first," "second," etc., are generally of the same class and the number of objects is not limited; for example, a first object can be one or more. Furthermore, in the specification and claims, "and / or" indicates at least one of the connected objects, and the character " / " generally indicates that the preceding and following objects are in an "or" relationship.
[0014] To make the embodiments of this application clearer, the relevant technical knowledge involved in the embodiments of this application will be introduced as follows: Optical image stabilization (OIS) is a technology that typically compensates for hand shake or camera sway by installing moving components inside the lens or on the image sensor. Vertical blanking refers to the time transition required for a scan point to return from the lower right corner to the upper left corner after completing a frame scan, hereinafter referred to as VB; The End of Frame (EOF) moment marks the completion of reading a whole frame of image data by the image sensor. At this moment, the data is transmitted to the subsequent processing unit through the interface for correct image calculation and correction. OIS return to center, also known as OIS reset, refers to the process where the OIS component returns to its center position.
[0015] Performing OIS centering within the VB time allows for a complete OIS stabilization travel distance for the next frame. Without altering the mechanical structure, this effectively increases the stabilization travel distance. Furthermore, since the sensor does not perform exposure operations during the VB time, resetting at this time will not cause motion blur or interfere with imaging, resulting in a significant improvement in the overall image stabilization effect.
[0016] The image stabilization control method provided in this application will be described in detail below with reference to the accompanying drawings, through specific embodiments and application scenarios.
[0017] Please see Figure 1 , Figure 1 A flowchart of the anti-shake control method provided in the embodiments of this application is shown below. Figure 1 As shown, the method includes the following steps: Step 101: Obtain the first position of the image stabilization component at the end of the exposure of the Nth frame image, where N is a positive integer.
[0018] In this application embodiment, the aforementioned image stabilization component can refer to a component on an electronic device that affects image stabilization, such as an OIS component. This application embodiment is applicable to various OIS image stabilization mechanisms, including lens shift, sensor shift, periscope, and gimbal-type OIS.
[0019] The Nth frame image mentioned above can refer to any frame image captured at the time of shooting; for real-time processing, it refers to the current frame image.
[0020] The above-mentioned acquisition of the first position of the image stabilization component at the end of the exposure of the Nth frame refers to the acquisition of the position of the image stabilization component at the EOF time of the Nth frame. In practical applications, the real-time position of the image stabilization component can be read by a Hall sensor.
[0021] Step 102: Determine the second reset distance of the image stabilization component based on the first reset distance between the first position and the first reset distance of the image stabilization component in the current shooting mode.
[0022] In this embodiment of the application, the first reset distance may refer to the maximum reset distance, and the second reset distance is the target reset distance, which may refer to the final actual reset distance.
[0023] Different shooting modes have different frame rates, and corresponding frame interval times also differ. For example, at a frame rate of 60 FPS, the frame interval is 16.6 ms, while at a frame rate of 120 FPS, the frame interval is only 8.3 ms. Therefore, the frame rate interval (VB) of the image stabilization component also differs in different shooting modes. The longer the VB, the longer the reset distance of the image stabilization component; conversely, the shorter the VB, the shorter the reset distance. It is evident that the maximum reset distance of the image stabilization component differs in different shooting modes. The maximum reset distance refers to the maximum resetting distance, also known as the maximum centering distance. In some embodiments, the maximum reset distance corresponding to different shooting modes can be pre-calculated based on parameters such as the frame rate and preset in memory. When image stabilization centering is required, the maximum reset distance corresponding to the current shooting mode is read from this memory.
[0024] In this embodiment, a second reset distance of the image stabilization component can be determined based on the maximum reset distance in the current shooting mode and the current position of the image stabilization component. Specifically, the second reset distance can be determined based on the relationship between the distance of the current position of the image stabilization component from the center position and the maximum reset distance. If the distance of the current position from the center position is greater than the maximum reset distance, it indicates that the component cannot be completely reset to the center position, but can be partially reset. Thus, the second reset distance is determined to be the maximum reset distance or within the maximum reset distance, i.e., the second reset distance does not exceed the maximum reset distance. If the distance of the current position from the center position is not greater than the maximum reset distance, it indicates that the component can be completely reset to the center position. Thus, the second reset distance is determined to be the distance from the current position to the center position, so that the image stabilization component completely returns to the center position or is within this distance.
[0025] Optionally, before step 102, the method further includes: The VB time is determined based on the frame rate, exposure time, and image readout time in the current shooting mode; The first reset distance of the anti-shake component is calculated based on the VB time and the moving speed of the anti-shake component.
[0026] In some embodiments, the VB time between two frames can be calculated based on the frame rate, exposure time, and image readout time in the current shooting mode. Then, based on the VB time and the moving speed of the image stabilization component, the maximum distance that the image stabilization component can reset within the VB time can be calculated.
[0027] Specifically, the corresponding frame interval time can be determined based on the frame rate in the current shooting mode. Then, the exposure time and image readout time are subtracted to obtain the VB time between the Nth frame and the N+1th frame. Multiplying this VB time by the moving speed of the image stabilization component gives the maximum reset distance of the image stabilization component within this VB time.
[0028] Let the available VB time in the current image sensor mode be... t 0, the current OIS movement speed is v If the value is 0, then the OIS value at VB time can be calculated. t Maximum return distance within 0 d 0 is: d 0= v 0× t 0, meaning the maximum reset distance is d 0. For example, d 0 distance can be as Figure 2 As shown.
[0029] In this way, the maximum resettable distance of the anti-shake component within the VB time can be accurately calculated, which helps to accurately calculate the actual reset distance in the future.
[0030] Optionally, the moving speed of the anti-shake component is determined by physically testing the displacement of the anti-shake component under sinusoidal jitter at a preset frequency.
[0031] In some embodiments, the moving speed of the image stabilization component v The value of 0 can be obtained through comprehensive simulation calculations based on factors such as sensor module weight, OIS drive module thrust, current, and voltage, followed by measurement in real physical testing. A simple testing method involves fixing the electronic device on a vibration table, inputting a sinusoidal vibration of known frequency / amplitude, and then using an electromagnetic encoder to read the relative displacement of the lens. x ,calculate x / t v 0, where the sinusoidal jitter frequency is known and t is a known value.
[0032] Step 103: During the vertical blanking VB time between the Nth frame image and the N+1th frame image, reset the image stabilization component according to the second reset distance.
[0033] During the VB time interval between the Nth and N+1th frames, before image exposure occurs, the image stabilization component is reset according to the second reset distance. This means either resetting the image stabilization component to the second reset distance or controlling the reset distance to be within the second reset distance. After reset, the image stabilization component returns to a position closer to the center than the first position. This allows for more stabilization travel for the image stabilization component in the N+1th frame, improving the stabilization effect in that frame.
[0034] Optionally, after step 103, the method further includes: When the exposure of the N+1th frame begins, the image stabilization component starts stabilizing from the second position, where the second position is the position to which the image stabilization component returns after resetting according to the second reset distance.
[0035] That is, after the image stabilization component is reset according to the second reset distance, it resets towards the center position and finally returns to the second position. When the next frame of the image is exposed, the image stabilization component starts stabilizing from the second position. Since the second position is closer to the center position than the first position before returning to the center, it can provide the image stabilization component with more stabilization travel in the next frame exposure, ultimately improving the image stabilization effect.
[0036] Optionally, step 102 includes: Determine a first distance from the first position to the center point of the image stabilization component; If the first distance is greater than the first reset distance, the second reset distance is determined to be the first reset distance; If the first distance is less than or equal to the first reset distance, the second reset distance is determined to be the first distance.
[0037] In some embodiments, the distance from the center position can be determined based on the current position of the image stabilization component, and then compared with the maximum resettable distance in the current mode to determine whether the image stabilization component can completely return to the center position within the VB time. Based on the determination result, a second reset distance within the VB time can be determined.
[0038] Specifically, the distance between the current position and the center position of the image stabilization component can be determined based on the current position and the center position of the image stabilization component, that is, the first distance between the first position and the center point position of the image stabilization component. In specific implementation, the Hall value of the distance between the OIS position and the center point position at the EOF time of the Nth frame image can be obtained, denoted as... d 1.
[0039] The Hall value is the reading from the Hall sensor. It works by sensing changes in the magnetic field of the permanent magnet on the lens, converting the magnetic signal into an electrical signal to read the lens displacement. The OIS system typically uses this actual displacement for feedback and closed-loop control. Specific parameters of the Hall sensor vary depending on the model, but generally meet conditions such as a resolvable displacement accuracy of less than 0.1µm, a sampling frequency greater than 1kHz, and a linearity of output Hall value with actual displacement greater than 99%.
[0040] The maximum resettable distance is denoted as d 0, then determine d Is 1 less than d 0, if d 1> d If 0 indicates that the anti-shake component cannot completely return to the center position from its current position within VB time, then the second reset distance is determined to be the maximum resettable distance. d 0, to drive the image stabilization components back to a position as close to the center as possible; if d 1≤ d A value of 0 indicates that the shake amplitude within this frame may be small, resulting in minimal lens shift from the stabilization center point. The stabilization component can return to its center position within VB time, thus determining the second reset distance as the first distance. d 1. To drive the image stabilization components back to the center position completely.
[0041] This implementation method allows for the determination of a second reset distance that is as large as possible based on the relationship between the distance from the current position of the image stabilization component to the center position and the maximum reset distance. This drives the image stabilization component back to a position as close to the center position as possible, thereby maximizing the image stabilization travel for the next frame and improving the image stabilization effect.
[0042] Optionally, step 103 includes: During the VB time period, the anti-shake component is controlled to move the second reset distance in the direction of the center point of the anti-shake component; Wherein, if the first distance is greater than the first reset distance, the distance from the second position to the center point is the difference between the first distance and the first reset distance; If the first distance is less than or equal to the first reset distance, the second position is the center point position.
[0043] In some embodiments, the image stabilization component can be controlled to move the second reset distance towards the center point of the image stabilization component within the VB time interval between the Nth frame and the N+1th frame, so that the image stabilization component returns to the position closest to the center point within a limited VB time interval.
[0044] Specifically, at the first distance d 1 is greater than the maximum resettable distance. d When the value is 0, the stabilization component is driven to move a distance towards the center point. d 0, to push the image stabilization component to a second position as close as possible to the center point, at which point the distance of the second position from the center point is... d 2 represents the first distance. d 1 and maximum reset distance d The difference of 0, that is d 2= d 1- d 0. After the next frame exposure begins, the image stabilization component is enabled from the second position.
[0045] The physical meaning is the maximum distance that can be moved from the current position back to the center. d The distance from the center point to the position after 0 is d 2. For example, such as Figure 3 As shown, at this time d 1 is 1200. d 0 represents 1000. d 1> d 0, then d 2= d 1- d 0 = 1200 - 1000 = 200, then d 2 = 200, indicating that the position after returning to the center is 200 units away from the center point.
[0046] At the first distance d 1 is less than or equal to the maximum resettable distance. d When the value is 0, the stabilization component is driven to move a distance towards the center point. d 1. To push the image stabilization component back to the center position, at which point the second position becomes the center position of the image stabilization component. After the next frame exposure begins, the image stabilization component is enabled from the center position.
[0047] For example, such as Figure 4 As shown, at this time d 1 is 800, d 0 represents 1000. d 1< d 0. The OIS position is relatively close to the center point, and within the VB time, the OIS can completely return to the center position, that is, return to... d At the position where 2=0.
[0048] In this way, after completing the centering motion within the VB time, the image stabilization component returns to either the exact center point or close to the center point. At this point, the exposure of the N+1th frame begins, and OIS stabilization is enabled from the current position, fully utilizing the greater stabilization travel to ensure effective image stabilization.
[0049] Optionally, the first position and the second position are the positions of the image stabilization component in the X-axis, Y-axis or Z-axis direction.
[0050] That is, the anti-shake centering technology in this application embodiment can be applied to the X-axis, Y-axis and Z-axis of the OIS anti-shake component at the same time. For displacement on any axis, the embodiment of this application can be used to perform inter-frame centering, increase the anti-shake travel and improve the anti-shake effect of the OIS component in each axis direction.
[0051] In summary, the embodiment of this application performs the OIS centering operation during the idle VB time between the end of the Nth frame exposure and the start of the (n+1)th frame exposure. The specific timing can be as follows: Figure 5 As shown.
[0052] During the VB phase, the OIS centering action will determine whether to perform an incomplete centering action based on the real-time OIS position of each frame. The process and judgment logic are as follows: Figure 6 As shown, it includes the following steps: Step 601: Start the centering process at the EOF time when the exposure of the Nth frame ends.
[0053] Let the obtained current exposure condition be combined with the available VB time in the current shooting mode as follows: t 0, the OIS component moving speed is v 0 allows us to calculate the maximum return distance within the VB time period. d 0= v 0× t 0.
[0054] Step 602: Obtain the distance between the position of the OIS component and the center point at the EOF time. d 1, such as Figure 2 and Figure 3 As shown.
[0055] Step 603, Judgment d Is 1 less than d 0, meaning whether it can completely return to the center. If d 1> d 0 indicates that it is impossible to completely return to the center point from the current position within the VB time, and step 604 is executed; if d 1< d 0 indicates that the shaking amplitude within this frame may be small, and the lens offset from the stabilization center point is small, so it can return to the center within VB time and execute step 605.
[0056] Step 604: Push the OIS component as close as possible to the center point. The distance between this position and the center point is... d 2. After the next frame exposure begins, the OIS component moves from a position relative to the center point. d Enabled at position 2, where, d 2 =d 1- d 0.
[0057] Step 605: Enable the full return to image stabilization center action, pushing the OIS component back to the center point position. For example, at this time... d 1 is 800, d 0 represents 1000. d 1< d 0. The current position of the OIS component is relatively close to the center point. Within the VB time frame, the OIS component can completely return to the center point. d 2 = 0.
[0058] Step 606: After completing the centering action of Step 605 or Step 604 within the VB time, the OIS component returns to the exact center position or close to the center position. At this time, the exposure of the N+1th frame begins, and the OIS component image stabilization is enabled from the current position, which can make full use of the larger image stabilization range.
[0059] The method in this application mainly changes the OIS action during inter-frame VB time, and from a continuous time perspective, it mainly takes effect in the inter-frame image stabilization strategy. The overall shooting process is as follows: Figure 7 As shown. Intra-frame stabilization can use general intra-frame stabilization strategies or other stabilization strategies, and can be used in conjunction with the inter-frame stabilization strategy of this application without special restrictions.
[0060] This application embodiment can make full use of the limited VB time to partially center back even when the VB duration is not sufficient to fully return to the center point. Even if it does not fully return to the center point, it will still be closer to the center point than not centering at all, thus freeing up more usable range for the next frame. The effect is also improved compared to not centering at all, expanding the effective scenarios of VB centering. In high frame rate modes such as 60 frames, the mode that originally could not center back can also be effective by applying this application embodiment, reducing motion blur.
[0061] The OIS centering optimization method in this application can be used in conjunction with various image sensor modes, such as 60fps and 120fps recording modes, to optimize issues such as motion blur during video recording. Simultaneously, it can adaptively adjust the centering travel based on the OIS motor performance. In practical applications, this significantly expands the effective scenarios for the centering function, extending the stabilization travel even with limited hardware, and greatly contributing to improving motion blur.
[0062] The image stabilization control method in this embodiment obtains the first position of the image stabilization component at the end of the exposure of the Nth frame image, where N is a positive integer; determines the second reset distance of the image stabilization component based on the first position and the first reset distance of the image stabilization component in the current shooting mode; and resets the image stabilization component according to the second reset distance during the vertical blanking time (VB) between the Nth frame image and the N+1th frame image. Thus, this embodiment fully utilizes the VB time for reset regardless of whether a complete reset is possible within the VB time. After calculating the reset distance based on the current position, it controls the image stabilization component to reset, allowing it to return to the center position as much as possible, thus providing more stabilization travel for the next frame. Compared to existing technologies that do not reset at all within a short VB time, this method improves image stabilization performance and reduces motion blur.
[0063] The image stabilization control method provided in this application can be executed by an image stabilization control device. This application uses an image stabilization control device executing the image stabilization control method as an example to illustrate the image stabilization control device provided in this application.
[0064] Please see Figure 8 , Figure 8 This is a schematic diagram of the structure of the anti-shake control device provided in the embodiments of this application, as shown below. Figure 8 As shown, the image stabilization control device 800 includes: The acquisition module 801 is used to acquire the first position of the image stabilization component at the end of the exposure of the Nth frame image, where N is a positive integer; The first determining module 802 is used to determine the second reset distance of the image stabilization component based on the first position and the first reset distance of the image stabilization component in the current shooting mode; The reset module 803 is used to reset the image stabilization component according to the second reset distance during the vertical blanking VB time between the Nth frame image and the N+1th frame image.
[0065] Optionally, when the exposure of the N+1th frame begins, the image stabilization component starts stabilizing from a second position, wherein the second position is the position to which the image stabilization component returns after resetting according to the second reset distance.
[0066] Optionally, the image stabilization control device 800 also includes: The second determining module is used to determine the VB time based on the frame rate, exposure time, and image readout time in the current shooting mode; The calculation module is used to calculate the first reset distance of the anti-shake component based on the VB time and the moving speed of the anti-shake component.
[0067] Optionally, the moving speed of the anti-shake component is determined by physically testing the displacement of the anti-shake component under sinusoidal jitter at a preset frequency.
[0068] Optionally, the first determining module 802 includes: The first determining unit is configured to determine a first distance from the first position to the center point of the image stabilization component; The second determining unit is configured to determine the second reset distance as the first reset distance when the first distance is greater than the first reset distance; The third determining unit is configured to determine the second reset distance as the first distance when the first distance is less than or equal to the first reset distance.
[0069] Optionally, the reset module 803 is used to control the anti-shake component to move the second reset distance in the direction of the center point of the anti-shake component; Wherein, if the first distance is greater than the first reset distance, the distance from the second position to the center point is the difference between the first distance and the first reset distance; If the first distance is less than or equal to the first reset distance, the second position is the center point position.
[0070] Optionally, the first position and the second position are the positions of the image stabilization component in the X-axis, Y-axis or Z-axis direction.
[0071] The image stabilization control device 800 in this embodiment obtains the first position of the image stabilization component at the end of the exposure of the Nth frame image, where N is a positive integer; determines the second reset distance of the image stabilization component based on the first position and the first reset distance of the image stabilization component in the current shooting mode; and resets the image stabilization component according to the second reset distance during the vertical blanking time (VB) between the Nth frame image and the N+1th frame image. Thus, this embodiment fully utilizes the VB time for reset regardless of whether a complete reset is possible within the VB time. After calculating the reset distance based on the current position, it controls the image stabilization component to reset, allowing it to return to the center position as much as possible, thus providing more stabilization travel for the next frame. Compared to the prior art where no reset occurs within a short VB time, this improves the image stabilization effect and reduces motion blur.
[0072] The image stabilization control device in this application embodiment can be an electronic device or a component within an electronic device, such as an integrated circuit or a chip. The electronic device can be a terminal or other devices besides a terminal. For example, the electronic device can be a mobile phone, tablet computer, laptop computer, PDA, in-vehicle electronic device, mobile internet device (MID), augmented reality (AR) / virtual reality (VR) device, robot, wearable device, ultra-mobile personal computer (UMPC), netbook, or personal digital assistant (PDA), etc. It can also be a server, network attached storage (NAS), personal computer (PC), television (TV), ATM, or self-service machine, etc. This application embodiment does not specifically limit the device.
[0073] The image stabilization control device in this application embodiment can be a device with an operating system. This operating system can be Android, iOS, or other possible operating systems; this application embodiment does not specifically limit the specific operating system used.
[0074] The anti-shake control device provided in this application embodiment can achieve... Figure 1 and Figure 6 The various processes implemented in the method embodiments can achieve the same technical effect, and will not be described again here to avoid repetition.
[0075] Optionally, such as Figure 9 As shown, this application embodiment also provides an electronic device 900, including a processor 901 and a memory 902. The memory 902 stores a program or instructions that can run on the processor 901. When the program or instructions are executed by the processor 901, they implement the various steps of the above-described anti-shake control method embodiment and can achieve the same technical effect. To avoid repetition, they will not be described again here.
[0076] It should be noted that the electronic devices in the embodiments of this application include the mobile electronic devices and non-mobile electronic devices described above.
[0077] Figure 10 A schematic diagram of the hardware structure of an electronic device to implement an embodiment of this application.
[0078] The electronic device 1000 includes, but is not limited to, the following components: radio frequency unit 1001, network module 1002, audio output unit 1003, input unit 1004, sensor 1005, display unit 1006, user input unit 1007, interface unit 1008, memory 1009, and processor 1010.
[0079] Those skilled in the art will understand that the electronic device 1000 may also include a power supply (such as a battery) for supplying power to various components. The power supply may be logically connected to the processor 1010 through a power management system, thereby enabling functions such as managing charging, discharging, and power consumption through the power management system. Figure 10 The electronic device structure shown does not constitute a limitation on the electronic device. The electronic device may include more or fewer components than shown, or combine certain components, or have different component arrangements, which will not be elaborated here.
[0080] The processor 1010 is used for: Obtain the first position of the image stabilization component at the end of the exposure of the Nth frame image, where N is a positive integer; Based on the first position and the first reset distance of the image stabilization component in the current shooting mode, determine the second reset distance of the image stabilization component; During the vertical blanking VB time between the Nth frame and the N+1th frame, the image stabilization component is reset according to the second reset distance.
[0081] Optionally, when the exposure of the N+1th frame begins, the image stabilization component starts stabilizing from a second position, wherein the second position is the position to which the image stabilization component returns after resetting according to the second reset distance.
[0082] Optionally, the processor 1010 is also used for: The VB time is determined based on the frame rate, exposure time, and image readout time in the current shooting mode; The maximum reset distance of the anti-shake component is calculated based on the VB time and the moving speed of the anti-shake component.
[0083] Optionally, the moving speed of the anti-shake component is determined by physically testing the displacement of the anti-shake component under sinusoidal jitter at a preset frequency.
[0084] Optionally, the processor 1010 is also used for: Determine a first distance from the first position to the center point of the image stabilization component; If the first distance is greater than the maximum reset distance, the second reset distance is determined to be the first reset distance; If the first distance is less than or equal to the first reset distance, the second reset distance is determined to be the first distance.
[0085] Optionally, the processor 1010 is also used for: Control the image stabilization component to move the second reset distance towards the center point of the image stabilization component; Wherein, if the first distance is greater than the first reset distance, the distance from the second position to the center point is the difference between the first distance and the first reset distance; If the first distance is less than or equal to the first reset distance, the second position is the center point position.
[0086] Optionally, the first position and the second position are the positions of the image stabilization component in the X-axis, Y-axis or Z-axis direction.
[0087] It should be understood that, in this embodiment, the input unit 1004 may include a graphics processing unit (GPU) 10041 and a microphone 10042. The GPU 10041 processes image data of still images or videos obtained by an image capture device (such as a camera) in video capture mode or image capture mode. The display unit 1006 may include a display panel 10061, which may be configured in the form of a liquid crystal display, an organic light-emitting diode, etc. The user input unit 1007 includes a touch panel 10071 and at least one of other input devices 10072. The touch panel 10071 is also called a touch screen. The touch panel 10071 may include a touch detection device and a touch controller. Other input devices 10072 may include, but are not limited to, physical keyboards, function keys (such as volume control buttons, power buttons, etc.), trackballs, mice, joysticks, etc., which will not be described in detail here. The memory 1009 can be used to store software programs and various data. The memory 1009 may primarily include a first storage area for storing programs or instructions and a second storage area for storing data. The first storage area may store the operating system, application programs or instructions required for at least one function (such as sound playback, image playback, etc.). Furthermore, the memory 1009 may include volatile memory or non-volatile memory, or both. The non-volatile memory may be read-only memory (ROM), programmable read-only memory (PROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), or flash memory. Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM), and direct memory bus RAM (DRRAM). The memory 1009 in this embodiment includes, but is not limited to, these and any other suitable types of memory.
[0088] The processor 1010 may include one or more processing units; optionally, the processor 1010 integrates an application processor and a modem processor, wherein the application processor mainly handles operations involving the operating system, user interface, and applications, and the modem processor mainly handles wireless communication signals, such as a baseband processor. It is understood that the aforementioned modem processor may also not be integrated into the processor 1010.
[0089] This application also provides a readable storage medium storing a program or instructions. When the program or instructions are executed by a processor, they implement the various processes of the above-described anti-shake control method embodiments and achieve the same technical effect. To avoid repetition, they will not be described again here.
[0090] The processor is the processor in the electronic device described in the above embodiments. The readable storage medium includes computer-readable storage media, such as computer read-only memory (ROM), random access memory (RAM), magnetic disk, or optical disk.
[0091] This application embodiment also provides a chip, which includes a processor and a communication interface. The communication interface is coupled to the processor. The processor is used to run programs or instructions to implement the various processes of the above-described anti-shake control method embodiments and can achieve the same technical effect. To avoid repetition, it will not be described again here.
[0092] It should be understood that the chip mentioned in the embodiments of this application may also be referred to as a system-on-a-chip, system chip, chip system, or system-on-a-chip, etc.
[0093] This application provides a computer program product, which is stored in a storage medium and executed by at least one processor to implement the various processes of the anti-shake control method embodiments described above, and can achieve the same technical effect. To avoid repetition, it will not be described again here.
[0094] It should be noted that, in this document, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes that element. Furthermore, it should be noted that the scope of the methods and apparatuses in the embodiments of this application is not limited to performing functions in the order shown or discussed, but may also include performing functions substantially simultaneously or in the reverse order, depending on the functions involved. For example, the described methods may be performed in a different order than described, and various steps may be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.
[0095] Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus necessary general-purpose hardware platforms. Of course, they can also be implemented by hardware, but in many cases the former is a better implementation method. Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, can be embodied in the form of a computer software product. This computer software product is stored in a storage medium (such as ROM / RAM, magnetic disk, optical disk) and includes several instructions to cause a terminal (which may be a mobile phone, computer, server, or network device, etc.) to execute the methods described in the various embodiments of this application.
[0096] The embodiments of this application have been described above with reference to the accompanying drawings. However, this application is not limited to the specific embodiments described above. The specific embodiments described above are merely illustrative and not restrictive. Those skilled in the art can make many other forms under the guidance of this application without departing from the spirit and scope of the claims, and all of these forms are within the protection scope of this application.
Claims
1. A method for stabilizing image control, characterized in that, include: Obtain the first position of the image stabilization component at the end of the exposure of the Nth frame image, where N is a positive integer; Based on the first position and the first reset distance of the image stabilization component in the current shooting mode, determine the second reset distance of the image stabilization component; During the vertical blanking VB time between the Nth frame and the N+1th frame, the image stabilization component is reset according to the second reset distance.
2. The method according to claim 1, characterized in that, After resetting the image stabilization component according to the second reset distance, the method further includes: When the exposure of the N+1th frame begins, the image stabilization component starts stabilizing from the second position, where the second position is the position to which the image stabilization component returns after resetting according to the second reset distance.
3. The method according to claim 1, characterized in that, Before determining the second reset distance of the image stabilization component based on the first position and the first reset distance of the image stabilization component in the current shooting mode, the method further includes: The VB time is determined based on the frame rate, exposure time, and image readout time in the current shooting mode; The first reset distance of the anti-shake component is calculated based on the VB time and the moving speed of the anti-shake component.
4. The method according to claim 3, characterized in that, The moving speed of the anti-shake component is determined by physically testing the displacement of the anti-shake component under sinusoidal jitter at a preset frequency.
5. The method according to any one of claims 1 to 4, characterized in that, Determining the second reset distance of the image stabilization component based on the first position and the first reset distance of the image stabilization component in the current shooting mode includes: Determine a first distance from the first position to the center point of the image stabilization component; If the first distance is greater than the first reset distance, the second reset distance is determined to be the first reset distance; If the first distance is less than or equal to the first reset distance, the second reset distance is determined to be the first distance.
6. The method according to claim 5, characterized in that, The step of resetting the image stabilization component according to the second reset distance includes: Control the image stabilization component to move the second reset distance towards the center point of the image stabilization component; Wherein, when the first distance is greater than the first reset distance, the distance of the second position from the center point is the difference between the first distance and the first reset distance, and the second position is the position to which the anti-shake component returns after being reset according to the second reset distance; If the first distance is less than or equal to the first reset distance, the second position is the center point position.
7. The method according to claim 2 or 6, characterized in that, The first position and the second position are the positions of the image stabilization component in the X-axis, Y-axis or Z-axis direction.
8. A shake-resistant control device, characterized in that, include: The acquisition module is used to obtain the first position of the image stabilization component at the end of the exposure of the Nth frame image, where N is a positive integer; The first determining module is used to determine the second reset distance of the image stabilization component based on the first position and the first reset distance of the image stabilization component in the current shooting mode; The reset module is used to reset the image stabilization component according to the second reset distance during the vertical blanking VB time between the Nth frame image and the N+1th frame image.
9. An electronic device, characterized in that, It includes a processor and a memory, the memory storing a program or instructions that can run on the processor, the program or instructions being executed by the processor to implement the steps of the anti-shake control method as described in any one of claims 1 to 7.
10. A readable storage medium, characterized in that, The readable storage medium stores a program or instructions that, when executed by a processor, implement the steps of the anti-shake control method as described in any one of claims 1 to 7.