ROI Tracking Stabilization for High-Magnification Zoom Preview
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image stabilization techniques struggle to maintain a stable and smooth framing of objects of interest at high magnification ratios, particularly due to hardware limitations such as gyro noise, OIS sensing noise, and calibration errors, leading to residual motion and challenges in transitioning between different modes.
Innovation Solution
A neural network-based image stabilization method that tracks the region of interest (ROI) using saliency detection and optical flow, combined with gyro and OIS data, to stabilize the image and maintain the ROI at the center of the viewfinder, while overcoming hardware limitations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Length of moving object
If high magnification ratio is used to capture distant objects, then the ability to capture distant objects is improved, but image stability and framing accuracy deteriorate due to hardware limitations
Solution Approach 1:
The patent introduces an intermediary stabilization system that includes sensor data acquisition (gyroscopes, accelerometers), neural network-based motion trajectory prediction, and compensation mechanisms. This intermediary system processes sensor data to predict and compensate for camera motion, thereby stabilizing the image at high magnification ratios without sacrificing the ability to capture distant objects.
Solution Approach 2:
The patent implements a feedback loop where sensor data continuously monitors camera motion, the neural network predicts motion trajectories, and the system adjusts the captured image in real-time to compensate for detected movements. This closed-loop feedback mechanism maintains image stability despite high magnification ratios that would otherwise amplify hardware limitations.
2Reliability
If traditional stabilization methods are used, then some level of stability is achieved, but residual motion and framing difficulty persist due to gyro noise and sensor latency
Solution Approach 1:
The patent replaces traditional mechanical stabilization systems (which rely on physical gyroscopes and optical image stabilization) with a computational approach using neural networks and sensor fusion. This substitution eliminates the limitations of mechanical systems, including gyro noise and signal latency, by using software-based motion prediction and compensation that achieves superior framing accuracy and stabilization effectiveness.
Solution Approach 2:
The patent changes the parameters of the stabilization system by transitioning from hardware-dependent parameters (gyro sensitivity, OIS response time) to software-controlled parameters (neural network prediction accuracy, sensor fusion algorithms). This parameter transformation allows the system to overcome the fixed limitations of hardware and achieve both high stabilization effectiveness and precise framing accuracy.
3Length of moving object
If zoomed mode is activated for high magnification, then the ability to view distant objects is improved, but object tracking and framing become difficult due to narrow field of view
Solution Approach 1:
The patent applies preliminary action by using the neural network to predict future motion trajectories of both the camera and the region of interest before the actual movement occurs. This predictive capability allows the system to pre-adjust the framing and tracking parameters, making object tracking in zoomed mode as easy as in normal mode, while maintaining high magnification ratios.
Data Source
AI summary
An example method includes displaying, by a display screen of an image capturing device, a preview of an image representing a field of view of the image capturing device. The method includes determining a region of interest in the preview. The method includes transitioning the image capturing device from a normal mode of operation to a zoomed mode of operation. The zoomed mode of operation includes: determining, based on sensor data collected by a sensor associated with the image capturing device, a motion trajectory for the region of interest, and based on the determined motion trajectory, generating an adjusted preview representing zoomed portion of the field of view. The adjusted preview displays the region of interest at or near a center of the zoomed portion. The method includes providing the adjusted preview of the portion of the field of view.


