Image Signal Processor Digital Stabilization OIS Translation Estimation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Electronic devices that perform digital image stabilization without optical image stabilization (OIS) 2D translation information often result in wobbling of final processed images due to the lack of reflection of OIS 2D translation information during image capture, especially when the device shakes three-dimensionally.
Innovation Solution
An electronic device comprising a camera module and an image signal processor that generates and processes gyro data and frame data to estimate OIS 2D translation information, filters out low-frequency components, and calculates stabilized camera motion information to compensate for camera module movements, thereby performing accurate digital image stabilization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If digital image stabilization is performed using only camera module rotation information and frame rotation information, then the device can perform stabilization without OIS 2D translation information, but image wobbling appears in the final processed image
Solution Approach 1:
The patent introduces an intermediary estimation process that infers OIS 2D translation information from available sensor data (gyro data and frame data). The image signal processor acts as a mediator that reconstructs the missing OIS translation information by combining camera rotation information from gyro data and frame rotation information, thereby enabling accurate digital image stabilization without direct OIS 2D translation information
Solution Approach 2:
The patent creates a copy or approximation of the OIS 2D translation information that would normally be provided by the optical image stabilizer. By estimating the translation information from gyro and frame data, the system replicates the effect of OIS in the digital domain, allowing the image stabilization to proceed as if the OIS information were directly available
2Device complexity
If OIS 2D translation information is not provided to the image signal processor, then the device can operate with limited sensor capabilities, but accurate image stabilization cannot be achieved
Solution Approach 1:
The patent transforms the available sensor parameters (gyro data representing camera rotation and frame data representing frame rotation) into estimated OIS 2D translation information. By changing the parameters from direct OIS translation measurements to derived estimates from rotation data, the system achieves the same stabilization effect with different, more universally available sensor inputs
Data Source
AI summary
An electronic device comprises a camera module and an image signal processor. The camera module generates and outputs gyro data and frame data for an input image. The image signal processor comprises a motion vector module which calculates motion vector information, a gyro-based motion estimator which extracts camera rotation information of the camera module from the gyro data, a motion vector-based motion estimator which extracts frame rotation information from the frame data, an optical image stabilization (OIS) two-dimensional (2D) translation information estimator which estimates OIS 2D translation information based on the motion vector information, the camera rotation information, and the frame rotation information, and a camera path optimizer which filters out a low-frequency component from the OIS 2D translation information and calculates stabilized camera motion information of the camera module using the filtered OIS 2D translation information and the camera rotation information.