Electronic Image Stabilization Using Gyroscope and Edge Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Handheld devices like camera phones suffer from image blurring due to hand jitter, which current image stabilization techniques, especially electronic image stabilization, struggle to effectively address, particularly in devices with smaller pixels and higher pixel densities, as they often discard useful data and face limitations in processing and non-linearities.
Innovation Solution
A method using a motion detection unit, such as a gyroscope, to capture images with predetermined blur properties, combining short and long exposure frames through edge detection and point spread function analysis to electronically stabilize images, reducing processing requirements and improving image quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional electronic image stabilization techniques are used to remove blur from images, then image stabilization is achieved, but useful data from long exposure frames is discarded and processing requirements increase
Solution Approach 1:
The patent converts the previously harmful blur in long exposure frames into a beneficial resource by recognizing that blurred edges contain valuable information for stabilization. Instead of discarding long exposure frames as conventional techniques do, the invention uses edge detection to extract usable edge information from both sharp and blurred images, transforming the wasted data into useful stabilization input that improves final image quality
Solution Approach 2:
The patent recovers useful information that was previously discarded by conventional EIS techniques. By implementing edge detection algorithms that can identify and extract valid edge information from long exposure frames even when blurred, the system recovers data that would otherwise be thrown away, thereby reducing information loss while maintaining stabilization effectiveness
2Illumination intensity
If longer exposure time is used to capture image, then more light is captured improving image quality, but hand jitter causes more blur in the image
Solution Approach 1:
The patent employs feedback mechanisms where gyroscope data about device motion is continuously monitored and used to guide the image stabilization process. The system uses edge detection to identify which edges are blurred due to motion, then applies targeted stabilization transformations based on gyroscope measurements, creating a feedback loop that compensates for the blur introduced by longer exposure times
Solution Approach 2:
The patent replaces mechanical image stabilization systems with an electronic/software-based solution. Instead of using physical actuators to move lenses or sensors during long exposure, the system captures the blurred image and uses computational methods including edge detection and gyroscope data to electronically stabilize the image, substituting mechanical intervention with digital processing
3Area of moving object
If smaller pixels are used in handheld devices, then device size is reduced, but exposure time must be increased leading to more blur
Solution Approach 1:
The patent replaces the need for longer exposure times with an electronic stabilization solution. By using edge detection algorithms combined with gyroscope data to stabilize images computationally, the system allows smaller pixels to be used without being forced to increase exposure time, thereby maintaining compact device size while preventing blur that would otherwise result from the longer exposure requirement
4Reliability
If conventional actuators are used for optical image stabilization, then image stability is improved, but device size and cost increase
Solution Approach 1:
The patent substitutes mechanical actuators with an electronic/software-based stabilization system. Instead of using physical components like voice coil actuators or moving lens elements that increase device volume, the invention uses gyroscope data and edge detection algorithms to computationally stabilize images, eliminating the need for bulky mechanical OIS components while maintaining image stability
Solution Approach 2:
The patent creates a computational model of the device motion using gyroscope data and uses this model to generate a stabilized version of the image. By copying the motion characteristics from the gyroscope measurements and applying inverse transformations to the image data, the system achieves stabilization without physical moving parts
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach enhances image stabilization by leveraging gyroscope data to minimize blur, reducing processing power and memory usage, and producing higher quality images with less distortion, even in devices with smaller pixels and higher pixel densities.
Implementation Method 1
a motion detection unit, such as a gyroscope, to capture images with predetermined blur properties
Data Source
AI summary
Methods and apparatus for electronically stabilizing an image captured by a device including a motion detection unit are provided. In one implementation, the method includes capturing a first exposure of the image, and capturing a second exposure of the image including using the motion detection unit to ensure that the second exposure of the image has a pre-determined blur property. The second exposure is longer than the first exposure. The method further includes combining the second exposure of the image having the pre-determined blur property and the first exposure of the image to electronically stabilize the image captured by the device.