Standalone EIS Unit for Image Stabilization Without GPU Transfer
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional electronic image stabilization in electronic devices relies on graphics processing units (GPUs), which can lead to inefficiencies due to data transfer delays and increased memory requirements, as well as potential errors and higher costs, especially when complete image frames need to be stored and processed.
Innovation Solution
Implementing a standalone electronic image stabilization (S-EIS) unit that performs image stabilization without a GPU, using a processor and memory to reduce data transfer, eliminate timing issues, and minimize memory needs by cropping, filtering, and transforming image data in situ, allowing for efficient image stabilization and reduced latency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional GPU-based electronic image stabilization is used, then image stabilization can be achieved, but data transfer delays and increased memory requirements occur
Solution Approach 1:
The patent segments the image stabilization function from the main GPU processing pipeline by implementing a dedicated EIS processor that operates independently. This segmentation allows the EIS processor to receive only necessary image data portions (cropped regions) rather than complete frames, reducing data transfer volume and timing conflicts with other GPU operations.
Solution Approach 2:
The patent extracts the essential stabilization function from the complex GPU system by creating a standalone EIS processor. This extracted component performs only the necessary stabilization operations on cropped image portions, eliminating the need for complete frame transfers to the GPU and reducing data transfer delays.
2Reliability
If traditional GPU-based electronic image stabilization is used, then image stabilization can be achieved, but memory requirements and costs increase
Solution Approach 1:
The patent applies local quality by processing only the necessary portions of image data rather than complete frames. The EIS processor receives and stabilizes only cropped regions containing the actual image content, while discarding peripheral data, thereby reducing memory requirements and associated costs.
Solution Approach 2:
The patent implements partial action by performing stabilization only on the necessary cropped portions of image data rather than processing complete frames. This partial processing approach reduces the quantity of data that needs to be stored in memory, lowering memory requirements and costs while maintaining stabilization effectiveness.
3Reliability
If complete image frames are stored and processed, then image stabilization can be performed, but processing efficiency decreases
Solution Approach 1:
The patent applies preliminary action by cropping image data to necessary portions before the stabilization processing occurs. This pre-processing step eliminates unnecessary data early in the pipeline, so that subsequent stabilization operations work only with essential image content, improving overall processing efficiency.
Solution Approach 2:
The patent implements discarding by eliminating unnecessary peripheral portions of image frames through cropping before stabilization. By discarding redundant data that would otherwise require processing and memory storage, the system improves processing efficiency while maintaining the essential stabilization function on the retained image content.
Data Source
AI summary
In a method of electronic image stabilization, a processor buffers image data into a memory buffer, the image data being obtained by the processor from an image sensor disposed in an electronic device. The processor obtains motion data from a motion sensor disposed in the electronic device, wherein the motion data corresponds with a time of capture of the image data. The processor analyzes the motion data to determine a stabilization correction to apply to the image data. The processor applies the determined stabilization correction to the image data to achieve stabilized image data. The determined stabilization correction is applied, and the stabilized image data is achieved, by the processor without requiring a transfer of the image data from the memory buffer to a graphics processing unit. The stabilized image data is output.