Dynamic Electronic Image Stabilization for Power-Efficient Video Recording
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current electronic image stabilization (EIS) solutions are inefficient and consume high power due to redundant operations, particularly in devices with limited compute and energy resources, such as mobile devices, which affects video recording quality.
Innovation Solution
A power-efficient dynamic EIS method that switches between single-pass and dual-pass stabilization processes based on motion measurements, using single motion stabilization passes for both frame preview and recording when motion is low, and dual-pass processes when motion is high, to optimize power usage while maintaining image quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If dual-pass stabilization process is used for both frame preview and video recording, then image stabilization quality is improved, but power consumption increases
Solution Approach 1:
The system dynamically switches between single-pass and dual-pass stabilization processes based on real-time motion measurements. When motion is detected above a threshold, the system uses dual-pass stabilization to maintain quality; when motion is below the threshold, it switches to single-pass stabilization to reduce power consumption. This dynamic adaptation resolves the contradiction by making the stabilization intensity variable rather than fixed.
Solution Approach 2:
The patent changes the processing parameter (number of stabilization passes) based on motion conditions. By monitoring motion measurements and adjusting the stabilization process intensity accordingly, the system optimizes the balance between image quality and power consumption, using full dual-pass processing only when necessary rather than continuously.
2Manufacturing precision
If dual-pass stabilization process is used, then stabilization accuracy is improved, but processing time increases
Solution Approach 1:
The system dynamically adjusts processing intensity based on motion conditions. During low-motion periods, single-pass stabilization is sufficient and faster; during high-motion periods, dual-pass stabilization is applied to ensure accuracy. This dynamic approach optimizes the time-quality tradeoff by applying intensive processing only when necessary.
Solution Approach 2:
The system periodically monitors motion measurements and adjusts stabilization processing accordingly. Rather than continuously applying dual-pass stabilization, the system uses periodic motion assessment to determine when intensive processing is needed, reducing overall processing time while maintaining accuracy during critical moments.
3Use of energy by moving object
If single-pass stabilization process is used, then power consumption is reduced, but image stabilization quality deteriorates
Solution Approach 1:
The system changes the stabilization processing parameter based on motion conditions. During low-motion periods, single-pass stabilization provides sufficient quality at lower power consumption. The system monitors motion continuously and upgrades to dual-pass processing when quality requirements become more demanding due to higher motion, thus adapting power usage to actual needs.
Solution Approach 2:
The stabilization process intensity is made dynamic rather than static. The system can transition between single-pass and dual-pass modes based on real-time motion assessment, ensuring that power consumption is minimized when high-quality stabilization is not critically needed, while still providing high quality when motion demands it.
4Manufacturing precision
If redundant operations are performed to satisfy latency and quality requirements, then video quality is improved, but processing efficiency decreases
Solution Approach 1:
The system changes processing parameters based on motion conditions and quality requirements. During low-motion periods, single-pass stabilization meets quality requirements with fewer operations. During high-motion periods, the system increases processing intensity to dual-pass to satisfy quality and latency requirements, thus avoiding redundant operations when they are not necessary for quality.
Solution Approach 2:
Processing efficiency is improved by making the number of stabilization passes dynamic. The system adapts processing intensity to actual quality needs based on motion analysis, performing intensive processing only when quality requirements demand it rather than always performing redundant operations, thus improving overall processing efficiency while maintaining video quality.
Data Source
AI summary
Systems, methods, and non-transitory media are provided for power-efficient image stabilization. An example method can include collecting measurements from a motion sensor, the measurements being based on movement of an image sensor while capturing frames; calculating parameters for counteracting motions in a frame, wherein first parameters are based on the measurements and second parameters are based on some of the measurements; adjusting, in a first stabilization pass of a dual-pass stabilization process, the first frame according to the second parameters; adjusting, in a second stabilization pass of the dual-pass stabilization process, the first frame according to the first parameters; based on a second frame having less motion than the first frame, enabling for the second frame a single-pass stabilization process for both a frame preview process and video record process; and adjusting, in the single stabilization pass, the second frame according to parameters for counteracting motions in the second frame.