Hybrid UAV Zoom for Electronic Image Stabilization at High Magnification
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing UAV systems experience reduced effectiveness of electronic image stabilization when zooming video frames, leading to a negative user experience due to insufficient pixel area for stabilization.
Innovation Solution
Implement a hybrid zoom approach that constrains maximum camera front end zoom to 3× and uses electronic image stabilization (EIS) in conjunction with additional zooming to enhance pixel area for viewport movement.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If camera front end zoom is increased to enhance viewing detail, then zoom capability is improved, but electronic image stabilization effectiveness deteriorates due to reduced pixel area
Solution Approach 1:
The patent segments the zoom function into two independent parts: optical zoom (camera front end) and digital zoom (electronic image processing). By limiting optical zoom to maximum 3× and implementing additional zoom through digital processing, the system maintains sufficient pixel area for EIS while achieving higher overall zoom levels. This segmentation allows each component to operate within optimal parameters.
Solution Approach 2:
The patent merges optical zoom and digital zoom functions into a hybrid zoom system. The optical zoom provides base magnification with full sensor resolution, while digital zoom supplements additional magnification through selective region processing. This combination achieves overall zoom levels exceeding 3× while preserving adequate pixel area for stabilization operations.
2Adaptability or versatility
If camera front end zoom is increased to provide higher magnification, then zoom level is improved, but pixel area for stabilization deteriorates
Solution Approach 1:
The patent divides the total zoom function into optical and digital components, with optical zoom capped at 3× to preserve pixel area. The additional zoom requirement is met through digital processing that operates on the already-cropped image, thereby maintaining sufficient pixel area for stabilization while achieving higher effective zoom levels.
3Adaptability or versatility
If electronic image stabilization is applied to highly zoomed video streams, then zoom capability is improved, but stabilization quality deteriorates
Solution Approach 1:
The patent applies electronic image stabilization to the zoomed video stream after optical zoom is applied but before final digital zoom processing. This preliminary stabilization ensures that the base stabilized image has sufficient pixel area and quality, upon which additional digital zoom can be applied without compounding degradation. The stabilization algorithm processes the intermediate image with adequate resolution.
Data Source
AI summary
Systems and methods for operating an unmanned aerial vehicle (UAV). A method includes capturing a raw video stream input using one or more camera sensors of the UAV. The method includes determining a zoom level for the raw video stream input. For the zoom level being determined to be greater than 3×, the method includes: first zooming the raw video stream input to a first field of view (FOV) at 3× to generate a 3× zoomed video stream; second zooming the 3× zoomed video stream to a second FOV at a second zoom level to generate a fully zoomed video stream at greater than 3×; and applying electronic image stabilization (EIS) to the fully zoomed video stream to generate a zoomed and stabilized video stream. Embodiments of the present technology provide a hybrid zoom approach with improved EIS performance to enhance the UAV user experience.