UAV Video Stabilization Separating Intentional Motion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing electronic image stabilization (EIS) techniques for unmanned aerial vehicles (UAVs) fail to distinguish between user-commanded motion and unintended motion, leading to suboptimal video stabilization and a negative user experience.
Innovation Solution
A method and system that quantify user-commanded motion and total motion of UAV camera sensors, subtracting the user-intended motion from the total motion to generate a residual, which is then used for applying EIS to stabilize the video stream, thereby separating intended from unintended motion.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If EIS is applied to total motion including user-commanded motion, then video stabilization is achieved, but user experience deteriorates due to overcorrection and loss of intentional motion
Solution Approach 1:
The patent segments total motion into two distinct components: user-commanded motion (intentional) and residual motion (unintentional). By separating these motion sources through signal processing, the system applies EIS only to the residual component, thereby stabilizing video without eliminating intentional camera movements commanded by the user.
Solution Approach 2:
The patent extracts the user-commanded motion component from the total motion signal using gyro data and control input mapping. This extracted intentional motion is then removed from the stabilization calculation, allowing EIS to compensate only for unwanted residual motion while preserving deliberate user actions.
2Stability of the object's composition
If EIS compensates for all UAV motion, then image stability improves, but intentional camera movements are lost
Solution Approach 1:
The patent divides motion compensation into two segments: intentional motion (from user commands) and unintentional motion (residual). The system calculates separate compensation for each segment, applying stability only where needed while preserving deliberate camera movements.
Solution Approach 2:
The patent implements feedback by continuously monitoring control inputs and gyro data to distinguish between intentional and unintentional motion. This feedback loop allows the system to adaptively adjust stabilization in real-time, maintaining image stability for residual motion while preserving user-intended camera movements.
Data Source
AI summary
Systems and methods for operating an unmanned aerial vehicle (UAV). A method includes capturing a raw video stream input using one or more camera sensors of the UAV. The method includes quantifying characteristics of motion of the UAV as commanded by a user of the UAV. The method includes quantifying characteristics of total motion of the one or more camera sensors including the motion commanded by the user. The method includes subtracting the characteristics of the motion commanded by the user from the characteristics of the total motion to generate a residual. The method includes applying electronic image stabilization to the raw video stream based on the residual to generate a stabilized video stream output. Accounting for unintended UAV motion in EIS separate and apart from the total motion being experienced by the UAV can significantly enhance a UAV user's video viewing experience.