Wearable Video Composition With Sensor-Based Activity Stabilization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Capturing vigorous user activities with portable electronic devices is challenging due to shaky and lengthy video recordings, which are difficult to process and share, especially when user hands are engaged in the activity.
Innovation Solution
A wearable device with stereo cameras and inertial measurement units captures raw video segments, calculates camera orientations, and computes a stabilized output path to produce a smooth and shareable video composition.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If raw video segments are captured during vigorous activities, then the video content captures dynamic user activities, but the video becomes shaky and difficult to share
Solution Approach 1:
The patent introduces an intermediary processing system that uses sensor data (accelerometer, gyroscope, magnetometer) as a mediator to calculate camera orientation and stabilize video segments. The sensors act as intermediaries between the shaky camera movement and the final stabilized video output, enabling vigorous activity capture while maintaining video stability.
Solution Approach 2:
The patent replaces mechanical stabilization (physical gimbals or stabilization mechanisms) with computational stabilization using sensor data and image processing algorithms. Instead of mechanically counteracting camera movement, the system uses digital image transformation based on calculated orientation data to achieve stabilization.
2Loss of time
If video segments are captured and processed in real-time, then immediate feedback is provided, but processing complexity and computational burden increase
Solution Approach 1:
The patent performs preliminary calculations of camera orientation using sensor data during the video capture phase. By pre-calculating orientation data and transforming video segments based on this preliminary information, the system reduces the computational burden during final processing and enables faster delivery of stabilized video.
Solution Approach 2:
The patent divides the video into multiple segments and processes each segment independently using calculated orientation data. This segmentation approach allows for efficient parallel processing and reduces overall computational complexity compared to processing the entire video as a single unit.
Data Source
AI summary
Systems, devices, media, and methods are described for capturing a series of video clips, together with position, orientation, and motion data collected from an inertial measurement unit during filming. The methods in some examples include calculating camera orientations based on the data collected, computing a stabilized output path based on the camera orientations, and then combining the video segments in accordance with said stabilized output path to produce a video composition that is stable, short, and easy to share. The video clips are filmed in accordance with a set of conditions called a capture profile. In some implementations, the capture profile conditions are reactive, adjusting in real time, during filming, in response to sensor data gathered in real time from a sensor array.