Adaptive Timelapse Frame Rate Control for Motion-Rich Video
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for producing timelapse videos often result in visually unpleasing results due to constant image frame recording rates that do not adapt to changes in device position or captured content, leading to long stretches with little action or excessive action that are difficult to perceive.
Innovation Solution
Implementing a system that intelligently determines non-linear, dynamic image recording rates based on device motion and scene detail changes, using positional sensors and image registration operations to adjust frame rates accordingly, thereby producing smoother and more engaging timelapse videos.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a constant image frame recording rate is used, then the recording process is simple and stable, but the timelapse video quality deteriorates with long stretches of little action or excessive action
Solution Approach 1:
The patent implements dynamic frame rate adjustment by varying the image recording rate over time based on detected device motion and scene content changes. The system transitions from a static constant frame rate to a dynamic adaptive frame rate that responds to real-time conditions, resolving the contradiction between recording stability and visual quality.
Solution Approach 2:
The system uses feedback from positional sensors and image analysis to continuously monitor device motion and scene changes, then adjusts the frame rate accordingly. This closed-loop control enables the system to maintain optimal visual quality by increasing frame rates during high-motion segments and decreasing them during stable periods.
2Manufacturing precision
If a high image recording rate is used throughout, then all action is captured in detail, but the video duration becomes too long for sharing
Solution Approach 1:
The patent changes the recording parameter (frame rate) dynamically based on scene requirements. During periods of significant device motion or scene change, the system increases the frame recording rate to capture detailed action. During stable periods, it decreases the rate to reduce overall video duration, thus resolving the contradiction between capture detail and video length.
3Duration of action of moving object
If a low image recording rate is used throughout, then the video duration is shortened for sharing, but important action segments are missed or unclear
Solution Approach 1:
The system dynamically adjusts the frame recording rate parameter based on real-time analysis of device motion and scene content. When significant action is detected through positional sensor data or image registration operations, the system increases the recording rate to ensure detailed capture. During calm periods, it maintains a lower rate to keep the overall video duration suitable for sharing.
4Difficulty of detecting and measuring
If the image recording rate is adjusted dynamically, then the timelapse video quality improves, but the system complexity increases
Solution Approach 1:
The system performs self-service by automatically analyzing its own operational data (positional sensor readings and captured images) to determine optimal frame rates without requiring external intervention. The device uses its existing sensors and processing capabilities to autonomously adjust recording parameters, minimizing the need for additional complex external control systems.
Solution Approach 2:
The patent leverages existing multi-functional components of the mobile device, using the same image capture device for both capturing images at variable rates and providing feedback for rate adjustment decisions. The positional sensors serve dual purposes of navigation and frame rate control, reducing overall system complexity while enabling dynamic quality improvement.
Data Source
AI summary
Devices, methods, and non-transitory program storage devices are disclosed herein to perform intelligent determinations of non-linear (i.e., dynamic) image recording rates for the production of improved timelapse videos. The techniques described herein may be especially applicable to timelapse videos captured over long durations of time and/or with varying amounts of device motion/scene detail change over the course of the captured video (e.g., when a user is walking, exercising, driving, etc. during the video's capture). By smoothly varying the image recording rate of the timelapse video in accordance with estimates of device motion, the quality of the produced timelapse video may be improved (e.g., fewer long stretches of the video with no action or too little action, as well as fewer stretches of the video where there is so much rapid action in the timelapse video that it is difficult for a viewer to perceive what is happening in the video).