Adaptive Slow-Motion Video Recording Based on Motion Intensity
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing slow-motion video recording systems record the entire video at a high frame rate, which imposes significant resource burdens and can be tedious for viewers who are not interested in watching certain portions in slow motion, and post-editing to modify frame rates is also undesirable.
Innovation Solution
Implementing a video processing system that adaptively changes frame rates based on the amount and intensity of motion in the recorded scene, using a combination of image processing, motion detection, and machine learning to dynamically encode and decode video frames at varying rates, thereby creating automatic slow-motion effects only where needed.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the entire video is recorded at a high frame rate, then slow-motion effect is achieved, but resource consumption increases
Solution Approach 1:
The patent applies different frame rates to different portions of the video based on motion intensity. High frame rates are applied only to segments with significant motion where slow-motion effect is desired, while normal frame rates are used for static portions. This local differentiation resolves the contradiction by maintaining slow-motion quality where needed while reducing overall resource consumption.
Solution Approach 2:
The system dynamically adjusts the frame rate throughout the video based on real-time motion analysis. The frame rate is not fixed but varies adaptively according to the motion content of each segment, allowing the system to optimize between slow-motion effect quality and resource consumption on a segment-by-segment basis.
2Reliability
If the entire video is recorded at a high frame rate, then slow-motion effect is achieved, but storage requirements increase
Solution Approach 1:
High frame rate recording is applied locally only to video segments containing significant motion, rather than uniformly across the entire video. This reduces the total quantity of high-frame-rate data that needs to be stored, directly addressing the storage requirements contradiction while preserving slow-motion quality in relevant segments.
Solution Approach 2:
The patent extracts and identifies only the necessary portions of video that require slow-motion treatment based on motion analysis. By separating the video into dynamic segments (requiring high frame rate) and static segments (requiring normal frame rate), the system reduces overall storage requirements while maintaining effect quality where needed.
3Reliability
If the entire video is recorded at a high frame rate, then slow-motion effect is achieved, but processing power increases
Solution Approach 1:
The system applies high frame rate processing and slow-motion effects only to specific video segments with significant motion, rather than processing the entire video at high frame rates. This localized approach reduces the total computational power required while maintaining slow-motion effect quality in segments where it is most beneficial.
Solution Approach 2:
The processing power requirement is made dynamic by adjusting the frame rate and processing intensity based on the motion content of each video segment. Static segments require minimal processing, while dynamic segments receive enhanced processing resources, optimizing the balance between slow-motion quality and compute resource consumption.
4Adaptability or versatility
If post-editing is used to modify frame rates, then slow-motion effect can be adjusted, but user tediousness increases
Solution Approach 1:
The system performs automatic motion analysis and frame rate adjustment without requiring user intervention. The camera autonomously identifies segments with significant motion and applies appropriate frame rates, eliminating the need for users to manually edit the video and reducing user tediousness while maintaining adaptability.
Solution Approach 2:
The frame rate adjustment is performed preliminarily during video capture rather than requiring post-editing. The system automatically analyzes motion and configures frame rates in advance, so when users review the video, the slow-motion effects are already optimally applied, eliminating tedious post-processing steps.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Systems, methods, and computer-readable media are provided for automated slow motion video recording. An example method can include storing, in a buffer, a sequence of ordered frames captured by an image sensor; sending, for display, a first frame from the sequence of ordered frames in the buffer at a time interval; calculating an amount of motion between the first frame in the buffer and a second frame in the buffer; determining, based on the amount of motion, a frame rate for encoding a set of frames from the sequence of ordered frames in the buffer, the set of frames including the second frame in the buffer and one or more frames sequentially between the first frame and the second frame; and encoding the set of frames at the frame rate determined.