Video Frame Extraction Using Shaking Analysis for Consistent Intervals
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional image processing systems struggle to accurately extract frames from moving images with minimal shaking, leading to inconsistent frame intervals and difficulty in understanding the temporal relationship between extracted frames, making it hard for users to comprehend changes in objects or scenes.
Innovation Solution
An image processing apparatus that specifies frame groups at user-defined intervals and analyzes each group to extract frames with minimal shaking or blurring, using a 'grading system' to evaluate image quality and prioritize frames with clear faces or optimal image characteristics.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If frames are extracted based on shaking amount analysis, then frame quality is improved, but frame interval consistency deteriorates
Solution Approach 1:
The patent divides the moving image into multiple frame groups, where each group contains a predetermined number of frames. Within each group, one frame is selected as the extraction target based on shaking amount analysis. This segmentation approach ensures that frames are extracted at consistent intervals (one per group) while still selecting high-quality frames within each group, thereby resolving the contradiction between frame quality and interval consistency.
2Stability of the object's composition
If frames are extracted at fixed intervals, then frame interval consistency is improved, but frame quality deteriorates
Solution Approach 1:
The patent applies different selection criteria to different local positions within each frame group. Specifically, within each group of predetermined number of frames, the frame with the minimum shaking amount is selected as the extraction target. This local optimization approach ensures that each selected frame has high quality (low shaking) while maintaining consistent extraction intervals across the entire moving image, thereby resolving the contradiction between frame quality and interval consistency.
3Measurement precision
If all frames are analyzed for shaking amount, then frame selection accuracy is improved, but processing time increases
Solution Approach 1:
The patent segments the moving image into multiple frame groups with a predetermined number of frames each. Shaking amount analysis is performed only on frames within each group to select one extraction target, rather than analyzing all frames individually for final selection. This segmentation reduces the total number of frames requiring detailed analysis while maintaining selection accuracy within each group, thereby resolving the contradiction between frame selection accuracy and processing time.
Solution Approach 2:
The patent performs shaking amount analysis on a partial set of frames (only those within each frame group that need evaluation for extraction target selection) rather than all frames in the moving image. By analyzing only the necessary subset of frames within each group to identify the minimum shaking frame, the processing time is reduced while still achieving accurate frame selection, thereby resolving the contradiction between frame selection accuracy and processing time.
Data Source
AI summary
An image processing apparatus according to the present invention can specify, among a plurality of frames, a plurality of frame groups having at least one frame included between the plurality of frame groups that are extraction target candidates in an array of the plurality of frames in the moving image according to a predetermined frame interval, analyze each of the plurality of specified frame groups, and extract a frame to be output from each of the plurality of frame groups based on a result of the analysis.