Optical Flow Video Frame Interpolation with Light Intensity Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Optical flow-based video frame interpolation is computationally intensive and can produce distorted frames during sudden changes in light intensity, making it inefficient for real-time media playback.
Innovation Solution
Implement a method that computes a limited set of optical flow estimates and uses interpolation to generate synthetic frames, while detecting sudden changes in light intensity to switch to non-optical flow based interpolation, ensuring smooth playback and minimizing computational cost.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If optical flow algorithm is used to generate synthetic frames, then visual smoothness is improved, but computational cost increases
Solution Approach 1:
The patent applies partial action by computing optical flow only for a limited set of keyframes rather than all frames. The system identifies which frames require optical flow processing and which can use simpler interpolation methods, thereby reducing overall computational cost while maintaining visual smoothness where most needed
Solution Approach 2:
The patent segments the video processing task into different types: frames that require optical flow processing and frames that can use simpler methods. This segmentation allows the system to apply computationally intensive optical flow only where necessary, improving efficiency while maintaining quality
2Productivity
If optical flow algorithm is used during sudden light intensity changes, then frame generation is maintained, but frame distortion occurs
Solution Approach 1:
The patent implements dynamic method selection by continuously monitoring light intensity changes and adapting the frame generation approach accordingly. When sudden light intensity changes are detected, the system switches from optical flow to alternative methods, and returns to optical flow when conditions are favorable, optimizing both quality and continuity
Solution Approach 2:
The patent introduces light intensity change detection as an intermediary mechanism that mediates between the requirement for continuous frame generation and the need to avoid distortion. This intermediary monitors conditions and determines which method should be used, preventing distortion while maintaining continuity
3Measurement precision
If more flow estimates are computed, then interpolation accuracy is improved, but computation time increases
Solution Approach 1:
The patent applies partial action by computing a limited number of flow estimates rather than exhaustive estimates for every frame. The system determines the minimum necessary number of flow estimates required to achieve acceptable interpolation accuracy, avoiding unnecessary computation time while maintaining sufficient precision
Data Source
AI summary
A novel method of using optical flow algorithm that maximizes the benefit of optical flow synthetic frames while minimizing the associated computation cost is provided. When using optical flow to produce synthetic frames between two actual/recorded frames, the method computes a set of estimates of optical flows (or a flow estimate) between the two frames. These flow estimates are then used to compute all synthetic frames that are needed between the two actual frames by interpolation, which creates each synthetic frame based on its temporal distances from the pair of actual frames.