Motion Estimated Video Jitter Elimination via Offset Adjustment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Digital video editing techniques using motion estimation introduce jitter when interpolating frames at different speeds, causing a detectable blurring effect due to the intermixing of sharp and blurred images.
Innovation Solution
An offset adjustment algorithm is applied to ensure that interpolated frames do not coincide with original frames, preventing jitter by calculating an adjustment value based on the fractional portion of the target speed, which shifts the time representation of each frame, thereby maintaining a consistent playback experience without interspersing sharp and blurred frames.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If interpolated frames are inserted between original frames to simulate motion at different speeds, then the motion simulation quality is improved, but jitter is introduced due to intermixing sharp and blurred frames
Solution Approach 1:
The patent extracts and removes original frames from the video sequence at specific time points, replacing them with interpolated frames. By selectively removing original frames and substituting them with motion-estimated interpolated frames, the system maintains smooth motion simulation while eliminating the jitter caused by intermixing sharp and blurred frames.
Solution Approach 2:
The patent changes the temporal parameter of frame selection by introducing an offset adjustment algorithm. This algorithm calculates adjusted frame times based on the fractional portion of the target speed, ensuring that interpolated frames are generated at time points that do not coincide with original frame timestamps, thereby preventing the jitter effect.
2Measurement precision
If the frame rate is slowed down to portray motion at half speed, then the motion portrayal accuracy is improved, but choppy motion is produced
Solution Approach 1:
The patent performs preliminary action by pre-calculating motion vectors and generating interpolated frames before playback. The motion estimation process computes forward and backward motion vectors in advance, and interpolated frames are generated beforehand at the required time points, ensuring smooth motion portrayal without choppy effects during actual playback.
Solution Approach 2:
The patent introduces interpolated frames as intermediary elements between original frames. These intermediate frames, generated through motion estimation using forward and backward motion vectors, serve as mediators that fill the temporal gaps when playback is slowed down, maintaining motion smoothness and portraying accurate motion at the desired speed.
3Stability of the object's composition
If interpolated frames are used to maintain smooth motion at slower speeds, then motion smoothness is improved, but detectable jitter is introduced when interspersed with original frames
Solution Approach 1:
The patent introduces asymmetry in the frame selection process by applying an offset adjustment that shifts the timing of interpolated frame generation. Instead of symmetrically placing interpolated frames at regular intervals, the offset adjustment creates an asymmetric timing pattern based on the fractional portion of the target speed, ensuring that interpolated frames do not coincide with original frames and eliminating detectable jitter.
Data Source
AI summary
A method includes receiving a digital video segment simulating motion at one speed, the frames in the segment spaced at a uniform time interval. The method further includes receiving a desired speed of motion, determining the appropriate uniform time interval corresponding to the desired speed, and generating a frame sequence simulating the motion at the desired speed, the frames in the generated sequence spaced at the determined appropriate uniform time interval. If the generated frame sequence includes a frame from the original segment, then only frames from the original segment are included in the generated frame sequence, and if the generated frame sequence includes an interpolated frame then only interpolated frames are included in the generated frame sequence.