Display Device Frame-Skip Compensation for Smooth Motion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Frame skips in video playback cause motion judder due to the absence of frames, leading to still images during movement, which disrupts smooth motion in display devices.
Innovation Solution
A display device with a frame skip detector, frame skip compensation adjuster, and frame interpolator that detects frame skips and generates interpolation frames to maintain smooth motion by adapting frame delay and interpolation based on detected skips.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If frame skip occurs in video playback, then image generation or transmission fails, but motion smoothness deteriorates due to still images appearing during movement
Solution Approach 1:
The system performs preliminary frame interpolation by generating intermediate frames between skipped frames before playback occurs. The frame interpolator creates synthetic frames at the skipped time points using motion estimation from surrounding frames, so that when the player encounters a frame skip, the interpolated frames are already prepared or can be generated in advance to maintain smooth motion.
Solution Approach 2:
The patent introduces an intermediary frame interpolation mechanism that acts as a mediator between the skipped frames. The frame interpolator generates intermediate frames that bridge the gap between consecutive frames, effectively mediating the discontinuity caused by frame skips and restoring smooth motion without requiring the original skipped frames.
2Loss of information
If the display device repeatedly outputs the previous frame during frame skip, then information loss is minimized, but motion judder occurs due to still images
Solution Approach 1:
The system converts the harmful effect of frame skips (which cause motion judder) into a beneficial frame interpolation opportunity. Instead of simply repeating the previous frame or dropping the skipped frame, the system uses the frame skip detection as a trigger to generate interpolated frames that actually improve motion smoothness while preserving the temporal information structure.
Solution Approach 2:
The frame interpolator creates copies of intermediate frames between the skipped frames. By copying and synthesizing intermediate frames based on motion estimation from surrounding frames, the system reproduces the missing temporal information without directly copying the skipped frames, thereby avoiding motion judder while preserving information.
3Stability of the object's composition
If frame interpolation is performed to remove motion judder, then motion smoothness is improved, but processing time and complexity increase
Solution Approach 1:
The system performs partial frame interpolation rather than complete frame reconstruction. Instead of interpolating all possible frames, the frame interpolator only generates frames at specific time points where frame skips are detected, applying interpolation selectively to the problematic frames rather than processing the entire video stream, thereby reducing processing time.
Solution Approach 2:
The frame skip compensation adjuster uses feedback from frame skip detection to control the frame interpolation process. By detecting where frame skips occur and using this feedback information, the system can dynamically adjust which frames need interpolation and at what rate, optimizing the balance between motion smoothness and processing time.
Data Source
AI summary
A display device includes: an image input unit configured to receive an image signal; a frame skip detector configured to detect a frame skip in the image signal; a frame skip compensation adjuster configured to determine information indicating whether to perform frame interpolation, interpolation input frame information, and an interpolation time, based on the frame skip detected by the frame skip detector; a frame interpolator configured to generate an interpolation frame, based on the information indicating whether to perform frame interpolation, the interpolation input frame information, and the interpolation time; and an image output unit configured to output an image signal including the interpolation frame corresponding to the interpolation time.