Frame Rate Conversion via Adaptive Playback Speed and Frame Duplication

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for aligning the frame rate of digital video content with the refresh rate of electronic displays often result in jittery playback and noticeable artifacts, particularly when the frame rate does not cleanly divide the display's refresh rate, leading to degraded viewing experiences.

Innovation Solution

The method involves adjusting the playback speed of video content over specified intervals to synchronize the frame rate with the display's refresh rate by using a combination of original frames and sequences of frame duplications, with adjustments made within certain limits to maintain smooth playback without reencoding the video content.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If frame duplication is used to align video frame rate with display refresh rate, then synchronization is achieved, but playback becomes jittery and artifacts appear

Engineering Contradiction:
Improveframe rate synchronizationVSAvoidjitter and artifacts
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent applies dynamics by making the frame duplication strategy adaptive rather than static. The system dynamically adjusts which frames to duplicate based on motion detection and scene complexity analysis. When motion is detected, the system reduces duplication to maintain smooth playback; when motion is minimal, it increases duplication to ensure synchronization. This dynamic adaptation resolves the contradiction by making the synchronization process responsive to content characteristics, thereby reducing visible artifacts while maintaining reliability.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes parameters by introducing multiple duplication levels (first-order, second-order, third-order duplications) and selectively applying them based on temporal and spatial analysis. Instead of uniformly duplicating frames, the system varies the duplication parameter locally across different frames and time intervals. This parameter variation allows the system to achieve synchronization while minimizing the visual impact of duplications, thus reducing jitter and artifacts.

Inventive Principle:
Principle #35Parameter changes

2Object-affected harmful factors

If video content is reencoded to match display refresh rate, then playback smoothness is improved, but processing complexity and time increase

Engineering Contradiction:
Improveplayback smoothnessVSAvoidvideo processing complexity
Core Design Contradiction:
Object-affected harmful factorsVSDevice complexity

Solution Approach 1:

The patent uses copying by creating duplicate frames from the original video content instead of reencoding. The system generates first-order, second-order, and third-order duplicate frames by copying and combining original frames in different sequences. This copying approach achieves smooth playback adaptation to different refresh rates without the computational complexity of reencoding, as copying frames is significantly less resource-intensive than full video reencoding.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent applies segmentation by dividing the video processing into distinct stages: original frame processing, first-order duplication, second-order duplication, and third-order duplication. Each stage handles specific frames based on motion characteristics and timing requirements. This segmented approach allows the system to process only necessary frames at each level, reducing overall processing complexity compared to reencoding the entire video stream.

Inventive Principle:
Principle #1Segmentation

3Reliability

If frame rate conversion is applied over long time intervals, then synchronization accuracy is improved, but playback speed variation increases

Engineering Contradiction:
Improvesynchronization accuracyVSAvoidplayback speed stability
Core Design Contradiction:
ReliabilityVSSpeed

Solution Approach 1:

The patent applies periodic action by organizing frame duplications into regular patterns (first-order, second-order, third-order duplications) that repeat at specific intervals. The system uses presentation timestamps and time-based logic to determine when to apply each type of duplication, creating a periodic structure to the frame rate conversion process. This periodic approach maintains synchronization accuracy while limiting playback speed variations to predictable, manageable ranges.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The patent uses dynamics by adjusting the playback speed and duplication strategy based on the specific time interval and content characteristics. The system dynamically determines the appropriate duplication order and timing based on motion detection and temporal analysis, allowing it to maintain synchronization accuracy while adapting playback speed to minimize visible variations. This dynamic adjustment prevents excessive speed variations even over longer time intervals.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS11431942B2Frame rate conversion
Publication Date: 2022.08.30 NETFLIX INC
  • US11431942B2 patent drawing
  • US11431942B2 patent drawing
  • US11431942B2 patent drawing

AI summary

The disclosed method includes accessing video content encoded at a specified frame rate, and determining a refresh rate for an electronic display on which the video content is to be presented. The method next includes specifying a time interval for the video content over which frame rate conversion is to be applied to synchronize the video content frame rate with the electronic display refresh rate. The method also includes presenting the video content on the electronic display where the playback speed is adjusted for a first part of the interval. At this adjusted speed, the interval is played back using original video frames and multiple frame duplications. The presenting also adjusts playback speed of a second part of the interval. At the adjusted speed, the interval is played back using the original frames and a different number of frame duplications. Various other methods, systems, and computer-readable media are also disclosed.