Display Playback Latency Control With Adaptive Frame Dropping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing display apparatuses experience latency issues during real-time bidirectional communication services, particularly in gaming environments, where frame dropping is uniformly applied without considering content-specific characteristics, leading to suboptimal latency management.
Innovation Solution
The display apparatus adaptively adjusts reproduction latency by classifying content based on characteristics, setting latency thresholds, and performing frame dropping or buffer flushing to manage latency effectively, using a processor to determine frame drop ratios and buffer flush operations based on content category and latency measurements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If frame dropping is uniformly performed at a certain rate in gaming mode, then latency is reduced, but the method is not flexible enough to adapt to different content characteristics
Solution Approach 1:
The patent implements dynamic frame dropping by adjusting the frame dropping rate based on real-time latency measurements and content characteristics. The system transitions from static uniform frame dropping to dynamic adaptive frame dropping where the dropping rate is continuously adjusted according to actual performance conditions, allowing optimal latency reduction for different content types.
Solution Approach 2:
The system employs feedback mechanisms by measuring actual latency during content reproduction and using this information to adjust the frame dropping rate. The processor continuously monitors latency, compares it against thresholds, and modifies the frame dropping rate accordingly, creating a closed-loop control system that adapts to content characteristics in real-time.
2Loss of time
If frame dropping is performed to reduce latency, then reproduction latency is reduced, but content quality may be affected
Solution Approach 1:
The patent changes the parameter of frame dropping rate dynamically based on latency conditions and content characteristics. By adjusting this parameter in response to measured latency and content type, the system optimizes the balance between reducing latency and maintaining content quality, rather than applying a fixed dropping rate that would compromise quality.
Solution Approach 2:
The system applies different frame dropping strategies to different content characteristics. Rather than uniform treatment, the patent identifies content types (e.g., game content requiring lower latency vs. video content where quality is paramount) and applies appropriate frame dropping rates to each, ensuring quality is maintained where latency reduction is less critical.
Data Source
AI summary
Provided are a display apparatus and an operating method thereof. The display apparatus includes a display, a reproducer configured to reproduce content, a memory storing one or more instructions, and a processor configured to execute the one or more instructions stored in the memory to: obtain a characteristic of content requested to be reproduced; obtain, as a first latency threshold serving as a reference value for a latency control operation, a first value based on the obtained characteristic of the content; measure latency of the content during reproduction of the content by the reproducer; determine whether the measured latency of the content is greater than the first value; and based on determining that the measured latency of the content is greater than the first value, control the reproducer to drop at least some of frames corresponding to the content.