Wireless Display Latency Compensation via Timestamp Analysis
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional wireless display systems introduce humanly perceptible delays due to system latency, which can unfairly penalize users, especially in fast-paced applications like video games, and are not suitable for battery-powered devices that cannot support high-bandwidth, uncompressed video transmission.
Innovation Solution
A method and system that receive user responses and query the electronic system for data indicating delays attributable to the system, allowing for compensation and adjustment of interactions to mitigate these delays, specifically by calculating and accounting for aggregate display subsystem latency and HID system latency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional wireless display systems are used, then visual information can be transmitted wirelessly, but humanly perceptible delays are introduced due to system latency
Solution Approach 1:
The system performs preliminary measurements of display subsystem latency and HID latency by timing stampstamps at known intervals before actual user interaction occurs. These pre-measured latency values are stored and then used to compensate for delays during real-time user response assessment, eliminating the need for continuous latency measurement during operation.
Solution Approach 2:
The system implements feedback by measuring actual user response times, comparing them against the pre-measured system latency values, and adjusting the assessment of user performance accordingly. The latency compensation values are fed back into the user response evaluation process to provide accurate assessment despite wireless display delays.
2Loss of time
If high-bandwidth links are used to minimize delay, then compression and decompression delays are eliminated, but battery-powered devices cannot support this approach
Solution Approach 1:
The patent extracts the latency compensation function from the video transmission path. Instead of trying to eliminate compression and decompression delays through high-bandwidth links, the system measures the actual latency introduced by these operations and compensates for it mathematically in the user response assessment, separating the compensation function from the transmission path.
Solution Approach 2:
The system creates a virtual copy of the timing information by using timestamps to record when frames are submitted and when user responses are detected. These timestamp copies are then used to calculate latency compensation values without requiring additional transmission bandwidth or increasing power consumption.
3Productivity
If system latency is not compensated, then user responses are assessed as-is, but users are unfairly penalized for delays not under their control
Solution Approach 1:
The system performs preliminary measurements of display subsystem latency and HID latency by timing stampstamps at known intervals before actual user interaction occurs. These pre-measured latency values are stored and then used to compensate for delays during real-time user response assessment, eliminating the need for continuous latency measurement during operation.
Solution Approach 2:
The system implements feedback by measuring actual user response times, comparing them against the pre-measured system latency values, and adjusting the assessment of user performance accordingly. The latency compensation values are fed back into the user response evaluation process to provide accurate assessment despite wireless display delays.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A method sends a signal to render visual information on a display, and receives a user response to the rendered visual information. The user response includes a first delay. The method also queries an electronic system for data indicating a second delay. The second delay is a portion of the first delay and attributable to the electronic system. The method further using the data indicating the second delay to compensate for electronic system delay during interactions with a user.