Display Tile Encoding to Reduce Tearing and Judder
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional display systems face issues with visual artefacts such as tearing and judder due to decoding or decompression processes being overtaken by rastering, especially in latency-prone wireless transmission, leading to reduced display quality.
Innovation Solution
The system prioritizes encoding and decoding of display data based on the user's point of focus or area of interest, ensuring that critical tiles are received and processed in time for display, using eye-tracking to determine the area of interest and adjusting encoding and decoding orders to maximize the probability of timely delivery.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is decoded or decompressed in the same order as it is sent to the display panel (rastering order), then the decoding process can keep up with rastering, but visual artefacts such as tearing and judder occur when transmission latency causes the rastering process to overtake the decoding process
Solution Approach 1:
The patent inverts the conventional decoding order by prioritizing tiles based on their display timing requirements rather than their spatial or transmission order. Tiles that need to be displayed sooner are decoded first, regardless of their position in the raster sequence. This inversion resolves the contradiction by ensuring that decoding completes before rastering requires the data, eliminating tearing and judder while maintaining display quality.
Solution Approach 2:
The patent implements preliminary action by pre-calculating and prioritizing the decoding order of tiles based on their display timestamps before the actual decoding begins. The system determines which tiles will be needed earliest and schedules their decoding in advance, ensuring that critical tiles are ready before the rastering process reaches them. This preliminary planning prevents the rastering process from overtaking decoding, eliminating visual artefacts while maintaining timely display.
2Ease of operation
If wireless transmission is used to reduce device complexity and increase mobility, then ease of operation improves, but transmission latency increases causing decoding to be stalled and visual artefacts to occur
Solution Approach 1:
The patent applies dynamics by making the decoding order adaptive rather than static. The system dynamically adjusts the decoding priority of tiles based on real-time transmission latency conditions and display timing requirements. When wireless transmission causes variable latency, the system recalculates which tiles need urgent decoding and reorders the decoding queue accordingly. This dynamic adaptation allows the system to maintain display quality despite the mobility benefits of wireless transmission.
3Device complexity
If all tiles are decoded with equal priority in rastering order, then the decoding process is simple to implement, but tiles in the area of interest may not be decoded in time reducing display quality
Solution Approach 1:
The patent applies local quality by differentiating the decoding priority based on the spatial location and importance of each tile. Tiles in the area of interest (AOI) are assigned higher priority for decoding compared to tiles outside the AOI. The system identifies which regions contain the user's focus and ensures those tiles are decoded first and guaranteed timely delivery. This localized quality enhancement resolves the contradiction by maintaining simple overall process structure while prioritizing critical regions for timely display.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A method of managing display data, which involves, at a host device (11), receiving display data for a frame having a plurality of tiles of pixels to be displayed at a display device(12), wherein the frame is stored in a frame buffer (18) of the display device (12) and the display data is output in raster order from the frame buffer to be displayed on a display(13). A tile identification of each tile is made, including a location of the tile within the frame. An encoding order for encoding at least some of the tiles by an encoder (16) at the host device (11) is determined, where the encoding order may change during an encoding process. The encoding order is determined based on the tile identification and any of actual or estimated capabilities of the encoder (16) at the host device (11) or a decoder (17) at the display device(12), actual or estimated delays or losses in a transport mechanism between the host device (11) and the display device (12) or changes in the transport mechanism, actual or estimated area of interest of the display(13), and/or actual or estimated time when a particular tile is to be output from the frame buffer(18), so as to increase a probability that display data will be available at a location in the frame buffer (18) of the display device (12) prior to the time when the display data from that location is required for output from the frame buffer and that display data will be available in the frame buffer of the display device (12) for the area of interest.