Low Latency Display System Using Down-Scaled Image Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing liquid crystal displays suffer from significant latency issues, leading to visual artifacts like blurred or jerky object motion in interactive technologies, as they require time to load and display image data, resulting in delays that are not fully mitigated by current solutions.

Innovation Solution

A digital display system and method that reduces latency by down-scaling image data frames to reduce the amount of data loaded into the display driver, allowing partial frames to be displayed before the entire frame is loaded, and using an image data scaler to generate and up-scale down-scaled frames for immediate assertion on pixels, along with a controller to manage data transfer based on sensor inputs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If full-resolution image data frames are loaded into the display driver, then image quality is maintained, but display latency increases significantly

Engineering Contradiction:
Improveimage qualityVSAvoiddisplay latency
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent segments the image data processing into multiple stages: down-scaling the full-resolution frame into smaller sub-frames, processing these sub-frames separately through the display driver, and then recombining them. This segmentation allows the system to process and display portions of the image data incrementally rather than waiting for the entire high-resolution frame to be loaded, thereby reducing display latency while maintaining overall image quality through the up-scaling reconstruction process.

Inventive Principle:
Principle #1Segmentation

2Loss of time

If the amount of image data loaded into the display driver is reduced, then display latency decreases, but image quality may be compromised

Engineering Contradiction:
Improvedisplay latencyVSAvoidimage quality
Core Design Contradiction:
Loss of timeVSMeasurement precision

Solution Approach 1:

The patent creates down-scaled copies of the original full-resolution image data. These down-scaled copies contain fewer pixels and require less data to be loaded into the display driver, enabling faster processing and reduced latency. The system then uses up-scaling algorithms to reconstruct the full-resolution image from these smaller sub-frames, effectively creating a temporal copy mechanism where reduced-quality intermediate representations are used to achieve real-time display performance.

Inventive Principle:
Principle #26Copying

3Loss of time

If partial frames are displayed before complete data loading, then latency is reduced, but visual artifacts may increase

Engineering Contradiction:
Improvedisplay latencyVSAvoidvisual artifact reduction
Core Design Contradiction:
Loss of timeVSReliability

Solution Approach 1:

The patent performs preliminary down-scaling of the image data before it enters the display driver. By pre-processing the full-resolution frame into smaller sub-frames in advance, the system prepares compressed representations that can be quickly processed and displayed. This preliminary action allows partial frame display to proceed without causing visual artifacts, as the down-scaled data is specifically structured to maintain image integrity during incremental processing and display.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10504417B2Low latency display system and method
Publication Date: 2019.12.10 OMNIVISION TECHNOLOGIES INC
  • US10504417B2 patent drawing
  • US10504417B2 patent drawing
  • US10504417B2 patent drawing

AI summary

A novel display system includes a host and a display. In a particular embodiment the host includes a data scaler and a dual frame buffer. Frames of image data are down-scaled before being transferred to the display, and is up-scaled while being loaded into the frame buffer or the display. The down-scaled frames of image data include less data than the frames of image data. In another embodiment, the process of loading the image data into the display begins before an entire frame of data is loaded into the frame buffer. Increasingly sized portions of the image data, each corresponding to a different color field, are asserted on the display and displayed one at a time. The portions of the frame that were not previously displayed are displayed along with the initial portions of a subsequent frame.