Touch Display Latency Reduction via Scaling and Segmentation

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Display devices with touch input systems experience high latency and increased power consumption due to delays in processing touch events and transmitting images between the touch sensor panel and the display panel, leading to user dissatisfaction and inefficient energy use.

Innovation Solution

A system comprising a first scaler to down-scale touch events, a touch path logic unit to generate mask data, a rendering logic unit to combine video images with overlay data, and a second scaler to up-scale display images, all controlled by an application processor to reduce latency and power consumption by optimizing touch event processing and image resolution matching.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If touch events are processed through multiple steps and the application processor, then the touch events can be accurately processed, but the processing time increases causing high latency

Engineering Contradiction:

Improvetouch event processing accuracyVSAvoiddisplay latency

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The system divides touch event processing into two separate paths: a fast path for low-resolution touch coordinates processed by the display driver integrated circuit (DDIC), and a normal path for high-resolution processing through the application processor. This segmentation allows critical timing-sensitive operations to bypass the application processor, reducing latency while maintaining processing accuracy where needed.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

The display driver integrated circuit (DDIC) acts as an intermediary that receives touch coordinates directly from the touch sensor controller and processes them independently of the application processor. This intermediary structure enables parallel processing where the DDIC handles time-sensitive coordinate transformation and display output, while the application processor handles less time-sensitive tasks like touch event recognition and application-level processing.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Manufacturing precision

If high resolution images are transmitted between the application processor and display panel, then the display quality is improved, but the power consumption increases

Engineering Contradiction:

Improvedisplay resolution qualityVSAvoidpower consumption

Core Design Contradiction:

Manufacturing precisionVSUse of energy by moving object

Solution Approach 1:

The system dynamically changes the resolution parameter based on the content being displayed. For video playback, the system uses lower resolution to reduce power consumption, while for static images or content requiring high detail, the system switches to high resolution. The application processor can control the display panel's resolution setting to match the actual content requirements, optimizing the balance between display quality and energy consumption.

Inventive Principle:

Principle #35Parameter changes

Data Source

PatentUS10110832B2Method and apparatus to reduce display lag using scaling

Publication Date: 2018.10.23 SAMSUNG DISPLAY CO LTD

AI summary

A system according to an exemplary embodiment includes: a first scaler configured to receive a plurality of touch events and down-scale the touch events to generate down-scaled touch events; a touch path logic unit configured to generate an output based on the down-scaled touch events; and a rendering logic unit configured to receive a video image, receive an output of the touch path logic unit, generate a display image by combining the video image with an overlay data according to the output of the touch path logic unit, and output the display image.