Display Driving Circuit Integrating Eye Tracker for VR GPU Workload Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current gazing point tracking technologies increase the workload of the graphics processing unit (GPU) in virtual reality and augmented reality systems, leading to system delays and poor user experience due to the need for high-definition rendering across a varying field of view.

Innovation Solution

A display driving circuit integrating an eye image acquisition unit, an eye tracker within a data driving chip, and a graphics processor, which determines eye gazing coordinates and processes images accordingly, allowing for high-definition rendering only in the foveal field of view and reduced-definition processing in the surrounding area, thereby reducing GPU workload and system delays.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If gazing point tracking is implemented with high-definition rendering in the foveal field of view, then imaging quality is improved, but GPU workload increases and system delay occurs

Engineering Contradiction:
Improveimaging qualityVSAvoidGPU workload
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The display area is segmented into a foveal field of view (high-definition rendering area) and a surrounding field of view (low-definition rendering area). The eye tracker divides the display region based on gazing coordinates, allowing the GPU to render high-definition images only in the foveal area while using lower resolution for peripheral areas, thus reducing overall GPU workload while maintaining perceived image quality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different rendering qualities are applied to different regions of the display. The foveal field of view receives high-definition rendering with full computational resources, while the surrounding field of view uses reduced-definition rendering. This local differentiation optimizes the balance between image quality and GPU performance by concentrating computational effort where the human eye has highest acuity.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If gazing point tracking is implemented with high-definition rendering across the entire field of view, then imaging quality is improved, but system delay increases

Engineering Contradiction:
Improveimaging qualityVSAvoidsystem delay
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The rendering process is segmented into high-definition processing for the foveal area and low-definition processing for peripheral areas. This segmentation reduces the total amount of data the GPU must process each frame, thereby reducing rendering time and system delay while maintaining high image quality in the critical foveal region where the user is actually looking.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Instead of applying high-definition rendering to the entire field of view (excessive action), the system applies high-definition rendering only to the necessary foveal area (partial action). This partial application of high-definition processing reduces computational load and rendering time, eliminating system delay while maintaining sufficient image quality in the region that matters most to the user.

Inventive Principle:
Principle #16Partial or excessive action

3Adaptability or versatility

If a separate sensor and data processing system are added for eye tracking, then gazing point tracking capability is improved, but device complexity increases

Engineering Contradiction:
Improvegazing point tracking capabilityVSAvoidcircuit integration
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The eye tracker is merged with the data driving chip, integrating the eye tracking functionality directly into the existing display driver infrastructure. This consolidation eliminates the need for separate dedicated eye tracking hardware and data processing pathways, reducing device complexity while maintaining full gazing point tracking capability. The integrated design allows eye tracking data to be processed and applied within the existing display rendering pipeline.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS10613624B2Display driving circuit, driving method thereof and display device
Publication Date: 2020.04.07 BOE TECHNOLOGY GROUP CO LTD
  • US10613624B2 patent drawing
  • US10613624B2 patent drawing
  • US10613624B2 patent drawing

AI summary

The present disclosure provides a display driving circuit, a driving method thereof and a display device. An eye tracker is integrated into a data driving chip. The eye tracker may determine eye gazing coordinates according to an eye image sent from an eye image acquisition unit; then a graphics processor processes an image to be displayed, according to the eye gazing coordinates sent from the eye tracker; and finally, the data driving chip controls a connected display panel to display according to the processed image to be displayed which is sent from the graphics processor.