Gaze-Driven Display Region Enhancement via Squint Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Users often face difficulty in viewing small text or low contrast images on displays, especially in mobile devices, where automatic enhancement without user intervention is desirable to improve visibility and visual clarity.

Innovation Solution

A system and method that detects user squinting and gaze direction using infrared light and facial recognition, enhancing the display region of interest by adjusting contrast, zooming, and modifying graphical user interface elements to improve image quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If the display shows small text or low contrast images, then the device can display more information, but the user has trouble seeing the region of interest

Engineering Contradiction:
Improveinformation densityVSAvoidvisibility
Core Design Contradiction:
Quantity of substanceVSObject-affected harmful factors

Solution Approach 1:

The system applies different display qualities to different regions of the screen. When a region of interest is detected through eye tracking, that specific area receives enhanced processing (higher resolution, adjusted contrast, sharpening) while other areas maintain normal display parameters, thus providing localized quality improvement without affecting overall information density.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The display enhancement is dynamic and adapts in real-time based on user gaze. The system continuously monitors eye position and automatically adjusts which regions receive enhancement, allowing the high-quality display area to move dynamically across the screen as the user shifts their attention between different content areas.

Inventive Principle:
Principle #15Dynamics

2Ease of operation

If the display is enhanced automatically without user intervention, then user convenience is improved, but the system complexity increases

Engineering Contradiction:
Improveuser convenienceVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system performs self-service by automatically detecting user gaze and applying enhancements without requiring manual input. The eye tracking system continuously monitors the user's eye position and autonomously adjusts display parameters in the detected region of interest, eliminating the need for user commands or manual zoom/contrast adjustments.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system uses feedback from the eye tracking system to continuously adjust display enhancement. By monitoring eye position in real-time and using this feedback to dynamically modify which regions receive enhancement, the system adapts to user needs automatically, creating a closed-loop control system that improves convenience while managing complexity through intelligent automation.

Inventive Principle:
Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Automatically enhances the display region where the user is looking, improving visibility and clarity without user interaction, by detecting squinting and using infrared pupil tracking to adjust contrast and GUI elements accordingly.

Implementation Method 1

receiving an infrared image of a face of the user and detecting a region on the display where the user is looking in accordance with the infrared image

Methodology Applied
Scientific EffectInfrared radiation: Infrared Radiation

Data Source

PatentEP3158424B1System and method for display enhancement
Publication Date: 2024.03.13 HUAWEI TECH CO LTD
  • EP3158424B1 patent drawingFigure 1~3
  • EP3158424B1 patent drawingFigure 4A
  • EP3158424B1 patent drawingFigure 4B

AI summary

A method for enhancing a display (125), a mobile device (360) and a wearable device (392) are provided. The method includes receiving an optical image of a face of a user (122) and detecting whether the user (122) is squinting in accordance with the optical image; detecting a region on the display (125) where the user (122) is looking and enhancing the region on the display (125) where the user (122) is looking when the user (122) is squinting.