Vision-Based Control System for Dynamic Display Resolution

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional human-computer interfaces are inadequate for individuals with physical disabilities and those engaged in tasks that require hands-free operation, as they are not well-suited for controlling the resolution of visual displays effectively.

Innovation Solution

A vision-based control system that monitors the user's eye gaze and refractive state to adjust the display resolution dynamically, using an auto-refractor measurement apparatus and gaze point tracker to analyze and adjust display parameters accordingly.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional manual HCIs (keyboards, mice, touchscreens) are used, then control precision is maintained, but accessibility for users with physical disabilities and hands-free operation capability deteriorates

Engineering Contradiction:
Improveaccessibility for users with physical disabilitiesVSAvoidcontrol capability
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent replaces manual mechanical input devices (keyboards, mice, touchscreens) with a vision-based control system that uses eye gaze tracking and refractive state measurement to control computing devices, enabling hands-free operation and accessibility for users with physical disabilities

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an auto-refractor measurement apparatus as an intermediary device that measures the user's refractive state and translates it into control signals, serving as a mediator between the user's natural eye movements and the computing device controls

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If vision-based HCIs use simple two-dimensional coordinate location, then ease of operation for basic tasks is improved, but control capability for complex tasks (such as resolution control) deteriorates

Engineering Contradiction:
Improveoperation for basic tasksVSAvoidcontrol capability for complex tasks
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent adds a new dimension to vision-based control by incorporating refractive state measurement (focus distance) as a third control parameter beyond traditional two-dimensional gaze position, enabling control of tasks such as display resolution that require depth/focus information

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent utilizes changes in refractive state (accommodation) as a control parameter to manipulate display resolution and other complex tasks, transforming a physiological parameter into a useful control dimension

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If display resolution is increased for detailed viewing, then measurement precision is improved, but ease of operation for hands-free control deteriorates

Engineering Contradiction:
Improvedisplay resolutionVSAvoidhands-free control capability
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system automatically adjusts display resolution based on the user's natural refractive state without requiring manual intervention, allowing the display to serve itself by adapting to the user's focus distance and gaze position

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables hands-free control of computing devices by dynamically adjusting display resolution based on the user's gaze and refractive state, improving accessibility for individuals with disabilities and those engaged in tasks that require hands-free operation.

Implementation Method 1

an auto-refractor measurement apparatus adapted to provide data indicating a refractive state of an eye of a user of the computing device

Methodology Applied
Scientific EffectRefraction: Refraction

Implementation Method 2

a gaze point tracker adapted to provide data indicating a point on the display at which the user's gaze is directed

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentUS8717363B2Vision-based computer control
Publication Date: 2014.05.06 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US8717363B2 patent drawing
  • US8717363B2 patent drawing
  • US8717363B2 patent drawing

AI summary

Disclosed herein is a method of controlling a computing device having a display. The method comprises identifying a point on the display at which a user's gaze is directed; determining whether an eye of the user has accommodated toward a near-field refractive state; and increasing, based on the determining, the resolution of a region on the display of the computer system, the region being centered on the identified gaze point.