Gaze-Based Display Control for Unintended Input

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing information processing technologies that rely on eye movement for input often unintentionally accept user inputs when the user is not consciously interacting with the screen, leading to unintended screen displays and user discomfort due to explicit variations.

Innovation Solution

An information processing apparatus that detects a user's gaze point and estimates their intention to subtly vary the screen display, allowing for implicit adjustments based on detected gaze patterns without requiring explicit user input, using a detection unit, estimation unit, image generation unit, and display control unit.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If explicit screen variation is performed based on detected eye movement, then input functionality is enabled, but unintended inputs occur when user sees screen unconsciously

Engineering Contradiction:
Improveinput functionalityVSAvoidinput accuracy
Core Design Contradiction:
Extent of automationVSReliability

Solution Approach 1:

The system performs preliminary detection of gaze position and duration before executing any input action. By monitoring how long the user's gaze remains fixed on a particular area (threshold time period), the system ensures that only intentional viewing triggers input functionality, preventing accidental activations from unconscious glances.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system provides feedback by requiring sustained gaze attention rather than momentary eye movement. This feedback mechanism filters out unconscious viewing behavior and confirms intentional user focus, thereby improving input reliability while maintaining automation.

Inventive Principle:
Principle #23Feedback

2Productivity

If explicit screen variation is performed based on eye movement input, then input operations are executed, but user discomfort occurs due to unintended operations

Engineering Contradiction:
Improveoperation executionVSAvoiduser discomfort
Core Design Contradiction:
ProductivityVSObject-affected harmful factors

Solution Approach 1:

The system performs preliminary verification by measuring gaze duration against a threshold time period before executing any screen variation or input operation. This preliminary check ensures that only deliberate user intentions result in operations, eliminating unintended actions that cause discomfort.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system applies preliminary anti-action by preventing execution of screen variation until intentional gaze is confirmed. This counter-measure blocks potential harmful unintended operations before they can occur, thereby eliminating user discomfort while preserving productive operations.

Inventive Principle:
Principle #9Preliminary anti-action

3Reliability

If manual operation is required for all screen interactions, then input accuracy is maintained, but operational burden increases

Engineering Contradiction:
Improveinput accuracyVSAvoidoperational burden
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The system enables self-service by automatically detecting user intent through sustained gaze patterns and executing corresponding screen variations without requiring manual confirmation. This allows the system to serve itself by interpreting visual attention as implicit command, reducing operational burden while maintaining accuracy through the threshold-based intention verification.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS9946338B2Information processing to vary screen display based on a gaze point of the user
Publication Date: 2018.04.17 SONY GROUP CORP
  • US9946338B2 patent drawing
  • US9946338B2 patent drawing
  • US9946338B2 patent drawing

AI summary

There is provided an information processing apparatus including a detection unit configured to detect a gaze point of a user in a display image displayed on a display unit, an estimation unit configured to estimate an intention of the user based on the gaze point detected by the detection unit, an image generation unit configured to generates a varying image that subtly varies from the display image to a final display image according to the intention estimated by the estimation unit, and a display control unit configured to control the display unit in a manner that the varying image generated by the image generation unit is displayed.