Eye-Gaze Media Display Control for Users With Motor Impairments

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Users with physical disabilities, such as neurodevelopmental disorders, face difficulties in controlling media display devices like televisions due to motor impairments, necessitating assistance for basic functions like channel switching and volume control.

Innovation Solution

An electronic device equipped with an image capturing system tracks a user's eye gaze to select UI elements, transmitting control signals to a media display device via short-range wireless communication, allowing seamless control without physical interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a remote control is used to control media display devices, then the device can be controlled for basic functions, but users with physical disabilities experience difficulty in operating it

Engineering Contradiction:

ImproveEase of operationVSAvoidAdaptability to physical disabilities

Core Design Contradiction:

Ease of operationVSAdaptability or versatility

Solution Approach 1:

The patent replaces the mechanical remote control system with an eye-tracking based control system. The electronic device captures images of the user's eyes and determines gaze position to control media display devices, eliminating the need for physical manipulation of a remote control and making the system accessible to users with motor impairments.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an intermediary system consisting of an image capturing device and processing circuitry that translates eye gaze movements into control signals. This intermediary layer converts biological eye movements into digital commands, enabling users with physical disabilities to control devices without direct physical interaction.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Adaptability or versatility

If eye gaze tracking is implemented to control media display devices, then users with disabilities can independently control the device, but the device complexity increases

Engineering Contradiction:

ImproveAdaptability to physical disabilitiesVSAvoidDevice complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements a universal control system where the electronic device performs multiple functions: capturing images, processing eye gaze data, determining control signals, and communicating with media display devices. This multi-functional approach consolidates complexity into a single device that can assist various users with different disabilities.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system enables self-service control for users with disabilities by automatically tracking eye gaze and translating it into device control commands without requiring external assistance. The electronic device autonomously processes images, determines gaze position, and generates control signals, allowing users to independently operate media display devices.

Inventive Principle:

Principle #25Self-service

3Reliability

If traditional remote control methods are used, then the control system is simple, but external assistance is required for users with physical disabilities

Engineering Contradiction:

ImproveReliability of independent controlVSAvoidEase of operation

Core Design Contradiction:

ReliabilityVSEase of operation

Solution Approach 1:

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentEP4248297B1Media display device control based on eye gaze

Publication Date: 2025.07.16 SONY GROUP CORP

Figure 1
Figure 2
Figure 3A

AI summary

Provided is an electronic device that captures a first image of a user. The electronic device determines a position of eye gaze of the user on a first UI element of a plurality of UI elements displayed on a first display screen of the electronic device, based on the first image. The electronic device selects the first UI element based on a determination of the position of the eye gaze on the first UI element for a time interval. The electronic device transmits a first control signal to a media display device, based on the selection of the first UI element. The electronic device receives a feedback image from the media display device. The feedback image indicates control of the media display device based on the first control signal. The electronic device controls the first display screen to display the feedback image with the plurality of UI elements.