Eye-Gaze AR Interface for Remote IoT Control Coordination

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing eye-based control systems face challenges in efficiently controlling devices from a distance and synchronizing multiple user activities, particularly in collaborative workflows, due to limitations in tracking and coordination.

Innovation Solution

A system utilizing augmented reality glasses with eye-tracking capabilities, dynamically creating user interfaces to guide users in performing eye-based controlled activities, including collaborative workflows, by identifying gaze direction, determining target devices and activities, and sequencing commands based on user interaction.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If eye-based control systems are used to control devices from a distance, then user interaction flexibility is improved, but tracking precision and coordination reliability deteriorate

Engineering Contradiction:
Improveuser interaction flexibilityVSAvoidtracking precision
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent introduces an intermediary processing system that bridges the gap between distant eye-based control inputs and device responses. The system uses intermediate computational steps to interpret eye gaze data, determine intent, and coordinate multiple devices, thereby maintaining control precision despite distance-related tracking challenges

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs preliminary actions by pre-processing eye tracking data and anticipating user intent before actual device control is needed. It proactively identifies gaze patterns, predicts desired actions, and prepares control commands in advance, improving both tracking effectiveness and response accuracy at distance

Inventive Principle:
Principle #10Preliminary action

2Productivity

If multiple user activities are synchronized in collaborative workflows, then productivity is improved, but system complexity and coordination difficulty increase

Engineering Contradiction:
Improvecollaborative workflow efficiencyVSAvoidsystem coordination complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent merges multiple user activities and device controls into a unified collaborative workflow system. It combines eye tracking data from multiple users, integrates device states, and coordinates actions across the IoT ecosystem through a centralized yet distributed control architecture, enabling synchronized productivity without linear complexity increases

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system implements universal coordination mechanisms that handle multiple user activities through common protocols and shared control logic. The eye-based control system serves multiple functions: individual device control, collaborative workflow management, and system-wide coordination, reducing overall system complexity through multi-functionality

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS12549436B2Internet of things configuration using eye-based controls
Publication Date: 2026.02.10 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US12549436B2 patent drawing
  • US12549436B2 patent drawing
  • US12549436B2 patent drawing

AI summary

In an approach to an Internet of Things configuration using eye-based controls, one or more computer processors receive an initiation of eye control of one or more computing devices from a user. One or more computer processors identify an eye gaze direction of the user. Based on the identified eye gaze direction, one or more computer processors determine one or more target devices of the one or more computing devices. One or more computer processors determine one or more activities associated with the one or more target devices. One or more computer processors determine one or more eye control commands associated with the one or more activities. One or more computer processors display the one or more eye control commands associated with the one or more activities in the field of view of the user.