Wearable Eye-Tracking AAC Device for Hands-Free Communication

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional Augmentative and Alternative Communication (AAC) devices are large, obtrusive, and require frequent calibrations, making them unsuitable for hands-free, portable communication for individuals with disabilities like ALS and Locked-in Syndrome, as they obstruct the user's vision and are not easily adaptable to non-controlled settings.

Innovation Solution

A low-cost, portable, standalone AAC device that uses eye movements as input, providing speech or text output through a wearable system with audio feedback and visual indicators, allowing users to communicate and control external devices without the need for extensive calibration or display components, enabling communication and control in various settings.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional AAC devices are used, then communication function is provided, but the devices are large and obtrusive, obstructing user vision and reducing portability

Engineering Contradiction:
ImproveportabilityVSAvoiddevice size
Core Design Contradiction:
Adaptability or versatilityVSArea of stationary object

Solution Approach 1:

The AAC device is segmented into separate functional components: a head-mounted unit with eye-tracking sensor, a wearable computing device with display and processor, and wireless communication modules. This segmentation allows each component to be optimized independently, reducing the size of individual parts while maintaining overall functionality.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system transitions from a single large stationary device to a distributed multi-dimensional architecture where computing, display, and sensing functions are separated across different wearable components, enabling portability without sacrificing communication capabilities.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Reliability

If conventional AAC devices are used, then communication is enabled, but frequent calibrations are required to account for head or body movements

Engineering Contradiction:
Improvecommunication reliabilityVSAvoidcalibration frequency
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The eye-tracking system continuously self-calibrates by monitoring user gaze patterns and adapting to head movements in real-time. The wearable computing device automatically adjusts calibration parameters based on detected motion, eliminating the need for frequent manual recalibration while maintaining communication reliability.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system incorporates continuous feedback loops where the eye-tracking sensor detects gaze direction, the processor analyzes the data, and the system adjusts its response accordingly. This real-time feedback mechanism compensates for head and body movements dynamically, maintaining reliable communication without requiring user intervention for calibration.

Inventive Principle:
Principle #23Feedback

3Ease of operation

If eye movement detection is implemented, then hands-free communication is achieved, but system complexity increases

Engineering Contradiction:
Improvehands-free operationVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system replaces complex mechanical control interfaces with optical eye-tracking detection. Instead of requiring physical buttons or switches, the wearable device uses eye-position sensors to detect gaze direction and interpret user intent, simplifying the interaction model while enabling hands-free operation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The wearable computing device serves multiple functions: it processes eye-tracking data, displays communication options, synthesizes speech output, and manages wireless connectivity. This multi-functionality consolidates what would otherwise require separate specialized components, reducing overall system complexity while enabling hands-free communication.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10372204B2Communication and control system and method
Publication Date: 2019.08.06 TECHNOLOGY AGAINST ALS
  • US10372204B2 patent drawing
  • US10372204B2 patent drawing
  • US10372204B2 patent drawing

AI summary

An input system includes at least one sensor and a controller communicatively coupled to the at least one sensor. The at least one sensor is configured to identify a position of an eye. The controller is configured to receive a first signal indicative of a first position of an eye from the at least one sensor and map the eye position to a user's selection.