Smart Glasses Eye Tracking for Hands-Free Code Configuration

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing no-code development platforms require users to interact with computing devices using mice or touchscreens, limiting the ability to configure programming code, and there is a desire to enable configuration through smart glasses interactions, particularly through eye movement calibration.

Innovation Solution

Smart glasses with embedded microprocessors, sensors to track eye position, and wireless communication interfaces that capture and transmit eye movement data to a computing device, allowing users to select and order programming functions visually, enabling hands-free software application development.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If no-code development platforms are used with traditional input devices (mouse, touchscreen, keyboard), then programming functions can be configured, but user interaction requires manual operation and limits hands-free configuration capability

Engineering Contradiction:

Improvehands-free configuration capabilityVSAvoidinteraction system complexity

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The patent replaces mechanical input devices (mouse, keyboard, touchscreen) with an optical-based eye tracking system. The smart glasses capture eye position data through optical sensors, and a calibration engine maps these positions to programming function selections, enabling hands-free configuration without mechanical interaction devices.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces eye position data as an intermediary between the user and the programming function selection. Instead of direct manual operation, the system captures eye positions, filters them for visual focus, maps them to programming functions through calibration, and uses this intermediate data to drive the configuration process.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Adaptability or versatility

If smart glasses with eye tracking are integrated into no-code platforms, then hands-free programming function selection is enabled, but requires calibration and filtering of eye position data to ensure accuracy

Engineering Contradiction:

Improveprogramming function selection capabilityVSAvoiddata processing complexity

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent performs preliminary calibration before actual programming function selection. The calibration engine pre-establishes the mapping between eye positions and programming function coordinates, and pre-filters eye position data for visual focus determination. This preliminary processing simplifies the subsequent function selection process.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent implements feedback through the calibration process, where eye position data is continuously captured, filtered, and mapped to verify accurate correspondence with programming function locations. The system uses this feedback to ensure the mapping accuracy and maintain precise control during hands-free configuration.

Inventive Principle:

Principle #23Feedback

3Measurement precision

If eye position data is captured and mapped to programming functions, then hands-free selection is achieved, but requires filtering based on visual focus determination to maintain precision

Engineering Contradiction:

Improveprogramming function selection precisionVSAvoidcalibration and filtering time

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The patent performs visual focus filtering and eye position validation in advance during the calibration phase. By pre-establishing which eye positions correspond to valid programming function selections and filtering out invalid positions beforehand, the system reduces the need for time-consuming validation during actual function selection.

Inventive Principle:

Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables hands-free configuration of programming code by mapping eye movements to selectable programming functions, allowing users to create software applications without traditional coding, enhancing usability and portability in software development.

Implementation Method 1

a sensor configured to capture a user eye position

Methodology Applied

Scientific EffectOptical detection: Photoelectric Effect

Data Source

PatentUS11340703B1Smart glasses based configuration of programming code

Publication Date: 2022.05.24 BANK OF AMERICA CORP

AI summary

Systems, methods, and apparatus for smart glasses based configuration of programming code are provided. A smart glasses device may capture a sequence of user eye positions using one or more sensors. A user interface may display one or more selectable programming functions. Each programming function may be pre-associated with a segment of programming code implementing the function. The user eye positions captured by the smart glasses may be filtered based on the degree of visual focus. A calibration engine may map each user eye position to one of the selectable programming functions displayed on the user interface. The selected programming functions may be ordered based on the sequence of user eye positions. A software application may be configured by assembling the segments of programming code associated with each programming function.