Elevator Gaze-Controlled Virtual Interface

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing elevator systems face challenges in providing user-friendly interfaces, especially for individuals with special needs and in crowded spaces, where physical contact with the interface may be difficult or undesirable.

Innovation Solution

The implementation of a virtual user interface projected onto air using a projector device, combined with gaze tracking technology to detect user inputs, allowing for touchless interaction with the elevator system.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a physical user interface (buttons or touch screen) is used, then the interface is easy to manufacture and implement, but it requires physical contact which is problematic for users with special needs and for health-related reasons

Engineering Contradiction:
ImproveAccessibility for users with special needsVSAvoidInterface implementation complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent replaces the mechanical physical interface (buttons, touch screens) with an optical system consisting of a projector that displays a virtual interface in the air and a gaze tracking device that detects user selection through eye movements. This substitution eliminates the need for physical contact while maintaining interface functionality, directly addressing the accessibility problem for users with special needs.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an intermediary optical field (the projected virtual interface) between the user and the elevator control system. The gaze tracking device acts as a mediator that translates eye movements into control signals, allowing users to interact with the system without physical contact with traditional interfaces.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Object-affected harmful factors

If a physical user interface is used in crowded spaces, then the interface is simple to implement, but it increases the risk of disease transmission through contact

Engineering Contradiction:
ImproveDisease transmission riskVSAvoidInterface system complexity
Core Design Contradiction:
Object-affected harmful factorsVSDevice complexity

Solution Approach 1:

The patent replaces the mechanical contact-based interface with an optical detection system. The projector displays the virtual interface in the air, and the gaze tracking device detects user intent through eye movements and blinking patterns, completely eliminating physical contact and thus disease transmission risk.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system uses the user's own physiological signals (eye movements, blinking) to control the interface, eliminating the need for external physical interaction. The gaze tracking device automatically detects and interprets these natural eye movements to generate control signals.

Inventive Principle:
Principle #25Self-service

3Ease of operation

If eye tracking technology is used to eliminate physical contact, then accessibility is improved, but the detection precision of user input may be compromised

Engineering Contradiction:
ImproveTouchless interaction capabilityVSAvoidUser input detection accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent implements a feedback mechanism where the system continuously monitors eye position and blinking patterns, correlates them with the displayed virtual interface elements, and adjusts the control signal generation accordingly. The system can detect when the gaze point intersects with a specific area of the virtual interface and uses blinking as a confirmation signal, ensuring accurate input detection.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent uses multiple eye tracking parameters (gaze position, blinking frequency, duration of gaze) rather than relying on a single parameter. This excessive measurement approach increases detection reliability by cross-validating multiple signals to determine user intent.

Inventive Principle:
Principle #16Partial or excessive action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution enables intuitive and accessible interaction with elevator systems, accommodating users with special needs and reducing the risk of disease transmission by eliminating physical contact with the interface.

Implementation Method 1

at least one projector device for projecting a virtual user interface to air

Methodology Applied
Scientific EffectLight projection: Light

Implementation Method 2

at least one gaze tracking device for capturing a number of images representing at least one eye of a person

Methodology Applied
Scientific EffectImage capture: Photography

Data Source

PatentEP4172088B1Controlling of elevator system
Publication Date: 2025.04.16 KONE OYJ
  • EP4172088B1 patent drawingFigure 1
  • EP4172088B1 patent drawingFigure 2
  • EP4172088B1 patent drawingFigure 3~4

AI summary

The invention relates to a solution for controlling the elevator system (100) with an arrangement comprising: at least one projector device (150) for projecting a virtual user interface (160); at least one gaze tracking device (170) and a control unit (140). The control unit (140) receives a number of images from the gaze tracking device (170) and performs: detect (230) a predefined input from image data; detect (240) an intersection of the virtual user interface (160) and a gaze point (180); and generate (250) a control signal to the elevator system (100) in accordance with a position of the gaze point (180) intersecting the virtual user interface (160).