Virtual Retinal Display Overlaying Input Areas for Gaze Interaction

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Touchscreens have limitations as input devices for computers, particularly in scenarios where users need to interact with the real world while inputting commands, as they require visual attention to be split between the screen and the environment.

Innovation Solution

A wearable virtual retinal display device with a gaze tracker and camera system that overlays virtual input areas onto the user's field of view, allowing them to see the real world while inputting commands by manipulating real volumes corresponding to these areas, which are then processed by a computer to perform associated actions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a touchscreen is used as an input device, then the computer can receive user commands, but the user must split visual attention between the screen and the real world environment

Engineering Contradiction:

Improveinput operationVSAvoidvisual attention to environment

Core Design Contradiction:

Ease of operationVSLoss of information

Solution Approach 1:

The patent creates a virtual copy of the touchscreen interface in the user's field of view using a virtual retinal display. The virtual input areas are projected onto the retina, allowing users to interact with digital interfaces without physically looking at a screen, thus maintaining awareness of the real-world environment while performing input operations.

Inventive Principle:

Principle #26Copying

Solution Approach 2:

The patent transitions the input interface from a physical 2D touchscreen surface to a virtual 3D space in the user's field of view. Virtual input areas are positioned at different depths and locations in the user's visual field, enabling interaction through head movements and gaze direction rather than physical touch, thereby resolving the conflict between interface interaction and environmental awareness.

Inventive Principle:

Principle #17Another dimension (Dimensionality change)

2Productivity

If a touchscreen display is used, then users can input commands, but users cannot concurrently see the real world without shifting attention

Engineering Contradiction:

Improveinput efficiencyVSAvoidtime to shift attention

Core Design Contradiction:

ProductivityVSLoss of time

Solution Approach 1:

The virtual retinal display maintains continuous presentation of the input interface in the user's field of view without requiring intermittent shifts to a physical screen. The virtual input areas remain constantly accessible through gaze and head movement, eliminating the discontinuous attention shifts required by traditional touchscreens and enabling uninterrupted interaction with both the interface and environment.

Inventive Principle:

Principle #20Continuity of useful action

3Adaptability or versatility

If a virtual retinal display with camera system is used, then users can interact with digital interfaces while seeing the real world, but the device complexity increases

Engineering Contradiction:

Improveinput method flexibilityVSAvoiddevice structure

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent integrates multiple functions into a single wearable device: the virtual retinal display module provides visual output, the gaze tracker monitors user attention, and the camera system captures environmental information. This multi-functional integration enables the device to serve as both an display, input device, and environmental sensor, justifying the increased complexity through enhanced versatility and adaptability.

Inventive Principle:

Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables users to interact with both digital and real-world elements seamlessly, improving usability and reducing the need to constantly focus on a screen, enhancing the efficiency of input operations in environments where real-world interaction is necessary.

Implementation Method 1

a VRD module comprising a gaze tracker physically associated with the frame for projecting a visible image directly on a retina of a person

Methodology Applied

Scientific EffectVirtual retinal display projection:

Implementation Method 2

at least one camera physically associated with the frame, with a lens-front directed at a real volume in front of the person, configured for acquiring a series of images of the real volume in front of the person

Methodology Applied

Scientific EffectLight detection:

Data Source

PatentUS11800084B2Wearable virtual retinal display

Publication Date: 2023.10.24 EYEJETS LTD

AI summary

Disclosed are a method and an input device for inputting information such as user commands to a computer a person wearing a virtual retinal display device that allows the person to concurrently see the real world.