Virtual Keyboard Gesture Controller via Optical Projection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional input devices for personal computing devices, such as physical keyboards and touchscreens, are cumbersome, fragile, and limited in functionality, leading to cluttered workspaces and user fatigue, especially in mobile settings where portability and flexibility are essential.

Innovation Solution

Integration of virtual keyboard technology with a gesture-sensing controller into a single modular device or laptop, utilizing laser diodes, infrared sensors, and stereoscopic cameras to project and detect virtual keyboards and gestures, allowing users to input data and commands through hand movements without the need for separate devices.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a physical keyboard is used for input, then typing functionality is reliable and simple, but it takes up workspace space and adds weight to mobile devices

Engineering Contradiction:
Improvetyping reliabilityVSAvoiddevice weight
Core Design Contradiction:
ReliabilityVSWeight of moving object

Solution Approach 1:

The patent replaces the mechanical physical keyboard system with an optical projection system (laser or LED) that displays virtual keys on a surface, combined with optical sensors (CMOS or CCD cameras) to detect finger positions. This substitution eliminates the need for physical keys while maintaining typing functionality through gesture recognition.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent creates a virtual copy of the physical keyboard by projecting an image of keyboard keys onto a surface. This optical copy allows users to type without physical contact, replicating the keyboard layout and functionality through light projection and visual feedback.

Inventive Principle:
Principle #26Copying

2Reliability

If a physical keyboard is integrated into a laptop, then typing is reliable, but the device becomes vulnerable to moisture and damage

Engineering Contradiction:
Improvetyping reliabilityVSAvoidmoisture susceptibility
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent replaces the mechanical keyboard system with a non-contact optical system using projected light and camera-based gesture detection. This eliminates physical components that can be damaged by moisture, while maintaining typing functionality through visual feedback and gesture recognition.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent creates a virtual keyboard copy that can be projected onto any surface, including the laptop itself or an external surface. This virtual copy is immune to moisture and physical damage, providing a durable alternative to physical keys.

Inventive Principle:
Principle #26Copying

3Weight of moving object

If a touchscreen keyboard is used, then the device becomes lightweight, but the touchscreen is fragile and degrades with use

Engineering Contradiction:
Improvedevice weightVSAvoidtouchscreen durability
Core Design Contradiction:
Weight of moving objectVSReliability

Solution Approach 1:

The patent introduces an intermediary optical system that projects virtual keys and detects gestures without requiring direct contact with the touchscreen surface. The laser/LED projection and camera detection act as intermediaries between the user and the touchscreen, reducing wear and tear on the display.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent projects a virtual keyboard overlay that serves as an intermediary layer between the user and the touchscreen. This optical copy allows users to interact with the device without directly touching or pressing the touchscreen, reducing degradation from use.

Inventive Principle:
Principle #26Copying

4Adaptability or versatility

If multiple input devices (keyboard, mouse, touchpad) are provided, then functionality is comprehensive, but the workspace becomes cluttered

Engineering Contradiction:
Improveinput functionalityVSAvoidworkspace area
Core Design Contradiction:
Adaptability or versatilityVSArea of stationary object

Solution Approach 1:

The patent merges multiple input device functionalities into a single integrated system. The gesture-sensing controller combines virtual keyboard typing, mouse-like cursor control through hand gestures, and other input functions into one unified device that uses optical projection and gesture recognition for all interactions.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent creates a universal input device that can perform multiple functions: typing through virtual keyboard projection, cursor control through gesture recognition, scrolling, selecting, and other commands. This single multi-functional device replaces the need for separate keyboards, mice, and touchpads.

Inventive Principle:
Principle #6Universality (Multi-functionality)

5Weight of moving object

If a virtual keyboard is used, then the device becomes portable and lightweight, but it requires typing on the display surface which is fragile

Engineering Contradiction:
Improvedevice weightVSAvoiddisplay surface vulnerability
Core Design Contradiction:
Weight of moving objectVSObject-affected harmful factors

Solution Approach 1:

The patent introduces an optical projection system as an intermediary that displays virtual keys without requiring direct typing on the display surface. The laser/LED projection and camera detection create a contactless interaction layer, protecting the display from wear and damage.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent projects a virtual keyboard copy onto the display surface or an external surface, allowing users to type through gesture recognition rather than direct contact. This optical copy provides the visual feedback of a keyboard while eliminating the mechanical wear and fragility issues.

Inventive Principle:
Principle #26Copying

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This integration enhances convenience, reduces clutter, and improves flexibility by allowing users to seamlessly switch between typing and gesture-based input, resulting in a lighter, more durable, and user-friendly computing experience.

Implementation Method 1

a laser diode assembly for projecting the virtual keyboard

Methodology Applied
Scientific EffectLaser: Laser

Implementation Method 2

an infrared sensor for detecting the gestures

Methodology Applied
Scientific EffectInfrared radiation detection: Infrared Radiation

Data Source

PatentUS10146321B1Systems for integrating gesture-sensing controller and virtual keyboard technology
Publication Date: 2018.12.04 MASSACHUSETTS MUTUAL LIFE INSURANCE CO
  • US10146321B1 patent drawing
  • US10146321B1 patent drawing
  • US10146321B1 patent drawing

AI summary

The systems described herein integrate virtual keyboard technology and gesture-based controllers into a single module or into a laptop or other mobile computing device in order to make laptops, personal computers, and other mobile computing devices more convenient, more versatile, and with less clutter or fewer peripheral devices than is typically the case with a traditional combination of a physical keyboard with a mouse, touchpad, or track ball. Users of the embodiments disclosed herein will be able to enter data or commands merely by typing or making hand gestures or hand movements, which will lead to greater flexibility, creativity, and productivity, while reducing user ennui and fatigue.