Virtual Input Device Projection Adjustment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing virtual input devices lack the ability to accurately determine when they are in use and adjust their projections accordingly, leading to inefficiencies in user interaction and input recognition.

Innovation Solution

A system comprising a projector and a camera, where the processor determines the approximate location of a surface and modifies the projection based on its brightness threshold, allowing for real-time adjustment and recognition of user input.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If the projector continuously projects the virtual input device, then the device is always available for use, but energy is wasted when the device is not in use

Engineering Contradiction:
Improveavailability of virtual input deviceVSAvoidenergy consumption of projector
Core Design Contradiction:
Ease of operationVSLoss of energy

Solution Approach 1:

The projector operates periodically rather than continuously - it projects the virtual input device only when activation conditions are met (motion detection, proximity detection, or user input detection), and remains inactive otherwise. This periodic operation resolves the contradiction by ensuring availability when needed while eliminating energy waste during non-use periods.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system uses feedback from sensors (motion sensors, proximity sensors, or input detection mechanisms) to determine when to activate the projector. The feedback loop continuously monitors the environment and triggers projector activation only when user presence or intent is detected, thereby maintaining ease of operation while reducing energy consumption during inactive periods.

Inventive Principle:
Principle #23Feedback

2Illumination intensity

If the projector projects the virtual input device at high brightness, then the device is easily visible and detectable, but energy consumption increases

Engineering Contradiction:
Improvebrightness of virtual input deviceVSAvoidenergy consumption of projector
Core Design Contradiction:
Illumination intensityVSLoss of energy

Solution Approach 1:

The projector uses high brightness only periodically when activation conditions are met, rather than maintaining continuous high brightness. This resolves the contradiction by ensuring high visibility and detectability when the virtual input device is active, while reducing energy consumption during inactive periods when lower or zero brightness is maintained.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The brightness parameter of the projector is dynamically changed based on activation conditions. When activated, the projector operates at high brightness for optimal visibility and detection. When inactive, the brightness is reduced or turned off completely, thereby resolving the contradiction between illumination intensity and energy consumption through parameter adjustment.

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables precise detection of user input and efficient interaction by ensuring the virtual input device is only active when in use, enhancing user experience and interaction accuracy.

Implementation Method 1

a laser to project a visible virtual keyboard onto a surface (e.g., a red diode laser as a light source)

Methodology Applied
Scientific EffectLight projection: Light

Implementation Method 2

as a finger makes a keystroke on the virtual keyboard, the finger breaks the infrared beam and infrared light is reflected back to a camera

Methodology Applied
Scientific EffectInfrared reflection: Reflection

Implementation Method 3

Reflected infrared beam may pass through an infrared filter to the camera, and the camera can photograph an angle of incoming infrared light

Methodology Applied
Scientific EffectInfrared detection: Infrared Radiation

Data Source

PatentEP2732357B1Methods and systems for a virtual input device
Publication Date: 2018.09.19 GOOGLE LLC
  • EP2732357B1 patent drawingFigure 1
  • EP2732357B1 patent drawingFigure 2
  • EP2732357B1 patent drawingFigure 3A~3B

AI summary

The present application discloses systems and methods for a virtual input device. In one example, the virtual input device includes a projector and a camera. The projector projects a pattern onto a surface. The camera captures images that can be interpreted by a processor to determine actions. The projector may be mounted on an arm of a pair of eyeglasses and the camera may be mounted on an opposite arm of the eyeglasses. A pattern for a virtual input device can be projected onto a "display hand" of a user, and the camera may be able to detect when the user uses an opposite hand to select items of the virtual input device. In another example, the camera may detect when the display hand is moving and interpret display hand movements as inputs to the virtual input device, and/or realign the projection onto the moving display hand.