Air-Mode Pointing Device Using Multi-Color Light Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional pointing devices, such as computer mice, require a surface for operation, limiting their use in 2D and 3D human-computer interaction tasks, and existing 3D pointing technologies are either expensive or lack sufficient resolution, making them unsuitable for affordable and manipulative tasks like 3D sculpturing or gaming.

Innovation Solution

A pointing/input device using passive light detection with a conventional webcam for 2D and 3D pointing and command inputs, employing sets of actuable light sources emitting different colors, allowing operation in 'air mode' without a surface, and utilizing a single imaging device to capture and interpret light source patterns for position and motion calculations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional optical mice are used for 2D pointing, then movement detection is achieved, but surface dependency limits operation to specific surfaces only

Engineering Contradiction:
Improvesurface independenceVSAvoidoperation availability
Core Design Contradiction:
Adaptability or versatilityVSEase of operation

Solution Approach 1:

The patent replaces the mechanical surface-contact-based optical mouse system with a passive light detection system using a webcam. Instead of requiring physical contact with a surface to detect movement, the system uses computer vision to track the position and orientation of a pointing device with light sources in 3D space, enabling operation without surface dependency.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The invention transitions from 2D surface-based pointing to 3D air-based pointing. By introducing the third dimension (depth/height) and using a camera to capture spatial coordinates in 3D space, the system enables pointing operations in air mode without requiring contact with a 2D surface.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Adaptability or versatility

If existing 3D pointing technologies are used, then 3D pointing capability is achieved, but high cost or low resolution makes them unsuitable for affordable tasks

Engineering Contradiction:
Improve3D pointing capabilityVSAvoidpointing resolution
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent employs inexpensive components to achieve 3D pointing functionality. Instead of using expensive specialized 3D pointing hardware, the system uses a standard webcam and simple light sources that can be easily replaced, providing affordable 3D pointing capability for tasks like sculpturing and gaming.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Solution Approach 2:

The system achieves precise 3D positioning by changing and tracking multiple parameters simultaneously - the spatial coordinates (x, y, z) of light sources, their intensities, and temporal sequences of activation. This multi-parameter approach enables high-resolution 3D pointing using inexpensive hardware.

Inventive Principle:
Principle #35Parameter changes

3Device complexity

If passive light detection with one camera is used, then cost-effectiveness and simplicity are improved, but 2D and 3D pointing modes must be differentiated

Engineering Contradiction:
Improvesystem simplicityVSAvoid2D and 3D mode differentiation
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The system dynamically adapts between 2D and 3D pointing modes based on the operational context. The software can switch between interpreting light source patterns for 2D cursor control or for 3D spatial positioning, allowing a single simple hardware configuration to serve multiple pointing needs without requiring physical mode switching mechanisms.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables 2D and 3D pointing and command inputs without a surface, providing affordable and manipulative functionality for tasks like 3D sculpturing and gaming, with standard computer hardware and software, offering a cost-effective solution for human-computer interaction systems.

Implementation Method 1

passive light detection for both 2D and 3D modes

Methodology Applied
Scientific EffectLight detection: Photoelectric Effect

Data Source

PatentUS9678583B22D and 3D pointing device based on a passive lights detection operation method using one camera
Publication Date: 2017.06.13 UNIVERSITY OF KENTUCKY RESEARCH FOUNDATION
  • US9678583B2 patent drawing
  • US9678583B2 patent drawing
  • US9678583B2 patent drawing

AI summary

Systems for surface-free pointing and/or command input include a computing device operably linked to an imaging device. The imaging device can be any suitable video recording device including a conventional webcam. At least one pointing/input device is provided including first, second, and third sets of actuable light sources, wherein at least the first and second sets emit differently colored light. The imaging device captures one or more sequential image frames each including a view of a scene including the activated light sources. One or more computer program products calculate a two-dimensional or three-dimensional position and/or a motion and/or an orientation of the pointing/input device in the captured image frames by identifying a two-dimensional or three-dimensional position of the activated light sources of the first, second, and/or third sets of light sources. Certain activation patterns of light sources are mapped to particular pointing and/or input commands.