Projector-Camera System for Gesture Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing small-sized electronic devices, such as smartphones and PDAs, face challenges in efficiently entering commands and data due to their small touch screens or mini-keyboards, which can be time-consuming and error-prone, especially when trying to enter messages or use virtual input devices.
Innovation Solution
An electronic device equipped with a projector-camera system that projects a light pattern onto a surface and captures images to determine if a touch object is in contact with the surface, allowing for the detection of touch actions and gestures without the need for additional sensors or mechanical components, using a method that involves creating a surface map and analyzing the presence of discontinuities in the light pattern.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Volume of moving object
If small touch screens or mini-keyboards are used in small-sized electronic devices, then the device size is reduced, but data entry efficiency deteriorates and becomes time-consuming and error-prone
Solution Approach 1:
The patent extends the input interface from the two-dimensional touch screen to the three-dimensional space above it by projecting a virtual keyboard onto a surface. This allows users to interact with a full-sized keyboard layout in mid-air or on external surfaces, effectively adding a spatial dimension to the input interface without increasing device physical size.
Solution Approach 2:
The patent introduces a projector as an intermediary device that creates a virtual keyboard projection between the user and the physical surface. This intermediary virtual interface enables efficient data entry by providing a larger, more comfortable typing area while the actual device remains compact.
2Measurement precision
If additional light sensors or sources are added to detect touch actions, then touch detection capability is improved, but device complexity and component requirements increase
Solution Approach 1:
The patent makes the existing camera serve multiple functions: it continues to capture images for normal operation and simultaneously detects touch actions by analyzing disruptions in the projected light pattern. This eliminates the need for dedicated touch detection sensors, reducing component requirements while maintaining touch detection capability.
Solution Approach 2:
The system uses its own projected light pattern as the detection medium. The camera captures the reflection and disruption of this self-generated light pattern to detect touch actions, allowing the device to perform self-detection without external or additional sensing components.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables efficient and accurate detection of touch actions and gestures, providing an alternative to traditional input methods by allowing users to interact with virtual keyboards or interfaces on various surfaces, including non-flat ones, without the need for additional light sensors or sources, enhancing user interaction with portable electronic devices.
Implementation Method 1
a camera to capture an image of the light pattern
Data Source
AI summary
The subject matter disclosed herein relates to optical projection and image detection to detect touch or gesture action.