Dual Camera 3D Hover Detection Reducing Power and Cost
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current systems for detecting user interaction in three-dimensional hover zones adjacent to display surfaces are costly, power-intensive, and require specialized components, while also facing challenges with occlusion and high computational overhead, failing to meet industry accuracy and resolution standards.
Innovation Solution
A system utilizing two generic off-the-shelf cameras pre-calibrated to capture two-dimensional images from different vantage points, processing only relevant landmark points to reconstruct sparse three-dimensional data, allowing for natural user interaction with minimal computational and cost overhead, and compatible with existing imaging applications.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If time-of-flight systems are used to detect three-dimensional hover zone interactions, then measurement precision and three-dimensional detection capability are improved, but device cost and power consumption increase significantly
Solution Approach 1:
The patent replaces time-of-flight sensing systems with a camera-based optical sensing system. Instead of using active TOF sensors that emit and measure reflected light time, the invention uses passive cameras to capture images from multiple viewpoints and reconstruct three-dimensional positions through triangulation. This substitution dramatically reduces power consumption while maintaining three-dimensional detection capability in the hover zone.
Solution Approach 2:
The patent uses multiple two-dimensional camera images as copies of the three-dimensional scene. By capturing the same spatial information from different viewpoints and reconstructing three-dimensional positions from these two-dimensional copies, the system achieves 3D detection without requiring expensive and power-intensive TOF sensors.
2Measurement precision
If structured light systems are used to enable three-dimensional hover detection, then measurement precision is improved, but device complexity and cost increase
Solution Approach 1:
The patent replaces structured light projection systems with a multi-camera imaging system. Instead of projecting complex light patterns and analyzing their distortion, the invention uses off-the-shelf cameras to capture images from multiple viewpoints and computes three-dimensional positions through geometric triangulation, significantly reducing system complexity.
Solution Approach 2:
The patent uses generic off-the-shelf cameras that can be used for both two-dimensional imaging and three-dimensional reconstruction. These universal components serve multiple functions: capturing hover zone interactions, detecting touch screen contacts, and providing depth information, eliminating the need for specialized structured light projectors and sensors.
3Measurement precision
If multi-camera systems are used to detect three-dimensional positions, then measurement precision is improved, but computational overhead increases
Solution Approach 1:
The patent segments the image processing task by having each camera independently identify features and potential touch points in its own image, then combining results through triangulation. This division of labor reduces the computational burden on any single processor and enables parallel processing, improving overall system productivity.
Solution Approach 2:
The patent processes only the minimal necessary information from each camera to achieve three-dimensional reconstruction. Instead of fully processing and analyzing entire high-resolution images, the system extracts only the relevant feature points and uses them for triangulation, reducing computational overhead while maintaining measurement precision.
4Measurement precision
If retro-reflective strips are added to the display bezel to enable optical sensing, then measurement precision is improved, but manufacturing complexity and cost increase
Solution Approach 1:
The patent eliminates the need for retro-reflective strips by using a different optical sensing approach. The system uses ambient or emitted optical energy that naturally illuminates the display and hover zone, and cameras capture reflections from standard display surfaces without requiring specialized retro-reflective materials or modified bezels.
Solution Approach 2:
The patent extracts the optical sensing function from the display hardware itself and relocates it to external cameras. Instead of modifying the display to include retro-reflective strips and integrated sensors, the invention uses separate imaging devices that capture optical information, simplifying display manufacturing while maintaining sensing capability.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables efficient and accurate user interaction in three-dimensional hover zones with reduced power consumption and cost, meeting industry standards for accuracy and resolution without the need for specialized components, and is adaptable to various display sizes from smartphones to large TVs.
Implementation Method 1
a camera and an optical emitter, perhaps an IR LED, are disposed at each upper corner region of the screen with (x,y) fields of view (FOV) that ideally encompass all of the screen
Implementation Method 2
You can determine the (x,y) location of the touch on the display screen surface by combining the centroid of the blob using triangulation
Data Source
AI summary
User interaction with a display is detected substantially simultaneously using at least two cameras whose intersecting FOVs define a three-dimensional hover zone within which user interactions can be imaged. Separately and collectively image data is analyzed to identify a relatively few user landmarks. A substantially unambiguous correspondence is established between the same landmark on each acquired image, and a three-dimensional reconstruction is made in a common coordinate system. Preferably cameras are modeled to have characteristics of pinhole cameras, enabling rectified epipolar geometric analysis to facilitate more rapid disambiguation among potential landmark points. Consequently processing overhead is substantially reduced, as are latency times. Landmark identification and position information is convertible into a command causing the display to respond appropriately to a user gesture. Advantageously size of the hover zone can far exceed size of the display, making the invention usable with smart phones as well as large size entertainment TVs.