Finger Detection Using Camera and EMF Sensors
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional computing devices face challenges in accurately determining user input, particularly when the user's fingertip is outside the camera's field of view or in 'dead zones,' limiting input to simple motions and reducing effectiveness.
Innovation Solution
The system employs a combination of cameras, electromagnetic field sensors, and other sensors to estimate the fingertip position using image analysis, extrapolation, and hand models, allowing for accurate determination of input even outside the camera's view by tracking changes and using sensor data to determine the relative position and orientation of the fingertip.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If camera-based gesture detection is used, then motion detection capability is provided, but detection accuracy deteriorates when fingertip is outside field of view or in dead zones
Solution Approach 1:
The patent combines multiple sensing modalities (camera, electromagnetic field sensor, other sensors) into an integrated system for fingertip detection. This multi-sensor fusion approach allows the system to maintain accurate fingertip position detection even when the fingertip is outside the camera's field of view by switching to or supplementing with electromagnetic field sensing and other sensor data.
Solution Approach 2:
The patent introduces electromagnetic field sensors as intermediary detection means to bridge the gap when direct camera detection fails. These sensors act as mediators that can detect fingertip presence and position in dead zones where cameras cannot see, thereby maintaining continuous and accurate gesture detection capability.
2Device complexity
If camera field of view is limited, then device complexity is reduced, but input effectiveness deteriorates due to restricted gesture recognition
Solution Approach 1:
The patent makes the sensing system universal by enabling it to detect fingertips through multiple methods (camera visualization, electromagnetic field detection, other sensor measurements). This multi-functional capability allows the system to handle various detection scenarios effectively, maintaining high input effectiveness regardless of fingertip position while managing device complexity through intelligent sensor utilization.
3Reliability
If simple broad motions are used for detection, then detection reliability is improved, but input versatility deteriorates due to limited gesture types
Solution Approach 1:
The patent implements dynamic detection capabilities by adapting the sensing approach based on real-time conditions. The system can dynamically switch between camera-based detection for visible fingertips and electromagnetic field/other sensor-based detection for fingertips in dead zones. This dynamic adaptation maintains reliable detection across diverse gesture types, enabling both simple and complex gestures to be recognized accurately.
Data Source
AI summary
A user can use a finger, or other such object, to provide input to a computing device. The finger does not have to contact the device, but can be positioned and/or oriented in such a way that the device can determine an input that the user is attempting to provide, such as an element or icon that the user is intended to select. One or more cameras can capture image information, which can be analyzed to attempt to determine the location and/or orientation of the finger. If the finger is at least partially outside a field of view of the camera(s), the device can use a sensor (e.g., EMF) to attempt to determine a location of at least a portion of the finger, which can be used with the image information to determine the location and/or orientation of the finger. Other estimation processes can be used as well.