Camera-Based Fingertip Tracking for Free-Space Input
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional methods for user input, such as touch-sensing displays and camera-based finger tracking, are either expensive, limited to flat surfaces, or lack the mobility and dexterity of fingertip movement in free space.
Innovation Solution
A camera-based system that identifies and maps fingertip locations and movements to virtual user inputs, using a video camera, processor, and memory to track fingertips in free space and translate their motion into usable inputs for applications, without requiring physical contact with a surface.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If touch-sensing displays are used for user input, then user input capability is provided, but the display becomes expensive and requires more user exertion for large sizes
Solution Approach 1:
The patent introduces a camera as an intermediary device to capture fingertip movements in free space, translating them into user inputs without requiring a touch-sensing display. This mediator enables user input capability while avoiding the cost and size issues of large touch displays.
Solution Approach 2:
The patent replaces the mechanical touch-sensing system with an optical system using a camera to detect fingertip position and movement. This substitution eliminates the need for expensive touch-sensing hardware while maintaining user input functionality.
2Measurement precision
If infrared and laser steering mirrors are used for fingertip tracking, then fingertip tracking in free space is achieved, but the equipment becomes complicated and expensive
Solution Approach 1:
The patent uses ordinary cameras that are inexpensive and widely available, replacing the costly infrared and laser equipment. While camera-based tracking may have slightly different characteristics, it achieves the essential functionality at a fraction of the cost and complexity.
Solution Approach 2:
The patent creates a visual copy of the fingertip in the camera image, which is then processed to extract position and movement information. This optical copying approach replaces the need for complex infrared detection and laser ranging systems.
3Device complexity
If ordinary cameras are used for finger tracking, then cost is reduced, but fingers have less mobility and dexterity compared to fingertips
Solution Approach 1:
The patent focuses the camera's attention specifically on the fingertip region, using image processing to identify and track the fingertip's position and movement separately from the rest of the finger. This localized approach captures the fine mobility and dexterity of the fingertip while using an ordinary camera.
Solution Approach 2:
The patent segments the finger into different parts, specifically isolating the fingertip for tracking purposes. By focusing only on the fingertip region in the video frames and extracting its movement characteristics, the system achieves high precision tracking of fingertip mobility and dexterity.
Data Source
AI summary
Systems and methods for camera-based fingertip tracking are disclosed. One such method includes identifying at least one location of a fingertip in at least one of the video frames, and mapping the location to a user input based on the location of the fingertip relative to a virtual user input device.