Camera-Based Fingertip Tracking for Free-Space User Input
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional methods for user input, such as keyboards and touch-sensing displays, are either expensive, require physical contact, or lack the mobility and dexterity to track fingertips in free space effectively, while camera-based tracking systems have limitations in recognizing finger movements.
Innovation Solution
A camera-based system that uses a video camera, processor, and memory to identify and map fingertip locations and movements to virtual user inputs, allowing for free-space tracking and interaction without physical contact, utilizing a software logic that processes video frames to translate fingertip motion into keyboard or mouse inputs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If touch-sensing displays are used for user input, then user input capability is provided, but the display becomes expensive and requires more user exertion for large sizes
Solution Approach 1:
The patent introduces a camera as an intermediary device to capture fingertip movements in free space, translating them into user inputs without requiring a touch-sensing display. This mediator enables user input capability while avoiding the high cost and size-related exertion problems of touch displays
Solution Approach 2:
The patent replaces the mechanical touch-sensing system with an optical system using a camera to detect fingertip position and movement. This substitution eliminates the need for expensive touch-sensing display hardware while maintaining user input functionality
2Ease of operation
If touch-sensing displays are used, then user input is enabled, but fingertip movement is restricted to flat surfaces only
Solution Approach 1:
The patent transitions from 2D flat surface interaction to 3D free-space interaction by using a camera to track fingertip movements in three-dimensional space. This dimensional expansion allows fingertips to move freely in space while still enabling accurate user input recognition
3Adaptability or versatility
If infrared and laser steering mirrors are used for fingertip tracking, then free-space tracking is achieved, but the equipment becomes complicated and expensive
Solution Approach 1:
The patent uses a standard camera to capture optical images of fingertips, creating a visual copy of the fingertip position and movement. This copying approach replaces complex infrared and laser systems with simple, inexpensive camera-based tracking while maintaining free-space tracking capability
Solution Approach 2:
The patent employs ordinary, inexpensive cameras instead of expensive, complex infrared and laser equipment. The use of cheap, readily available camera technology achieves the same tracking function at a fraction of the cost and complexity
4Ease of manufacture
If ordinary cameras are used for tracking, then cost is reduced, but fingers have less mobility and dexterity compared to fingertips
Solution Approach 1:
The patent applies local quality enhancement by specifically optimizing the tracking of fingertip regions in the captured images. The system focuses computational resources and image processing algorithms on accurately identifying and tracking the small, precise fingertip area within the broader finger structure, thereby achieving high measurement precision with ordinary cameras
Data Source
AI summary
Systems and methods for camera-based fingertip tracking are disclosed. One such method includes identifying at least one location of a fingertip in at least one of the video frames, and mapping the location to a user input based on the location of the fingertip relative to a virtual user input device.