Glasses Display Hand Motion Recognition via Camera Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Glass-type display devices, such as Google Glass, face challenges in providing effective command input methods due to the limitations of voice recognition, particularly in noisy environments and the difficulty in mimicking mouse movements or gestures.
Innovation Solution
A method utilizing a camera-mounted glasses-type display device to recognize and interpret hand motions, allowing users to input commands through natural and intuitive hand gestures, including recognizing hand shapes, tracking hand movements, and outputting control signals based on these motions, with features like using a color code on the index finger to differentiate between finger states and interpreting circular motions for zoom functions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If voice recognition method is used for command input, then hands-free operation is enabled, but malfunction occurs in loud environments and hearing of other persons is disturbed
Solution Approach 1:
The patent introduces a camera as an intermediary device to capture hand motion images, which then serve as the basis for recognition and control signals. This intermediary approach replaces direct voice recognition with visual-based hand gesture recognition, solving the problem of voice recognition malfunctioning in loud environments while maintaining hands-free operation capability
2Ease of operation
If voice recognition method is used for command input, then hands-free operation is enabled, but it is difficult to input commands such as mouse movement or gesture
Solution Approach 1:
The patent replaces the acoustic field-based voice recognition system with an optical field-based hand gesture recognition system. By using a camera to capture images and analyzing hand motion trajectories, the system can recognize various gestures (click, drag, zoom, etc.), thereby expanding command input versatility while maintaining hands-free operation
3Adaptability or versatility
If hand gesture recognition is implemented, then mouse-like control is achieved, but device complexity increases due to image processing requirements
Solution Approach 1:
The patent extracts only the essential elements needed for hand gesture recognition: hand contour detection, key point identification (fingertips, joints), and trajectory analysis. By focusing on these extracted features rather than processing entire images, the system achieves mouse-like control capability while minimizing the complexity of the image processing requirements
Data Source
AI summary
Provided is a method of performing an input operation through motion recognition in a glasses-type display device, which is capable of controlling the glasses-type display device through the most natural and intuitive hand motion. The method of performing the input operation through motion recognition in the glasses-type display device includes: an image acquiring operation of acquiring sequential images by using a camera mounted on the glasses-type display device; a hand recognizing operation of recognizing a hand of a user from the acquired sequential images; a hand tracking operation of tracking the recognized hand; a hand motion recognizing operation of recognizing a motion of the hand based on a position of the hand acquired in the hand tracking operation; and a control signal outputting operation of outputting a control signal corresponding to the motion of the hand. When the hand is recognized in the hand recognizing operation, the position of the hand is displayed on a screen of the glasses-type display device.