Wearable Device Finger Gesture Recognition via Camera
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Wearable electronic devices face challenges in executing functions accurately due to difficulties in recognizing depth motions and potential user discomfort, especially in virtual reality or augmented reality environments, where long-term arm movements can cause physical strain.
Innovation Solution
A wearable electronic device equipped with a display, camera, and processor that identifies specific finger gestures to execute corresponding functions, allowing for quick and convenient control without requiring extensive motions, regardless of peripheral situations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If depth motions are used for controlling functions in virtual reality or augmented reality environments, then the user can perform actions with natural hand movements, but it becomes difficult to clearly recognize the perception of distance to the virtual object and may cause physical pain when performed for a long time
Solution Approach 1:
The patent introduces a camera as an intermediary device to capture hand gestures and convert them into controllable inputs for virtual reality or augmented reality applications. This mediator translates natural hand movements into precise digital commands, maintaining both natural operation and accurate distance perception.
Solution Approach 2:
The patent replaces the mechanical system of direct hand-to-object interaction with an optical system using a camera to detect hand gestures. This substitution allows for accurate distance measurement through image processing while maintaining natural hand movements, eliminating the physical strain associated with prolonged mechanical interactions.
2Adaptability or versatility
If the entire arm is used for actions in virtual reality or augmented reality environments, then the user can perform comprehensive movements, but physical pain may be inflicted when performed for a long time
Solution Approach 1:
The patent extracts the essential motion information from the entire arm by focusing only on hand gesture detection. This extraction allows for comprehensive movement control while eliminating the need for prolonged arm movements that cause physical pain, as only the hand needs to perform small, comfortable gestures.
Solution Approach 2:
The patent uses partial action by detecting only hand gestures rather than requiring full arm movements. This partial detection provides sufficient control versatility for virtual reality or augmented reality applications while significantly reducing the physical strain on the user's entire arm during prolonged use.
3Ease of operation
If motion recognition is used for controlling functions, then the user can perform actions without contact, but it becomes difficult to recognize depth motions accurately
Solution Approach 1:
The patent transitions from three-dimensional depth motion recognition to two-dimensional gesture recognition in the camera's image plane. This dimensional change simplifies the recognition process while maintaining contactless operation, as the camera naturally captures two-dimensional spatial information that can be processed more accurately than depth information.
Data Source
AI summary
A wearable electronic device may include a display, a camera, and a processor, wherein the processor is configured to, based on execution of a first application, control the display to display at least one first object corresponding to at least one first function of the first application at a position corresponding to at least one finger of a user wearing the wearable electronic device, based on identifying that a prespecified finger is in contact with a specific finger among the at least one finger by using the camera while the first application is executed, execute a first specific function corresponding to the specific finger among the at least one first function, based on execution of a second application, control the display to display at least one second object corresponding to at least one second function of the second application at the position corresponding to the at least one finger, and based on identifying that the prespecified finger is in contact with the specific finger by using the camera while the second application is executed, execute a second specific function corresponding to the specific finger among the at least one second function.