Eyewear Gesture Control Using Finger Orientation for AR Navigation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing smart glasses systems lack an intuitive interface for navigating virtual content, leading to a steep learning curve and inefficient resource usage, which limits user appeal and battery life.
Innovation Solution
The system enables users to navigate virtual content using intuitive hand gestures detected by a camera, translating finger movements into control commands for virtual objects, reducing processing and battery demands.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If contact-based control (buttons, switches) is used on eyewear devices, then device control functionality is achieved, but user comfort and safety deteriorate due to additional components and hygiene concerns
Solution Approach 1:
The patent removes traditional contact-based control components (buttons, switches, dials) from the eyewear device structure. Instead, it extracts the control function and implements it through gesture recognition using the existing camera and processor, thereby eliminating the need for additional physical controls while maintaining device control functionality
Solution Approach 2:
The patent replaces the mechanical control system (physical buttons and switches) with an optical recognition system. The camera captures hand gesture images, and the processor analyzes these images to determine control commands, substituting mechanical interaction with optical and computational methods
2Adaptability or versatility
If more control components are added to eyewear devices, then device control capability is improved, but user comfort and wearability deteriorate
Solution Approach 1:
The patent makes the existing camera and processor serve multiple functions: they continue to perform their primary functions (image capture and processing) while also being used for gesture recognition and control command generation. This multi-functionality expands control capability without adding dedicated control components that would increase weight
3Ease of operation
If traditional control interfaces are used on eyewear, then device control is achieved, but hygiene and safety deteriorate due to contact requirements
Solution Approach 1:
The patent replaces contact-based mechanical control with non-contact optical gesture recognition. The camera captures hand gestures in the air space near the eyewear, and the processor translates these gestures into control commands, eliminating the need for physical contact between the user and the device, thereby addressing hygiene concerns
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Systems and methods are provided for performing operations comprising: displaying one or more virtual objects on an eyewear device; detecting, by a camera of the eyewear device, a hand within view of the eyewear device; determining that a first finger of the hand is oriented along a same direction as the one or more virtual objects that are displayed; detecting movement of a second finger of the hand relative to the first finger; and controlling the display of the one or more virtual objects in response to detecting movement of the second finger to the first finger.