Wearable Device Hand Gesture ROI Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing wearable electronic devices struggle to accurately identify a user's intention and deliver relevant information, as they rely solely on eye and/or gaze tracking, which may not accurately capture the user's actual intentions.
Innovation Solution
A method for operating a wearable electronic device that involves recognizing hand gestures to set and adjust a region of interest (ROI) within an image frame, allowing the device to project the ROI onto a virtual display, thereby enhancing user interaction and information delivery.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Extent of automation
If eye and/or gaze tracking is used to identify user intention, then the device can interact with the user, but the accuracy of identifying actual user intention deteriorates
Solution Approach 1:
The patent combines multiple sensing modalities (eye tracking, gaze tracking, and hand gesture recognition) into a unified interaction system. The hand gesture recognition module processes camera feed to detect gestures, while eye/gaze tracking continues to function, and both inputs are integrated to determine user intention, thereby improving accuracy while maintaining automation
Solution Approach 2:
The patent introduces hand gestures as an intermediary control mechanism between the user and the device. Instead of relying solely on passive eye tracking, the user actively performs gestures that are detected and translated into device commands, providing a more reliable indicator of user intention while preserving automated interaction capabilities
2Measurement precision
If hand gesture recognition is added to improve user intention identification, then identification accuracy improves, but device complexity increases
Solution Approach 1:
The patent makes the existing camera serve multiple functions: its primary function remains capturing images for display, and a secondary function is added for hand gesture recognition. By processing the same camera feed through different algorithms (one for display, one for gesture detection), the system achieves multi-functionality without adding dedicated sensing hardware, thus improving accuracy while limiting complexity increase
Solution Approach 2:
The system uses its own camera resource to perform gesture recognition, making the camera serve itself for dual purposes. The image processing pipeline is extended to simultaneously extract visual data for display and gesture features for control, allowing the device to improve its interaction capability using resources it already possesses
Data Source
AI summary
A method of operating a wearable electronic device includes: recognizing a first gesture of a hand of a user for setting a region of interest (ROI) corresponding to a view of the user in an image frame corresponding to a view of a camera; generating a virtual display for projecting the ROI based on whether the first gesture is recognized; extracting the ROI from the image frame; recognizing a second gesture of the hand for adjusting a size of the ROI; and adjusting the size of the ROI and projecting the ROI of the adjusted size onto the virtual display, based on whether the second gesture is recognized.