Pinch Gesture Recognition via Pixel Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current gesture recognition technologies, particularly for Virtual Reality (VR) and Augmented Reality (AR) devices, face challenges in accurately recognizing the pinch gesture due to differences in distance and position, leading to inconsistent gesture recognition across long-range and short-range lenses.
Innovation Solution
A gesture recognition method and system that utilizes an image capturing device to sense gestures, performs binarization to distinguish foreground and background pixels, and determines if foreground pixels surround a background pixel to identify the pinch gesture, enabling accurate operation of electronic devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If gesture recognition is performed using long-range or short-range lenses, then gesture recognition capability is provided, but recognition accuracy varies due to differences in distance and position
Solution Approach 1:
The patent changes the parameter of pixel value interpretation by introducing binarization to distinguish foreground and background pixels. This transformation allows the system to recognize gestures based on spatial relationships between pixels rather than absolute positions, making the recognition accurate across different distances and device types.
2Ease of operation
If specific gestures are assigned to represent specific effects, then operation convenience is improved, but gesture recognition reliability is insufficient
Solution Approach 1:
The patent segments the image into foreground pixels (representing the gesture) and background pixels (representing the environment). By analyzing the spatial relationship between these segmented pixel groups, the system can reliably detect whether a pinch gesture is being performed, significantly improving recognition reliability while maintaining ease of operation.
Data Source
AI summary
A gesture recognition method includes performing a binarization process on an image to obtain a binarized image, wherein the binarized image includes a plurality of foreground pixels and a plurality of background pixels; determining whether the plurality of foreground pixels surrounds at least a first background pixel; and determining a gesture complying with a predefined gesture in response to determination that the plurality of foreground pixels surrounds the at least a first background pixel.