Gaze-Validated Display Operation Method for Gesture Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing gesture interaction technologies face errors in operation recognition due to the constant detection state of hand gestures during browsing or communication, leading to inaccurate operation execution on display screens.
Innovation Solution
A method and device that detect the gazing position of an operator's eyes and the operation position of their operating portion on a display screen, ensuring consistency between the two positions before executing an operation action, using position identifiers such as cameras and infrared transceivers to improve detection accuracy and prevent errors.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If gesture interaction technology continuously detects hand gestures during browsing or communication, then the system can respond to user operations, but errors in operation recognition occur due to constant detection state
Solution Approach 1:
The system performs preliminary detection of hand gestures and pre-judges whether they constitute valid operations before full execution. This two-stage approach (pre-detection + confirmation) allows the system to maintain constant readiness for user input while filtering out false positives, thereby improving both response speed and recognition accuracy simultaneously
2Speed
If the system executes operations based solely on detected hand gestures, then operation execution is quick, but inaccurate operations are executed leading to errors
Solution Approach 1:
The system implements a feedback mechanism where detected hand gestures are validated against predefined criteria before execution. The control unit receives detection results, judges whether they meet operation standards, and only executes confirmed valid operations. This feedback loop ensures quick execution of legitimate operations while blocking erroneous ones, resolving the contradiction between speed and accuracy
Data Source
AI summary
The present disclosure discloses a method for executing an operation action on a display screen and a device for executing an operation action. Firstly, a gazing position of an operator's eyes on the display screen and a corresponding operation position of the operator's operating portion on the display screen are determined, then a corresponding operation is executed for content displayed on the display screen according to the operation action of the operating portion, when it is determined that the gazing position of the operator's eyes on the display screen is consistent with the corresponding operation position of the operator's operating portion on the display screen. Therefore, the method needs to not only determine the corresponding operation position of the operator's operating portion on the display screen, but also determine the gazing position of the operator's eyes on the display screen, and the corresponding operation is executed for the content displayed on the display screen according to the operation action of the operating portion only when the two positions are consistent with each other.