Dynamic GUI Overlay for Natural User Interface Gesture Guidance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Natural user interfaces lack visual cues, leading to user disorientation and inefficiency when interacting with new or complex software programs, as they remove GUI elements to maximize viewing area but eliminate guiding features.
Innovation Solution
A computing system that displays GUI elements on a natural user interface only during specific gesture phases, using a gesture-recognizing module to detect registration, operation, and termination phases, and a gesture assist module to overlay visual or audio cues and selectors on the interface, ensuring user guidance without permanent GUI elements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If GUI elements are removed from the natural user interface, then the viewing area is increased and direct gesture input is enabled, but the user may become disoriented and unable to efficiently perform gesture input
Solution Approach 1:
The patent applies the dynamics principle by making the GUI element display state changeable based on gesture recognition. The system dynamically transitions between displaying and hiding the GUI element according to the detected gesture phase, allowing the interface to adapt its guidance level during interaction rather than maintaining a static state throughout.
Solution Approach 2:
The system implements self-service by automatically detecting the gesture phase through the gesture-recognizing module and autonomously deciding when to display or hide the GUI element. The system serves itself by monitoring its own operational state and adjusting the interface accordingly without requiring manual user control over the GUI element visibility.
2Ease of operation
If GUI elements are permanently displayed on the natural user interface, then user guidance is provided, but the viewing area is reduced and direct gesture input is limited
Solution Approach 1:
The patent applies periodic action by displaying the GUI element intermittently rather than continuously. The system periodically displays the GUI element during specific gesture phases (registration and operation phases) and hides it during other phases (termination phase and idle states), providing guidance only when necessary for the current interaction stage.
Solution Approach 2:
The system dynamically adjusts the visibility of the GUI element based on the current gesture phase detected by the gesture-recognizing module. The display state transitions from hidden to visible and back to hidden according to the operational requirements at different stages of gesture interaction, optimizing both guidance and viewing area at each moment.
3Loss of information
If visual cues are provided continuously, then user orientation is maintained, but the interface becomes cluttered and natural interaction is hindered
Solution Approach 1:
The system provides visual cues periodically rather than continuously, displaying the GUI element only during specific gesture phases when orientation assistance is most beneficial. This periodic display prevents interface clutter while maintaining user orientation at critical moments during the interaction sequence.
Solution Approach 2:
The patent extracts the GUI element from permanent display and presents it only when specifically needed during gesture interaction. The element is taken out of the continuous display state and introduced temporarily during registration and operation phases, then removed during termination phase, reducing overall interface clutter while providing necessary guidance.
Data Source
AI summary
A computing system for displaying a GUI element on a natural user interface is described herein. The computing system includes a display configured to display a natural user interface of a program executed on the computing system, and a gesture sensor configured to detect a gesture input directed at the natural user interface by a user. The computing system also includes a processor configured to execute a gesture-recognizing module for recognizing a registration phase, an operation phase, and a termination phase of the gesture input, and a gesture assist module configured to first display a GUI element overlaid upon the natural user interface in response to recognition of the registration phase. The GUI element includes a visual or audio operation cue to prompt the user to carry out the operation phase of the gesture input, and a selector manipulatable by the user via the operation phase of the gesture.