Adaptive GUI Layout for Hand-Pointing Interaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing interactive display apparatuses do not optimize the placement of graphical user interface (GUI) items based on the hand used by the user for pointing operations, leading to suboptimal operability.
Innovation Solution
A display method and apparatus that detect the pointing element, such as a right or left hand, and adjust the placement of item images in the operation image accordingly, ensuring that frequently used items are positioned for easy access and visibility.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If the same GUI is displayed regardless of which hand is used for pointing, then the display system maintains simplicity and consistency, but the operability of the GUI deteriorates because frequently used items may be hidden by the pointing hand
Solution Approach 1:
The patent applies dynamics by making the GUI layout adaptive and changeable based on real-time detection of which hand is being used for pointing. The system dynamically switches between a first layout (when right hand is detected) and a second layout (when left hand is detected), allowing the GUI to optimize its configuration according to the user's actual interaction mode, thereby improving operability without requiring multiple fixed display systems
Solution Approach 2:
The patent changes the layout parameter of the GUI based on the detected pointing hand. When the right hand is detected as the pointing element, the system applies a first layout configuration; when the left hand is detected, it applies a second layout configuration. This parameter change approach allows the same display system to adapt to different usage scenarios, improving ease of operation while maintaining system simplicity
2Productivity
If the GUI layout is fixed, then the display system maintains consistency and simplicity, but user interaction efficiency deteriorates because items may be hidden by the pointing hand
Solution Approach 1:
The system uses dynamic layout adjustment based on hand detection to improve user interaction efficiency. By detecting which hand is used for pointing and automatically switching between different layouts, the system ensures that frequently used items remain visible and accessible, thereby enhancing productivity without requiring complex manual reconfiguration
Solution Approach 2:
The patent implements feedback by detecting the user's pointing hand and using this information to automatically adjust the GUI layout. The detection section identifies which hand is being used, and the display control section responds by selecting the appropriate layout, creating a closed-loop system that continuously optimizes user interaction efficiency based on actual usage patterns
Data Source
AI summary
A display method including detecting a pointing element, and displaying an operation image containing a plurality of item images. When the pointing element includes the right hand, the plurality of item images are placed in the operation image based on a first aspect, and when the pointing element includes the left hand, the plurality of item images are placed in the operation image based on a second aspect.