Gesture-Controlled Display Training Mode for User Readiness
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing touchless gesture-controlled systems lack usability and awareness, as users often do not understand they can interact with the system via gestures, leading to misinterpretation and ineffective use, especially in public environments where training materials are not feasible.
Innovation Solution
A touchless gesture-controlled display system that uses a virtual user representation (avatar) whose size changes with distance and moves in sync with the user, accompanied by visual indicators and training modes to guide users to the interaction point, mirroring their movements and providing feedback to enhance user awareness and interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If touch-based systems are used, then users can interact with the display intuitively, but users must stand close to the display and step back and forth to see content properly
Solution Approach 1:
The patent replaces the mechanical touch-based interaction system with a gesture-controlled system that detects hand movements in the air. The gesture sensor captures hand gestures without physical contact, allowing users to interact from a distance of 1 to 2.5 meters while maintaining intuitive control through familiar hand motions.
2Ease of operation
If touch screens are used, then interaction is direct and intuitive, but the screens get dirty quickly and require cleaning
Solution Approach 1:
The patent eliminates the physical touch screen surface by using gesture sensing technology. Users interact through air gestures detected by the gesture sensor, completely removing the touch surface that accumulates dirt and fingerprints, thereby solving the cleaning requirement while preserving direct interaction capability.
3Ease of operation
If touch-based systems are used, then users can interact with the display, but people are concerned about hygiene because unknown users touch the screen
Solution Approach 1:
The patent replaces the physical touch interface with contactless gesture recognition. Users interact through hand gestures in the air space, completely avoiding contact with the display surface. This eliminates hygiene contamination concerns while maintaining full interactivity, as the gesture sensor accurately detects and responds to hand movements without physical touch.
4Length of moving object
If touchless gesture-controlled systems are used, then users can interact from a distance, but users often do not understand they can interact via gestures and may tap on the glass instead
Solution Approach 1:
The patent implements a training mode that activates before the main application, presenting users with visual examples of acceptable gestures and the corresponding responses. This preliminary instruction phase ensures users understand the gesture control mechanism before interacting with the main content, preventing mistaken taps on the display glass.
Solution Approach 2:
The system provides immediate visual feedback when gestures are detected, showing the corresponding action on the display. This feedback loop helps users understand that gesture control is functional, reinforcing correct usage and preventing incorrect taps by demonstrating the system's responsive behavior.
5Measurement precision
If gesture-controlled systems are used in professional environments, then interaction is precise, but no training approach is offered because users are expected to be experienced
Solution Approach 1:
The patent introduces a training mode as a preliminary action that provides gesture examples and instructions before the main application starts. This allows first-time users to learn the expected gestures without affecting the precision of gesture recognition during actual use, thereby maintaining high measurement accuracy while increasing adaptability to users of all experience levels.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The present invention generally relates to gesture-controlling systems as well as methods and computer programs for operating such systems. In order to provide a gesture-controlled system with an improved man-machine interface which allows users to efficiently control and provide inputs to the system, a touchless gesture-controlled display system is provided. The system comprises a display (2) for simultaneously displaying a plurality of virtual user representations (3) each corresponding to a user (5) located nearby the display (2). The system is configured for entering a training mode when one of the plurality of users (5) is detected at a position from where the system can be controlled by the user (5).