Multi-User Interactive Display Gesture Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current human-computer interaction systems, particularly in multi-user settings, lack intuitive and efficient methods for controlling interactive displays using gestures, and fail to clearly communicate which user is in control, leading to confusion and inefficiency.
Innovation Solution
A method for a multi-user interactive display system that uses a digital image capture system to analyze time sequences of images, detect users, designate a controlling user, and update content in response to predefined gestures, while visually indicating the controlling user and priority order through graphical elements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple users interact with the display simultaneously using gestures, then user engagement and interactivity are improved, but system complexity and user confusion increase
Solution Approach 1:
The system segments user interactions by detecting individual users through depth camera imaging, assigning unique identifiers to each user, and managing separate gesture recognition streams for each user. This segmentation allows multiple users to interact simultaneously without creating a single complex control signal, thereby reducing overall system complexity while maintaining multi-user capability.
Solution Approach 2:
The system introduces a fiducial marker as an intermediary element that users must point to in order to initiate control. This fiducial acts as a mediator between the user's gesture and the system response, providing a clear reference point that disambiguates which user's gesture should trigger which action, thereby reducing user confusion in multi-user environments.
2Ease of operation
If gesture recognition is used for user control, then ease of operation is improved, but measurement precision and control accuracy deteriorate
Solution Approach 1:
The system provides visual feedback by displaying the detected user and their assigned fiducial marker on the display screen itself. This feedback loop allows users to confirm that the system has correctly identified them and is ready to interpret their gestures, thereby maintaining high measurement precision while preserving the ease of gesture-based operation.
Solution Approach 2:
The system performs preliminary action by requiring users to first point to and establish control over a fiducial marker before gesture recognition begins. This preliminary step primes the system to accurately track subsequent gestures, improving measurement precision while keeping the overall interaction intuitive and easy to perform.
3Loss of information
If the system displays all detected users equally, then completeness of information is improved, but ease of operation deteriorates due to lack of control clarity
Solution Approach 1:
The system applies local quality by differentiating the visual representation of users based on their control status. The active controlling user is displayed with enhanced visual characteristics (such as different color or highlighting) compared to other detected users. This differentiation maintains complete user detection information while making it immediately obvious which user currently holds control, thereby improving ease of operation.
Data Source
AI summary
A method for controlling a multi-user interactive display system including a soft-copy display including at least an information display region and a command control region, and a digital image capture system positioned to capture a time sequence of images of users located in a field-of-view of the soft-copy display. A time sequence of images is analyzed to detect a plurality of users, and at least one of the users is designated to be a controlling user. The captured images are displayed in the command control region, wherein the detected users are demarked using graphical elements. The captured time sequence of images is analyzed to detect a gesture made by the controlling user and content displayed in the information display region is updated accordingly.