Adaptive Virtual Screen Sizing for Gesture Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current computing and gaming systems lack the ability to adapt to the unique physical characteristics and motion ranges of individual users, leading to inefficiencies in gesture-based control systems, where users of varying sizes and physical abilities face challenges in interacting with virtual screens effectively.
Innovation Solution
The system uses depth and size information from capture devices to dynamically adapt virtual screens to users, resizing and repositioning them to match the user's wingspan and motion range, and adjusts responsiveness and visual elements based on user profiles and gestures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the system uses a fixed virtual screen size for all users, then the system is simple to implement, but users of different sizes and abilities cannot interact effectively
Solution Approach 1:
The virtual screen size and position are made dynamic, automatically adjusting based on real-time detection of user physical characteristics such as height, arm length, and wingspan. The system transitions from a static fixed-size interface to a dynamic adaptive interface that responds to user dimensions.
Solution Approach 2:
The system changes key parameters of the virtual screen including size, position, and scale according to detected user characteristics. By modifying these parameters dynamically, the interface adapts to different user physical dimensions without requiring manual configuration.
2Ease of operation
If users stand further away from the system to accommodate large wingspan, then the virtual screen can cover the full reach, but the sensing mechanism cannot detect fine motions
Solution Approach 1:
The system dynamically adjusts the virtual screen position and size based on the user's actual distance from the sensing mechanism and detected arm reach. This allows the screen to remain optimally positioned for interaction while accommodating varying user distances from the sensor array.
Solution Approach 2:
The system continuously monitors user position and gesture data, using this feedback to real-time adjustments of the virtual screen parameters. This feedback loop ensures the interface remains optimized for both accessibility and detection precision under varying conditions.
3Area of stationary object
If the system requires users to reach all four corners of the display, then the virtual screen covers the full display area, but users with limited mobility cannot interact effectively
Solution Approach 1:
The virtual screen is divided into functional zones with different interaction characteristics. Users can interact with different portions of the screen using gestures appropriate to their physical capabilities, with the system interpreting gestures relative to the user's position and range of motion rather than requiring uniform interaction across the entire screen.
Solution Approach 2:
The virtual screen dynamically repositions and resizes based on detected user characteristics such as arm length, reach capability, and body dimensions. This ensures the interactive area remains within the user's physical reach while maintaining comprehensive coverage of the display when appropriate.
Data Source
AI summary
Disclosed herein are systems and methods for controlling a computing environment with one or more gestures by sizing a virtual screen centered on a user, and by adapting the response of the computing environment to gestures made by a user and modes of use exhibited by a user. The virtual screen may be sized using depth, aspects of the user such as height and/or user profile information such as age and ability. Modes of use by a user may also be considered in determining the size of the virtual screen and the control of the system, the modes being based on profile information and/or information from a capture device.