Virtual Input Interface Layout Using Hand Feature Point Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing VR software relies on traditional physical input elements, necessitating a shift to gesture tracking technology that requires user education and adaptation.
Innovation Solution
A method and system for configuring a virtual input interface using hand feature points, enabling gesture-based interactions by tracking hand gestures and rendering corresponding virtual input elements on a virtual interface.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If traditional physical handheld controller interfaces are used, then users can operate with familiar physical input elements, but the system cannot leverage the potential of gesture tracking technology
Solution Approach 1:
The patent creates a virtual copy of the physical controller interface in the VR environment. The virtual input interface replicates the layout and functionality of physical controllers, allowing users to interact with familiar button arrangements and control schemes through hand gestures, thus bridging the gap between physical familiarity and gesture-based operation
Solution Approach 2:
The virtual input interface serves as an intermediary between the user's physical hand gestures and the VR system's command recognition. By mapping hand positions and gestures to virtual controller elements, the system mediates the translation of natural gestures into meaningful input commands without requiring users to learn entirely new interaction paradigms
2Adaptability or versatility
If gesture tracking technology is implemented, then the system can enable new interaction methods, but users require education and guidance to master the new ways of interaction
Solution Approach 1:
The system pre-configures the virtual input interface with familiar controller layouts before the user begins interacting. By establishing the virtual interface structure in advance with recognizable button arrangements and control schemes, users can transition to gesture-based operation without needing extensive education or guidance on interface layout and interaction patterns
3Adaptability or versatility
If virtual input interface is configured based on hand feature points, then the interface can be customized to user anatomy, but the system complexity increases
Solution Approach 1:
The system adjusts parameters of the virtual input interface based on detected hand feature points, such as scaling the size of virtual buttons and controls to match the user's hand dimensions. By dynamically modifying interface parameters like button size, spacing, and positioning based on measured hand anatomy, the system achieves customization without requiring complex manual configuration procedures
Data Source
AI summary
The embodiments of the disclosure provide a method for providing an input interface, a host, and a computer readable storage medium. The method includes: tracking at least one feature point on a hand; and configuring a layout of at least one virtual input element on the virtual input interface based on the at least one feature point.


