HMD Controller Gesture Control for Virtual Character Movement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems fail to effectively provide movement instructions to objects in virtual spaces using gestures, particularly in head-mounted display environments, where characters within and outside the user's field of view require distinct movements based on controller inputs.
Innovation Solution
A method that detects controller movements to determine movement instructions, causing characters within the user's field of view to perform specific movements and those outside to perform different movements, utilizing a head-mounted display system with eye gaze and tracking sensors to differentiate and control character actions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a single movement instruction is given to all characters in the virtual space, then the control operation is simplified, but the movement precision and appropriateness for different characters deteriorates
Solution Approach 1:
The patent segments the character group into multiple subsets based on spatial relationships (characters in field-of-view region vs. characters outside field-of-view region). This allows different movement instructions to be applied to different segments, resolving the contradiction between simplified control and precise movement by enabling differentiated control without requiring complex individual character management.
Solution Approach 2:
The patent applies local quality by giving different movement instructions to different character segments based on their spatial characteristics. Characters within the field-of-view region receive one type of movement instruction while characters outside receive another, making the movement control appropriate for each local group's spatial context.
2Manufacturing precision
If multiple movement instructions are given to different characters, then the movement appropriateness for each character is improved, but the device complexity and control difficulty increases
Solution Approach 1:
The control system is simplified through segmentation by automatically dividing characters into distinct groups based on their spatial relationship to the user's field-of-view. This automatic segmentation eliminates the need for manual character-by-character control setup, reducing device complexity while still enabling differentiated movement instructions for different character groups.
Solution Approach 2:
The patent implements a universal control mechanism where a single controller can issue different types of movement instructions to different character segments based on their spatial characteristics. This multi-functional control approach allows one control device to handle multiple characters with different movement patterns, reducing overall system complexity.
3Adaptability or versatility
If gesture-based control is implemented in virtual space, then the user immersion and interaction intuitiveness are improved, but the measurement precision of controller movement deteriorates
Solution Approach 1:
The patent applies parameter changes by transforming the continuous controller movement data into discrete gesture categories (e.g., pointing gestures, throwing gestures). This discretization maintains measurement precision by identifying specific gesture patterns while enabling intuitive interaction through natural movement recognition, resolving the contradiction between gesture intuitiveness and measurement accuracy.
Data Source
AI summary
To give various movement instructions by body gestures to an object in a virtual space, a method includes detecting movements of controllers held by both hands of a user. The method further includes determining a first movement instruction based on the movements of the controllers. The method further includes causing a first character gazed at by the user to perform a first movement and causing a second character not gazed at by the user to perform a second movement depending on the first movement instruction. With this, instructions are given to the characters in the virtual space by means of body gestures.


