VR Controller Posture Estimation for Immersive HMD Gaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users of VR games with HMDs face inconvenience in holding game controllers due to the inability to visually check the asymmetric shape of the controller, leading to inefficient adjustments.
Innovation Solution
A controller device equipped with a control unit that includes operation receiving means, posture estimating means, and operation information generating means, allowing the device to estimate its posture and generate information representing the contents of user operations, regardless of how the controller is held.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If users wear HMD in VR games to improve immersion, then the sense of immersion is improved, but users cannot see their hands and the controller direction
Solution Approach 1:
The patent creates a virtual copy of the controller and hands in the HMD display that mirrors the real-world controller position and orientation. This virtual representation allows users to see and verify their controller direction without removing the HMD, thus maintaining immersion while solving the visibility problem.
2Duration of action of moving object
If users adjust controller direction in blind manner, then users can continue playing VR games, but the operation efficiency and accuracy deteriorate
Solution Approach 1:
The system provides real-time visual feedback by displaying the virtual controller and hand positions in the HMD. This feedback loop allows users to immediately verify their controller orientation and make precise adjustments, dramatically improving adjustment efficiency compared to blind adjustment.
3Ease of operation
If controller device has asymmetric shape for better ergonomics, then the ergonomic performance is improved, but the ability to visually identify direction when held in blind manner deteriorates
Solution Approach 1:
The virtual copy displayed in the HMD preserves all visual information about the asymmetric controller shape and orientation. This allows users to maintain the ergonomic asymmetric design while compensating for the loss of visual feedback through the virtual representation.
Data Source
AI summary
Provided is a controller device including a controller main body and a control unit, in which the control unit receives an operation performed by a user on the controller main body, estimates a posture of the controller main body, and generates information representing the contents of the received operation and outputs the information, by using the estimation result.