HMD Controller Positioning via Camera Overlay
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users wearing head-mounted displays (HMDs) face difficulties in determining the position of a game controller, especially in non-see-through HMDs, as they cannot observe the external world, leading to challenges in finding and holding the controller.
Innovation Solution
A method and device that utilize a computer to receive images of the real space, calculate the virtual position of the controller within the HMD's display space, and display a guide on the HMD to indicate the controller's position, improving usability by providing visual assistance for the user to locate the controller.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If a non-see-through HMD is used to provide immersive visual experience, then the visual immersion is improved, but the user cannot observe the external world including the controller position
Solution Approach 1:
The patent introduces a camera as an intermediary device that captures images of the real world and transmits them to the HMD display. This mediator allows the user to see the external environment (including controller position) through the virtual reality interface without breaking the immersive experience. The camera acts as a bridge between the virtual and real worlds, solving the contradiction of maintaining visual immersion while preserving external visibility.
Solution Approach 2:
The patent overlays virtual reality images with real-world camera images in a composite display dimension. Instead of choosing between pure VR immersion or real-world visibility, the system creates a new dimensional space where both virtual and real images coexist. This dimensional integration allows users to perceive controller position information within the immersive VR environment without exiting the virtual space.
2Stability of the object's composition
If the user wears the HMD with both hands before holding the controller, then the HMD is securely positioned, but the user cannot visually locate the controller and must grope for it
Solution Approach 1:
The camera serves as a mediator that captures and transmits visual information about the controller's location to the user's HMD display. This intermediary system eliminates the need for physical groping by providing visual guidance through the virtual reality interface, allowing users to locate and grasp the controller efficiently while maintaining secure HMD positioning.
Solution Approach 2:
The system provides real-time visual feedback by displaying live camera images on the HMD that show the controller's position relative to the user's hands. This feedback loop allows users to adjust their hand positions based on visual information, creating an efficient closed-loop control system for controller acquisition without compromising HMD stability.
3Reliability
If the user moves the head to check the HMD state, then the user can verify proper wearing, but the user loses the sense of distance and direction to the controller
Solution Approach 1:
The camera acts as a stable reference intermediary that maintains consistent spatial information about the controller's position regardless of head movements. By displaying real-time camera images that show the controller's location in the external world, the system provides a stable spatial reference frame that compensates for head movements, preserving the user's sense of distance and direction to the controller.
Solution Approach 2:
The patent creates a composite display dimension that integrates real-world spatial information from the camera with virtual reality content. This additional dimensional layer provides stable spatial references that remain consistent during head movements, allowing users to verify HMD wearing while maintaining accurate perception of controller position and orientation.
Data Source
AI summary
The position and the posture of an HMD, and the position of a game controller in the real space are detected, and tracked. An image of a virtual space is displayed on the HMD. A controller object is disposed and displayed at a position within the virtual space that corresponds to the position of the game controller in the real space viewed from the HMD. Therefore, the player can easily find and hold the game controller even when the player wears the HMD.