AR Controller Perspective-Based Virtual Object Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current gaming and control systems using stationary displays lack the immersive experience and realism provided by augmented reality, particularly in terms of user interaction and feedback, as they do not allow for natural user input and perspective-based control of virtual objects.
Innovation Solution
A method and system for controlling virtual objects in a near-eye, augmented reality display using a real controller device, where user input is captured via natural user interfaces, and the action is applied based on the user's perspective, which changes with head or body movements, incorporating force feedback mechanisms for enhanced realism.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If a stationary display is used for gaming and control, then the system is simple and easy to operate, but the immersive experience and realism are insufficient
Solution Approach 1:
The patent transitions from traditional 2D stationary displays to 3D augmented reality space, allowing virtual objects to exist and interact in three-dimensional space. This dimensional expansion enables users to experience games and applications from multiple perspectives, significantly enhancing immersion and realism while maintaining controller-based interaction simplicity
2Ease of operation
If traditional controller input is used, then the control method is simple, but the user interaction lacks naturalness and perspective-based control
Solution Approach 1:
The patent makes the controller device perspective-aware, allowing it to adapt its functionality based on the user's spatial orientation and position. The same controller inputs can produce different actions depending on the user's perspective, enabling natural interaction while maintaining the simplicity of controller operation. This multi-functional capability allows the controller to serve both as a simple input device and as a perspective-sensitive interaction tool
3Adaptability or versatility
If force feedback mechanism is added to enhance realism, then the user experience is improved, but the device complexity increases
Solution Approach 1:
The patent implements force feedback mechanisms that provide tactile resistance and vibration to the controller, giving users physical sensation when interacting with virtual objects. This feedback loop enhances realism by allowing users to 'feel' virtual object properties and collisions, significantly improving user experience while the feedback is generated through software-controlled actuators rather than complex mechanical structures
Data Source
AI summary
Technology is described for controlling a virtual object displayed by a near-eye, augmented reality display with a real controller device. User input data is received from a real controller device requesting an action to be performed by the virtual object. A user perspective of the virtual object being displayed by the near-eye, augmented reality display is determined. The user input data requesting the action to be performed by the virtual object is applied based on the user perspective, and the action is displayed from the user perspective. The virtual object to be controlled by the real controller device may be identified based on user input data which may be from a natural user interface (NUI). A user selected force feedback object may also be identified, and the identification may also be based on NUI input data.