Tracked Physical Proxy for Virtual Object Manipulation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users lack a means to directly interact with virtual objects in computer-generated reality (CGR) environments, limiting their integration and immersion.
Innovation Solution
A method and system that utilize a tracked physical object, represented as a proxy device, to manipulate virtual objects in a CGR environment by creating a fixed alignment between the physical object and its virtual representation, allowing physical movements to translate into virtual object movements within a 3-D coordinate space.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a tracked physical object is used to manipulate virtual objects, then direct manipulation capability is improved, but device complexity increases
Solution Approach 1:
A proxy device is introduced as an intermediary between the physical environment and the virtual environment. The proxy device includes a tracker that captures physical movements and a controller that translates these movements into corresponding virtual object manipulations, enabling direct manipulation without requiring complex direct integration between physical objects and virtual objects
Solution Approach 2:
The system creates a virtual representation (copy) of the physical proxy device in the virtual environment. This virtual proxy device mirrors the physical device's position and orientation, allowing the user to manipulate virtual objects through the copied representation while maintaining a simple physical interface
2Measurement precision
If a fixed alignment is created between virtual object and virtual representation, then manipulation precision is improved, but system complexity increases
Solution Approach 1:
The system pre-establishes a fixed alignment relationship between the virtual object and the virtual representation of the proxy device. This alignment is configured in advance through reference frames and transformation matrices, so that when the user performs manipulations, the precise mapping is already in place without requiring real-time complex calculations
Solution Approach 2:
The system operates in a three-dimensional coordinate space with defined reference frames for both the proxy device and the virtual object. By establishing transformations between these dimensional spaces, the system achieves precise manipulation mapping while maintaining manageable system complexity through structured spatial relationships
Data Source
AI summary
In one implementation, a method of manipulating virtual objects using tracked physical objects is disclosed. The method involves presenting content including a virtual object and a virtual representation of a proxy device physically unassociated with an electronic device on a display of the electronic device. Input is received from the proxy device using an input device of the proxy device that represents a request to create a fixed alignment between the virtual object and the virtual representation in a three-dimensional (“3-D”) coordinate space defined for the content. The fixed alignment is created in response to receiving the input. A position and an orientation of the virtual object in the 3-D coordinate space is dynamically updated using position data that defines movement of the proxy device in the physical environment.