AR VR Alignment Using Natural Position Understanding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional methods for aligning augmented reality (AR) or virtual reality (VR) worlds with the real world, such as plane detection and ray casting, are not intuitive and may not always result in accurate alignment, making it difficult for users to properly place virtual objects in virtual spaces.
Innovation Solution
The use of AR-enabled smartphones or 6 degree-of-freedom (6DoF) controllers with 3D development platforms and asset creation tools allows users to select an instantiation point for virtual assets in the real world, translating this position to the virtual space for accurate spawning and maintaining spatial orientation throughout the experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If plane detection and ray casting methods are used to align AR/VR world with real world, then alignment functionality is achieved, but user intuitiveness and placement accuracy deteriorate
Solution Approach 1:
The patent introduces an intermediary object (physical object detected by camera) that mediates between the user's natural pointing action and the virtual object placement. The user points at a physical object in the real world, the system detects this object via camera, and uses it as an intermediary to determine the placement position in virtual space, making the operation intuitive while maintaining accuracy
Solution Approach 2:
The patent replaces the conventional mechanical ray-casting method (requiring precise manual aiming) with a vision-based detection system. The camera captures images of physical objects, and image processing algorithms automatically determine spatial relationships, substituting manual mechanical alignment with automated visual recognition
2Productivity
If conventional ray casting method is used, then virtual object placement is achieved, but placement accuracy deteriorates due to imprecise ray casting
Solution Approach 1:
The system provides visual feedback by displaying the detected physical object and its spatial relationship to the user's device. This feedback loop allows the system to accurately determine placement positions based on objectively detected physical objects rather than subjective manual input, improving both efficiency and accuracy
Solution Approach 2:
The patent uses the physical object detected in the real world as a copy or reference model for determining virtual object placement. The spatial coordinates and orientation of the physical object are copied and used to establish the corresponding position in virtual space, ensuring accurate placement without manual ray casting
3Reliability
If manual ray casting is required for alignment, then alignment functionality is achieved, but ease of operation worsens due to non-intuitive shooting mechanism
Solution Approach 1:
The system performs self-service by automatically detecting physical objects and calculating placement positions without requiring manual ray casting operations from the user. The camera and processing system autonomously identify reference objects and determine spatial relationships, making the operation as intuitive as pointing the camera at an object
Data Source
AI summary
A method and system for selecting an instantiation point for a virtual asset relative to a physical space, the method including and system operable for: prompting a user to place a device at a desired position/alignment in the physical space; capturing the position/alignment with respect to a real world frame of reference; translating the position/alignment with respect to the real world frame of reference to a frame of reference in virtual space; and spawning the virtual asset in the virtual space at/with the translated position/alignment. The device includes one of a smartphone with a camera and a 6 degree-of-freedom controller.