AR Waypoint Selection Using 3D Map Ray Casting
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality (AR) technologies limit interactions between virtual objects and real-world objects, with virtual objects often being static once placed, lacking dynamic movement and interaction with real-world environments.
Innovation Solution
A client device uses a 3D map of the real-world environment to position virtual content, enabling interactions by selecting real-world locations or objects with a controller, allowing virtual objects to move and interact realistically with the environment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If virtual objects are placed in the real-world environment using AR techniques, then the immersive experience is enhanced, but the virtual objects become static and lack interaction with real-world objects
Solution Approach 1:
The patent introduces an intermediary system consisting of a controller with ray casting technology and a 3D map of the real-world environment. This intermediary enables the selection and control of virtual objects without requiring complex direct manipulation interfaces, thus enhancing interaction capability while managing system complexity through a dedicated control device
Solution Approach 2:
The patent replaces traditional mechanical or manual control methods with ray casting technology. By using ray casting from the controller to select objects on the 3D map, the system substitutes complex mechanical interaction interfaces with a more intuitive and less complex optical/ray-based selection mechanism, enabling versatile virtual object control
2Measurement precision
If ray casting is performed to determine the selected object or location, then the selection precision is improved, but the computational complexity increases
Solution Approach 1:
The patent performs preliminary actions by pre-building and storing a 3D map of the real-world environment before the actual object selection process. This pre-processing step organizes spatial data in advance, allowing ray casting operations during interaction to be more efficient and precise without repeating complex environmental scanning and processing during real-time selection
Solution Approach 2:
The 3D map serves as an intermediary data structure between the real-world environment and the virtual object selection system. By mediating through this pre-processed spatial representation, the system achieves precise ray casting-based object selection while reducing computational complexity compared to performing real-time environmental analysis during each selection operation
Data Source
AI summary
A client device and a controller allow a user to control AR content by selecting real-world locations or objects. The client receives position data indicating a position and orientation of the controller, the position data defining an axis of the controller. The client device performs ray casting to determine a location in a 3D map of a real world that intersects the axis. The client device receives a selection indication (e.g., a user pressing a button on the controller). The client device selects, subsequent to the selection indication, the location in the 3D map that intersects the axis as a waypoint. The client device defines a route for a virtual object based on the waypoint.