Persistent 3D AR Attachment to Virtual Replicas for Accurate Tracking
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality (AR) applications are typically viewed individually, lack persistence, and do not account for the mapping of all geometries of the 3D world, leading to inaccurate tracking and user discomfort, and require resource-intensive downloads on client devices.
Innovation Solution
A system and method that enables persistent and accurate location-and-geometry based positioning of AR applications by attaching them to virtual replicas of real-world objects, allowing shared interactions and reducing the need for client-side downloads through server-side rendering and real-time tracking.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If AR applications are attached to markers or locations with individual viewing, then implementation is simpler, but tracking accuracy and user comfort deteriorate
Solution Approach 1:
The patent creates virtual replicas of real-world objects that serve as persistent attachment points for AR applications. These virtual replicas are detailed 3D models stored on servers that accurately represent the geometry and spatial properties of physical objects, enabling precise tracking without relying on simple markers.
Solution Approach 2:
The system transitions from 2D marker-based or location-based AR to 3D geometry-based AR by attaching applications to virtual replicas with full spatial characteristics. This dimensional enhancement allows for more accurate tracking of user position and orientation relative to the AR content.
2Ease of operation
If AR applications are downloaded to client devices, then offline access is enabled, but resource consumption and download time increase
Solution Approach 1:
The patent extracts the heavy computational and storage requirements from client devices and relocates them to remote servers. The server stores virtual replicas and renders AR content, while client devices only need to transmit lightweight position and orientation data, eliminating the need for downloading large application packages.
Solution Approach 2:
The system replaces the mechanical approach of downloading and storing applications locally with a network-based streaming approach. AR content is rendered remotely and transmitted as media streams, substituting local processing with remote processing and network transmission.
3Adaptability or versatility
If AR applications are viewed individually based on viewing position, then user-specific customization is achieved, but shared experiences and persistence are lost
Solution Approach 1:
The patent creates virtual replicas that serve multiple functions simultaneously: they are persistent attachment points for AR applications, they enable user-specific viewing customization based on position and orientation, and they facilitate shared experiences by providing a common reference frame for multiple users. The virtual replicas are accessible to all users while maintaining individual viewing perspectives.
Data Source
Figure 1A~1B
Figure 2A~2B
Figure 3A~3B
AI summary
A system and method for attaching digital reality applications and interactions to static objects are disclosed. The system comprises a server configured to store and process input data, the server comprising a memory and a processor; and a plurality of client devices connected to the server via a network configured enable interaction with digital reality applications. The memory contains a database with structured data containing a persistent virtual world system storing virtual replicas of static objects. The virtual replicas are configured based on the static objects, comprising location and space, physics, and 3D structure. The system enables application developers to attach digital reality applications on the virtual replicas. When users employing client devices approach a digital reality application, the digital reality application detects the physical position and orientation of the client device, triggering the server to share digital reality application content with the client devices.