Merging Local 3D Maps for AR Location Accuracy
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality systems face challenges in accurately determining a player's location in the real world due to the inaccuracy of traditional positioning devices, which hinders the creation of a unified 3D map for overlaying virtual elements onto real-world environments.
Innovation Solution
A system that connects multiple client devices via a network to generate and link 3D maps based on image data and location information, using common features and synchronization data to create a singular 3D map, allowing for accurate determination of device locations and consistent virtual world representation across devices.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional positioning devices are used to determine player location, then the system is simple to operate, but the measurement precision is insufficient leading to large location error
Solution Approach 1:
The patent divides the mapping task into segments by having each client device generate its own local 3D map independently, then these local maps are merged server-side into a global map. This segmentation allows each device to use simple positioning while achieving high overall precision through collaborative mapping.
Solution Approach 2:
The patent merges multiple local 3D maps generated by different client devices into a single unified global 3D map. This combining process leverages the strengths of multiple devices to achieve higher location determination accuracy than any single device could provide alone.
2Area of stationary object
If multiple local maps are generated from different client devices, then the coverage area is expanded, but the maps have different coordinate spaces making them difficult to integrate
Solution Approach 1:
The patent introduces a server as an intermediary that receives local maps from multiple client devices, performs coordinate space transformations to align them to a common reference frame, and merges them into a unified global map. This intermediary handles the complexity of coordinate transformations centrally.
Solution Approach 2:
The patent transforms 2D images captured by cameras into 3D maps with depth information, adding a spatial dimension. This dimensional transformation enables the system to represent the environment in three-dimensional space, facilitating accurate integration of maps from multiple devices with different viewing angles.
3Speed
If 3D maps are generated in real-time from image data, then the virtual world overlay is updated continuously, but the processing time and computational resources increase
Solution Approach 1:
The patent segments the mapping computation by performing 3D map generation on client devices using their local camera data, then transmitting only the essential map information to the server for merging. This segmentation distributes computational workload and reduces the processing burden on any single system.
Solution Approach 2:
The patent performs preliminary actions by pre-processing and generating local 3D maps on client devices before they are transmitted to the server. This preliminary computation allows the server to focus only on merging and integration tasks, improving overall system efficiency.
Data Source
AI summary
An augmented reality system generates computer-mediated reality on a client device. The client device has sensors including a camera configured to capture image data of an environment. The augmented reality system generates a first 3D map of the environment around the client device based on captured image data. The server receives image data captured from a second client device in the environment and generates a second 3D map of the environment. The server links the first and second 3D together in a singular 3D map. The singular 3D map may be a graphical representation of the real world using nodes that represent 3D maps generated by image data captured at client devices and edges that represent transformations between the nodes.