Cloud-Assisted Local 3D Mapping with Server Aggregation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality systems struggle to efficiently generate and update three-dimensional maps on client devices, leading to suboptimal user experiences due to limited processing power and storage capacity, especially in real-time environments.
Innovation Solution
A system that generates 3-D maps on client devices using camera and GPS data, aggregates local maps to create global maps on a server, and utilizes neural networks for object detection and geometry estimation, enabling efficient map updates and object recognition.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If 3-D map data is generated and stored locally on client devices, then real-time augmented reality processing is improved, but device storage capacity and processing power are exceeded
Solution Approach 1:
The patent divides the mapping system into two segments: local map data stored on client devices for immediate real-time processing, and global map data stored on remote servers for comprehensive coverage. This segmentation allows the system to achieve real-time performance while distributing storage requirements across multiple locations.
Solution Approach 2:
The patent introduces a server as an intermediary between client devices and global map data. The server acts as a mediator that stores large-scale global maps and provides relevant portions to client devices, enabling real-time local processing without requiring clients to store all map data locally.
2Measurement precision
If high-resolution 3-D maps are generated on client devices, then map detail and accuracy are improved, but device processing power and energy consumption are exceeded
Solution Approach 1:
The patent performs preliminary processing of map data on remote servers before transmission to client devices. Global maps are pre-generated and stored in optimized formats, reducing the computational burden on client devices and enabling high-resolution display without excessive energy consumption.
Solution Approach 2:
The patent creates simplified copies of global map data for local storage on client devices. These copies contain only the necessary high-resolution details for the current view, while the full-resolution global maps remain on servers, reducing local processing requirements while maintaining display quality.
3Reliability
If local maps are continuously updated in real-time, then map currentness is improved, but network bandwidth and server load are exceeded
Solution Approach 1:
The patent implements periodic updates of local map data from global maps at optimized intervals, rather than continuous real-time synchronization. This approach maintains map currentness while reducing network bandwidth consumption and server processing load compared to continuous updates.
Solution Approach 2:
The patent updates only the specific portions of local maps that have changed or are relevant to the user's current location, rather than continuously updating entire maps. This selective update approach maintains map currentness while significantly reducing network and server requirements.
Data Source
AI summary
An augmented reality system generates computer-mediated reality on a client device. The client device has sensors including a camera configured to capture image data of an environment and a location sensor to capture location data describing a geolocation of the client device. The client device creates a three-dimensional (3-D) map with the image data and the location data for use in generating virtual objects to augment reality. The client device transmits the created 3-D map to an external server that may utilize the 3-D map to update a world map stored on the external server. The external server sends a local portion of the world map to the client device. The client device determines a distance between the client device and a mapping point to generate a computer-mediated reality image at the mapping point to be displayed on the client device.