Location-Based Immersive AR Content System
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current augmented reality systems have limitations in providing immersive and interactive experiences, as they often rely on linear storytelling and do not allow multiple users to simultaneously explore and interact with virtual content in real-time within a shared virtual world.
Innovation Solution
A system and method that utilize mobile devices with cameras and displays to capture and transmit location and orientation data to a server, which renders virtual content and overlays it onto the real-world environment, enabling multiple users to interact with location-specific virtual characters and objects in real-time, creating a persistent and immersive augmented reality experience.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple users simultaneously explore and interact with virtual content in real-time within a shared virtual world, then the immersive and interactive experience is enhanced, but the system complexity and computational resources required increase
Solution Approach 1:
The system divides the augmented reality experience into separate functional modules: GPS location tracking, camera image capture, virtual content rendering, and composite image generation. Each module operates independently but contributes to the overall immersive experience, allowing the system to handle multiple users without becoming unmanageably complex.
Solution Approach 2:
The mobile device serves multiple functions simultaneously: it acts as a GPS receiver for location tracking, a camera for capturing the physical environment, a display for showing the augmented reality composite, and a processing unit for integrating virtual and real-world elements. This multi-functionality reduces the need for separate specialized devices for each user.
2Ease of operation
If virtual content is rendered and overlaid in real-time based on user location and orientation data, then the interactivity and responsiveness of the augmented reality experience improve, but the processing time and computational load increase
Solution Approach 1:
The system pre-loads and prepares virtual content at designated locations before users arrive. When a user approaches a location, the corresponding virtual content is already rendered and ready for immediate overlay, eliminating delays associated with real-time generation and reducing processing time while maintaining interactivity.
3Adaptability or versatility
If location-specific virtual content reacts to user presence and interactions in real-time, then the immersive nature of the experience increases, but the measurement precision and tracking accuracy requirements increase
Solution Approach 1:
The system introduces intermediary reference elements in the physical environment that serve as mediators between the user's physical position and the virtual content. These intermediaries help translate physical location into accurate virtual positioning, enabling reactive virtual content while reducing the precision demands on direct GPS and orientation tracking.
Data Source
AI summary
A computer-implemented method comprising: capturing, with a mobile device comprising a camera and a display, a first image of a physical environment and first set of telemetry data corresponding with the first image, wherein the first set of telemetry data comprises GPS location data along with orientation data; transmitting, to a server system via a wireless communication channel, the first set of telemetry data; determining, with the server system, a precise location and orientation of the mobile device in the physical environment based on the first set of telemetry data received from the mobile device and on information accessed from multiple sources of data including one or more of a street map database, visual positioning system (VPS) data, and image anchors; rendering an image of virtual content based at least in part on the first set of telemetry data for the mobile device, wherein the rendered image of virtual content is over rendered such that it represents a larger area in the virtual world than the first image represents in the physical environment; transmitting the rendered image and the first set of telemetry data back to the mobile device via the wireless communication channel; capturing, with the mobile device, a second image and a second set of telemetry data, wherein the second set of telemetry data comprises gps location data along with orientation data; compositing, at the mobile device, a subset of the rendered image with the second image, wherein the subset of the rendered image is determined based changes between the first and second sets of telemetry data; and displaying the composited image on the display of the mobile device such that the virtual content appears in the physical environment.