Remote AR Presentation With 3D Graphics Beyond Screen Boundaries
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality systems struggle to provide personalized and accurate graphics to individual viewers at live events, especially in environments with organic, non-2-D shapes and changing conditions, such as sports venues, due to difficulties in identifying distinctive features and maintaining precise viewer positioning and orientation.
Innovation Solution
A system that uses specific feature detection and iterative refinement to establish a correspondence between a viewer's device coordinates and the real-world coordinates, employing techniques like photogrammetry, fiducials, and structure from motion to create a spatially-organized database for accurate AR content overlay.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If 3D graphics are displayed within the boundaries of a remote device's display screen, then the remote device can display the 3D graphics, but the full 3D graphics cannot be seen by the user due to screen boundaries
Solution Approach 1:
The patent extends the 3D graphics beyond the traditional 2D display boundaries by utilizing depth information and spatial positioning. The system renders 3D objects and environments that protrude into the virtual space beyond the physical screen edges, allowing users to perceive and interact with content that would otherwise be truncated by display boundaries.
Solution Approach 2:
The patent implements a layered rendering approach where 3D graphics are nested within multiple spatial zones. The display screen serves as an inner boundary, while virtual extensions occupy outer spatial regions. This nested structure allows the full 3D content to be preserved while accommodating the physical constraints of the display device.
2Ease of operation
If the system processes and renders 3D graphics in real-time, then the user can interact with the graphics, but the processing time and computational resources increase
Solution Approach 1:
The patent implements preliminary processing of 3D graphics by pre-rendering models, textures, and environmental data before the user interacts with the content. The system prepares geometric data, material properties, and spatial relationships in advance, so that when the user initiates interaction, the graphics can be displayed with minimal additional processing time.
Solution Approach 2:
The system incorporates feedback mechanisms that monitor user interaction and adjust the rendering process accordingly. When users interact with 3D graphics, the system receives feedback about their actions and dynamically adjusts processing priorities, optimization levels, and data loading strategies to maintain interactivity while managing computational resources efficiently.
3Adaptability or versatility
If the system displays remote content on a local device, then the user can access the content, but the local device's processing capabilities are insufficient for complex 3D graphics
Solution Approach 1:
The patent introduces a remote server or cloud-based processing system as an intermediary between the local display device and the complex 3D graphics. The server handles the computationally intensive tasks of rendering, while the local device focuses on display and user interaction. This intermediary architecture allows access to sophisticated 3D content without requiring the local device to possess high processing power.
Solution Approach 2:
The system creates and transmits copies of 3D graphic data to the local device for display. Instead of requiring the local device to generate complex 3D graphics from scratch, the system retrieves pre-processed or partially processed copies from remote sources, reducing the processing burden on the local device while maintaining content quality.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Augmented reality systems provide graphics over views from a mobile device for both in-venue and remote viewing of a sporting or other event. A server system can provide a transformation between the coordinate system of a mobile device (mobile phone, tablet computer, head mounted display) and a real world coordinate system. Requested graphics for the event are displayed over a view of an event. In a tabletop presentation, video of the event can be displayed with augmented reality graphics overlays at a remote location.