Spatially Aware Media for Remote AR Positioning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional augmented reality (AR) experiences require users to be physically present in a real-world space to augment it with virtual content, can only be viewed from one perspective at a time, and often need reinitialization upon termination.
Innovation Solution
Generating and storing 'spatially aware media' that includes visual, audio, and haptic content corresponding to a real-world space, allowing virtual content to be overlaid onto images of the space from multiple perspectives without the need for physical presence or reinitialization, using 3D spatial features for accurate positioning of virtual objects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional AR experiences are used, then virtual content can be overlaid on real-world space, but users must be physically present in that space
Solution Approach 1:
The patent creates a digital twin or copy of the real-world space by capturing images and identifying 3D spatial features to generate spatially aware media. This copy can be viewed and interacted with remotely without requiring physical presence in the original space, thus enabling remote viewing capability while maintaining the AR overlay functionality.
Solution Approach 2:
The patent transitions from a single physical perspective to multiple virtual perspectives by rendering the 3D models from different camera viewpoints within the captured spatial environment. This allows users to view the augmented space from multiple angles simultaneously, adding a dimensional aspect that overcomes the physical presence limitation.
2Ease of operation
If conventional AR experiences are used, then virtual content can be displayed, but only from one perspective at a time
Solution Approach 1:
The patent enables multi-perspective viewing by capturing multiple camera images from different positions within the real-world space and rendering 3D models from corresponding viewpoints. Users can switch between or view multiple perspectives simultaneously, transforming a single-view AR experience into a multi-dimensional viewing experience.
Solution Approach 2:
The spatially aware media structure is designed to support multiple camera viewpoints and rendering perspectives within a single augmented reality environment. This universal framework allows the same spatial data to be viewed from multiple angles without requiring separate AR sessions, thus providing multi-functionality.
3Productivity
If conventional AR experiences are used, then real-world space can be augmented, but reinitialization is required upon termination
Solution Approach 1:
The patent performs preliminary actions by capturing images and identifying 3D spatial features in advance to create spatially aware media that can be stored and reused. When the AR session is terminated, this pre-processed spatial data remains available, eliminating the need for time-consuming reinitialization and allowing quick resumption of augmented viewing.
Solution Approach 2:
Instead of discarding spatial data when an AR session ends, the patent recovers and preserves the captured images and 3D spatial features as reusable spatially aware media. This allows the system to maintain the augmented reality environment across sessions without requiring reinitialization, thus improving productivity and reducing time loss.
4Adaptability or versatility
If multiple perspectives are enabled, then viewing flexibility increases, but computational complexity increases
Solution Approach 1:
The patent performs preliminary rendering准备工作 by capturing multiple camera images and pre-identifying 3D spatial features before the user viewing session. This pre-processing creates a ready-to-use spatially aware media structure that reduces real-time computational complexity when switching between multiple perspectives, as the heavy lifting of spatial analysis has already been completed.
Data Source
AI summary
The present disclosure relates, in part, to spatially aware media that includes three-dimensional (3D) spatial information pertaining to a real-world space. The spatially aware media may map this 3D spatial information to media such as an image, for example, to provide 3D spatial context for the media. This may allow users to more flexibly and efficiently interact with virtual content in real-world spaces that are relevant to them. According to one embodiment, spatially aware media is augmented to provide an image of a real-world space overlaid with a render of a 3D model defined relative to the 3D spatial features of the real-world space. Before augmenting the spatially aware media, a recommended position for the 3D model relative to the 3D spatial features of the real-world space may be determined based on the 3D model and/or on the spatially aware media.