Spatially Aware Media for Remote AR Viewpoint Access
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional augmented reality (AR) experiences require users to be physically present in a real-world space to augment it with virtual content, and they typically allow viewing from only one perspective at a time, with the need for reinitialization after each session.
Innovation Solution
The generation and storage of 'spatially aware media' that includes visual, audio, and haptic content corresponding to a real-world space, along with information identifying 3D spatial features, allowing for virtual content to be generated and overlaid in a realistic manner, enabling remote access and viewing from multiple perspectives without reinitialization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional AR experiences require users to be physically present in a real-world space to augment it with virtual content, then the system can provide real-time spatial awareness, but the user's mobility and accessibility are restricted
Solution Approach 1:
The patent creates digital copies of real-world spaces through 3D scanning and spatial mapping, storing these as spatially aware media that can be accessed remotely. This allows users to interact with virtual content in replicated environments without being physically present, resolving the contradiction between accessibility and system requirements
Solution Approach 2:
The system introduces spatially aware media as an intermediary between the user and the real-world space. This media acts as a bridge, allowing remote users to view and interact with augmented content as if they were physically present, eliminating the need for physical presence while maintaining spatial awareness
2Loss of information
If conventional AR experiences allow viewing from only one perspective at a time, then the system maintains simplicity, but the user's ability to analyze and understand the spatial environment is limited
Solution Approach 1:
The patent enables multi-perspective viewing by rendering spatially aware media from multiple camera angles and viewpoints simultaneously. This allows users to explore the same spatial environment from different perspectives without increasing physical device complexity, as all perspectives are pre-rendered and stored
Solution Approach 2:
The system performs preliminary spatial scanning and 3D reconstruction of real-world environments before user interaction. This pre-processing creates comprehensive spatial models that can be viewed from multiple perspectives on-demand, eliminating the need for complex real-time multi-perspective rendering during user sessions
3Reliability
If conventional AR experiences require reinitialization after each session by scanning the real-world space, then the system maintains spatial accuracy, but the user's time efficiency is reduced
Solution Approach 1:
The patent performs spatial scanning and 3D mapping in advance, creating and storing spatially aware media before user sessions begin. This preliminary action captures accurate spatial information that can be reused across multiple sessions, eliminating the need for repeated scanning and reinitialization while maintaining spatial accuracy
Solution Approach 2:
The system recovers and reuses previously captured spatial data stored as spatially aware media across multiple user sessions. Instead of discarding and re-scanning the environment each time, the system retrieves and re applies stored spatial models, saving time while maintaining consistency and accuracy
Data Source
AI summary
The present disclosure relates, in part, to spatially aware media that includes three-dimensional (3D) spatial information pertaining to a real-world space. The spatially aware media may map this 3D spatial information to media such as an image, for example, to provide 3D spatial context for the media. This may allow users to more flexibly and efficiently interact with virtual content in real-world spaces that are relevant to them. According to one embodiment, spatially aware media is augmented to provide an image of a real-world space overlaid with a render of a 3D model defined relative to the 3D spatial features of the real-world space. Before augmenting the spatially aware media, a recommended position for the 3D model relative to the 3D spatial features of the real-world space may be determined based on the 3D model and/or on the spatially aware media.