Remote AR Authoring via 3D Mesh Projection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional systems for authoring site-specific augmented reality experiences require the author to be physically present in the environment, limiting the ability to create and modify augmented reality content without being present at the specific location.
Innovation Solution
An augmented reality authoring system that generates a three-dimensional representation of a remote physical environment using remote environment data, allowing users to interact with and add virtual objects to the environment from a different location by projecting digital video frames onto a three-dimensional mesh based on capture information from an image capture device.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If an author uses a conventional system to author a site-specific augmented reality experience, then the experience can be customized to the particular physical environment, but the author must be physically present in the environment to arrange virtual objects relative to physical objects
Solution Approach 1:
The system creates a three-dimensional digital copy (mesh representation) of the physical environment that can be viewed and interacted with remotely. This digital twin allows the author to arrange virtual furniture relative to captured physical furniture without being physically present, while maintaining the site-specific customization capability
Solution Approach 2:
The system introduces an intermediary digital representation (the three-dimensional mesh and photorealistic composite) between the author and the physical environment. This intermediary allows remote interaction with the environment by mapping virtual objects to the digital representation, which then gets applied to the actual physical space
2Manufacturing precision
If an interior decorator travels to a client's apartment to author the augmented reality experience, then accurate placement of virtual furniture can be achieved, but travel time and costs are incurred
Solution Approach 1:
By creating a detailed three-dimensional mesh copy of the apartment environment, the system enables accurate virtual furniture placement to be performed remotely. The digital copy preserves all geometric features and spatial relationships, allowing the interior decorator to achieve the same placement accuracy without traveling to the location
Solution Approach 2:
The system performs preliminary capture of the physical environment (creating the three-dimensional mesh and photorealistic composite) before the authoring process begins. This preliminary action establishes the digital foundation that enables subsequent remote authoring work to be done accurately without requiring physical presence
Data Source
AI summary
In implementations of systems for augmented reality authoring of remote environments, a computing device implements an augmented reality authoring system to display a three-dimensional representation of a remote physical environment on a display device based on orientations of an image capture device. The three-dimensional representation of the remote physical environment is generated from a three-dimensional mesh representing a geometry of the remote physical environment and digital video frames depicting portions of the remote physical environment. The augmented reality authoring system receives input data describing a request to display a digital video frame of the digital video frames. A particular digital video frame of the digital video frames is determined based on an orientation of the image capture device relative to the three-dimensional mesh. The augmented reality authoring system displays the particular digital video frame on the display device.