HMD Virtual Environment Rendering with Physical Property Preservation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional augmented reality systems lack intuitive methods for capturing and segmenting three-dimensional objects from their environment for storage and communication, limiting their ability to effectively visualize and collaborate on real-world spaces and objects across different locations.
Innovation Solution
A head-mounted display (HMD) device equipped with optical input devices scans and generates three-dimensional datasets of physical environments and objects, allowing for the creation of virtual representations that maintain physical properties, enabling users to capture, store, and share these representations across different locations, facilitating collaboration and visualization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If conventional augmented reality systems are used to display virtual objects, then users can perceive composite views of real-world and computer-generated images, but the systems lack intuitive methods for capturing and segmenting three-dimensional objects from their environment
Solution Approach 1:
The system automatically segments three-dimensional objects from their environment by detecting edges, contours, and spatial relationships in the captured data. This divides the complex task of object isolation into automated computational steps, resolving the contradiction by making object capture intuitive while managing complexity through algorithmic processing.
Solution Approach 2:
The system creates digital copies of physical three-dimensional objects by scanning and reconstructing their geometry and appearance. This copying approach enables intuitive object capture without manual intervention, as the system automatically replicates objects in virtual space, resolving the ease of operation requirement while handling complexity through automated reconstruction algorithms.
2Adaptability or versatility
If three-dimensional objects are captured and stored for later use, then users can view and interact with virtual representations across different locations, but the systems lack capabilities for effective collaboration and visualization across locations
Solution Approach 1:
The system transforms physical objects into virtual representations by changing their state from physical to digital, while preserving key parameters such as geometry, texture, and spatial relationships. This parameter transformation enables cross-location collaboration while maintaining object fidelity, resolving the contradiction between adaptability and information preservation.
Solution Approach 2:
The system introduces a digital intermediary layer that mediates between physical objects and remote users. This virtual representation acts as an intermediary that preserves all necessary physical properties while enabling cross-location interaction, resolving the contradiction by maintaining information fidelity through the intermediary digital model.
Data Source
AI summary
Systems and techniques from displaying virtual representations of real-world spaces and objects in various environments are disclosed. A source environment at a first location can be scanned by a head-mounted display (HMD) device to generate three-dimensional datasets corresponding to the physical environment at the first location. The three-dimensional datasets can include detected physical properties associated with the physical environment. At a second location, the HMD can re-create the source environment, and render for display a virtual representation of the physical environment based on the three-dimensional datasets, where the virtual representation of the source environment is rendered to maintain any one of the detected physical properties associated with the physical environment. Further, at the second location, the HMD can enable a user to view one or more physical objects within the virtual representation of the physical environment such that the physical object is perceived to be within the source environment.