Virtualized Scene Rendering for Precise Blended Reality Views
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing mixed physical and virtual reality systems are limited by undefined physical environments, lacking precise definition and integration of virtual elements.
Innovation Solution
A system that provides a virtualized view of a physical scene by using comprehensive foreknowledge of the environment, allowing precise location and pose determination of a user device, and generating photorealistic renderings that can be dynamically modified or enhanced, eliminating the need for physical tags.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If comprehensive foreknowledge of the physical environment is used to generate virtualized views, then the photorealistic rendering quality and integration precision are improved, but the system complexity and data processing requirements increase
Solution Approach 1:
The system performs preliminary actions by capturing comprehensive foreknowledge of the physical environment through multiple cameras and sensors before virtualized view generation. The physical environment is pre-mapped and stored as structured data, allowing precise location and pose determination during runtime without real-time complex processing. This pre-processing approach resolves the contradiction by preparing data in advance, reducing real-time computational complexity while maintaining high precision.
2Ease of manufacture
If photorealistic renderings are generated and dynamically modified, then the viewing experience quality is improved, but the computational resources and processing time increase
Solution Approach 1:
The system implements dynamics by enabling real-time dynamic modification of photorealistic renderings. Virtual objects can be added, removed, or modified in the virtualized view without regenerating the entire scene. The rendering engine supports dynamic updates by modifying only the changed portions, allowing ease of manufacture and adaptation while minimizing processing time through incremental rendering techniques.
3Adaptability or versatility
If virtual elements are precisely integrated into the physical environment, then the blended reality experience is improved, but the accuracy requirements for environment mapping increase
Solution Approach 1:
The system uses an intermediary approach by introducing a virtualized view layer that mediates between the physical environment and virtual elements. Multiple cameras capture the physical environment from different perspectives, and these views are integrated through structured data representation. This intermediary layer allows precise integration of virtual elements by providing a standardized interface for environment mapping, reducing the direct accuracy requirements while maintaining high blended reality quality.
Data Source
AI summary
Techniques for providing blended physical and virtual reality experiences are disclosed. In some embodiments, a rendering of an actual view of a scene as seen by a camera capturing the scene is obtained from existing assets associated with a virtualized version of the scene and displayed. The actual view of the scene comprises a known environment that includes one or more of a constrained set of objects. The rendering facilitates surfacing information associated with one or more objects comprising the actual view.