Mixed Reality Energy Visualization via Sensor Geometry Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current virtual and mixed reality technologies cannot effectively visualize and display invisible forms of energy, such as sound, heat, and electromagnetic fields, within real-world environments, limiting user interaction and understanding of these phenomena.
Innovation Solution
The use of sensors to scan real-world environments and gather geometry data, combined with energy detection, allows for the determination of how energy propagates through space, enabling the display of this energy as virtual content through mixed reality devices, thereby making invisible energies visible to users.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If sensors are used to detect energy and geometry data is collected, then energy propagation can be visualized in mixed reality environments, but the complexity of the system increases due to multiple sensors and data processing requirements
Solution Approach 1:
The patent uses sensors as intermediaries to detect invisible energy forms (sound, heat, electromagnetic fields) and converts them into detectable signals. These sensors act as mediators between the physical energy phenomena and the digital representation, enabling visualization without requiring direct human perception of the invisible energy.
Solution Approach 2:
The patent creates virtual copies or representations of invisible energy by capturing real-world energy data through sensors and generating corresponding visual elements in the mixed reality environment. These virtual energy representations are copies that mimic the behavior and propagation of actual physical energy, making invisible phenomena visible through digital twins.
2Loss of information
If multiple sensors and data processing are implemented to visualize energy propagation, then user understanding of energy dynamics improves, but the computational resources and processing time required increase
Solution Approach 1:
The patent performs preliminary actions by pre-processing geometry data and establishing spatial models of the environment before energy detection occurs. By pre-computing propagation paths, reflection points, and absorption characteristics based on the scanned environment, the system reduces real-time computational requirements when actual energy visualization is needed.
Solution Approach 2:
The patent segments the energy propagation visualization into discrete components such as direct energy paths, reflected energy, absorbed energy, and energy density zones. This segmentation allows parallel processing of different energy components and enables optimized rendering strategies where only relevant energy segments are computed and displayed based on user context.
3Measurement precision
If the system scans and processes real-world geometry and energy data, then accurate energy propagation representation is achieved, but the quantity of data to be processed increases
Solution Approach 1:
The patent extracts only the essential geometry data and energy parameters needed for accurate propagation modeling, rather than processing complete environmental datasets. By selectively extracting relevant features such as boundary surfaces, reflective materials, and energy source locations, the system maintains measurement precision while reducing overall data volume for processing.
Solution Approach 2:
The patent implements partial processing by focusing computational resources on regions of interest where energy propagation is most significant. Rather than uniformly processing the entire environment, the system concentrates data analysis and visualization efforts on areas with high energy density or user interaction potential, achieving accurate representation where it matters most while reducing total data processing requirements.
Data Source
AI summary
The techniques describe herein use sensor(s) to scan a real-world environment and obtain data associated with geometry of the real-world environment that affects how energy propagates (e.g., locations of spatial objects in a room). The sensor(s) also detect energy (e.g., sound) in the real-world environment, from which a location of a source of the energy can be determined. The techniques combine the geometry data and the energy data to determine how the detected energy propagates from the location of the source through the real-world environment. The techniques can then cause a representation of the propagating energy to be displayed, to a user, as virtual content via a mixed reality device. Accordingly, a user is able to see energy that is otherwise invisible.