Extended Reality Visualization of Non-Visible Physical Phenomena

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current extended reality technologies fail to effectively visualize non-visible phenomena in physical environments, such as electromagnetic signals, airflow, and hidden objects, limiting user interaction and immersion.

Innovation Solution

An extended reality system that utilizes electronic devices with sensors and depth mapping capabilities to detect and visualize non-visible features by overlaying their representations onto the physical environment, using visual contexts and sensor data to create accurate three-dimensional visualizations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If extended reality technology is used to bridge virtual and physical environments, then user immersion is improved, but the ability to visualize non-visible phenomena remains insufficient

Engineering Contradiction:
Improveuser immersionVSAvoidvisualization of non-visible phenomena
Core Design Contradiction:
Adaptability or versatilityVSLoss of information

Solution Approach 1:

The patent uses sensors as intermediary devices to detect non-visible phenomena (electromagnetic signals, airflow, hidden objects) and converts them into visual representations that can be displayed in the extended reality environment. This mediator approach allows the system to bridge the gap between invisible physical phenomena and visible virtual overlays, resolving the contradiction by enabling visualization without compromising immersion.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system changes the parameter of visibility by detecting non-visible phenomena through sensors and transforming them into visible visualizations. By altering the state from non-visible to visible through parameter transformation, the system maintains both user immersion and information completeness about non-visible features.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If sensors and depth mapping are used to detect non-visible features, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improvedetection accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent employs multi-functional sensors that can detect various types of non-visible phenomena (electromagnetic signals, airflow, hidden objects) using a single integrated system. This universal approach improves measurement precision across multiple phenomena types while avoiding the complexity increase that would result from deploying separate specialized sensors for each phenomenon.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system merges depth mapping capabilities with sensor-based detection of non-visible features into a unified processing framework. By combining these functions, the system achieves high measurement precision for both visible and non-visible elements without the overhead of maintaining separate complex systems.

Inventive Principle:
Principle #5Merging (Combining)

3Ease of operation

If visualizations are overlaid on physical environment, then user interaction is enhanced, but accuracy of location mapping may deteriorate

Engineering Contradiction:
Improveuser interactionVSAvoidlocation mapping accuracy
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The system uses depth mapping and sensor data to provide continuous feedback on the spatial relationship between virtual visualizations and physical features. This feedback loop ensures that overlays remain accurately positioned on their corresponding physical objects, maintaining location mapping precision while enabling intuitive user interaction with the augmented content.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12131533B2Visualization of non-visible phenomena
Publication Date: 2024.10.29 APPLE INC
  • US12131533B2 patent drawing
  • US12131533B2 patent drawing
  • US12131533B2 patent drawing

AI summary

Implementations of the subject technology provide visualizations of non-visible features of a physical environment, at the location of the non-visible features in the physical environment. The non-visible features may include wireless communications signals, sounds, airflow, gases, subsonic and/or ultrasonic waves, hidden objects, or the like. A device may store visual contexts for visualizations of particular non-visible features. The device may obtain a depth map that allows the device to determine the location of the non-visible feature in the physical environment and to overlay the visualization on a user's view of that location. In this way, the non-visible feature can be visualized its correct location, orientation, direction and/or strength in the physical environment.