AR Physics Model Interaction Visualization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current augmented reality systems lack the ability to effectively visualize physical interactions between objects in real-time, limiting their capability to provide users with interactive and dynamic information about their environment.

Innovation Solution

A system and method that utilize sensors to generate live data on physical characteristics of objects, compute physics models of predicted interactions, and visualize these interactions in real-time by overlaying virtual information onto the real-world view, using a network of viewing devices and servers to render dynamic and static object interactions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If augmented reality systems overlay computer-generated information on the real world, then information availability about the environment is improved, but the ability to visualize physical interactions between objects remains lacking

Engineering Contradiction:
Improveinformation about physical interactionsVSAvoidcapability to provide interactive dynamic information
Core Design Contradiction:
Loss of informationVSAdaptability or versatility

Solution Approach 1:

The system performs preliminary computations of physics models to predict interactions between objects before the user needs this information. By pre-calculating potential collisions, forces, and physical behaviors based on sensor data, the system prepares interaction visualizations in advance, enabling real-time display of physical interaction information that would otherwise be too complex to compute on-demand.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system introduces physics models as an intermediary layer between sensor data and AR visualizations. Rather than directly displaying raw sensor data or simple object positions, the physics models compute predicted interactions (collisions, forces, movements) that mediate between the physical world and the virtual information overlay, enabling realistic visualization of physical interactions.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If the system computes physics models of predicted interactions in real-time, then visualization of physical interactions is improved, but computational complexity increases

Engineering Contradiction:
Improveaccuracy of interaction predictionVSAvoidcomputational requirements
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system segments the computational task of physics modeling into separate modules: sensor data acquisition, object identification, physics model computation, and visualization rendering. By dividing the complex computation into distinct segments that can be processed independently and in parallel, the system reduces the computational burden on any single component while maintaining overall accuracy in interaction prediction.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system computes physics models selectively rather than for all objects simultaneously. It focuses computational resources on objects that are likely to interact based on their proximity, velocity, and physical properties, performing partial computations only where needed. This approach maintains reliable interaction prediction for critical objects while reducing overall computational complexity.

Inventive Principle:
Principle #16Partial or excessive action

3Loss of information

If the system overlays multiple layers of virtual information including physics models, then information density is improved, but processing time increases

Engineering Contradiction:
Improvereal-time object interaction dataVSAvoidrendering time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The system updates physics models and interaction visualizations at periodic intervals rather than continuously. By computing physics predictions at regular time steps and updating the AR display periodically, the system maintains real-time information about object interactions while reducing the processing time required compared to continuous computation and rendering of all visual elements.

Inventive Principle:
Principle #19Periodic action

Data Source

PatentUS9558592B2Visualization of physical interactions in augmented reality
Publication Date: 2017.01.31 META PLATFORMS TECHNOLOGIES LLC
  • US9558592B2 patent drawing
  • US9558592B2 patent drawing
  • US9558592B2 patent drawing

AI summary

A system and method for visualization of physical interactions are described. Objects in a scene are captured with a viewing device. Physical characteristics of the objects are computed using data from at least one sensor corresponding to the objects. A physics model of predicted interactions between the one or more objects is generated using the physical characteristics of the objects. An interaction visualization is generated based on the physics model of the predicted interactions between the one or more objects. An image of the one or more objects is augmented with the interaction visualization in a display of the viewing device.