AR Collision Simulation Using Physics Engine and Image Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Augmented reality systems struggle to realistically display collisions between real and virtual objects due to limitations in accurately simulating physical interactions and energy exchanges, which affects the realism and accuracy of virtual object movements and interactions within a real-world environment.

Innovation Solution

An augmented reality display device system that identifies collisions between real and virtual objects using captured image and depth data, employs a physics engine to simulate collisions based on physical properties and interaction characteristics, and generates image data to display realistic effects on the real object, allowing for user-initiated changes in physical properties and interactions between virtual objects controlled by different applications.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a physics engine is used to simulate collisions between real and virtual objects, then the realism of virtual object interactions is improved, but the computational complexity and processing time increase

Engineering Contradiction:
Improverealism of collision simulationVSAvoidcomputational complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent replaces complex full-physics simulation with a simplified collision detection and response system. Instead of using a complete physics engine that simulates all physical interactions, the system uses image data analysis to detect collisions and applies pre-determined visual effects to represent the collision outcomes, thereby reducing computational complexity while maintaining visual realism.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent uses captured image data of real objects and generates modified copies of these images to represent collision effects. By working with image copies rather than simulating actual physical interactions, the system achieves realistic visual representation without the computational burden of full physics simulation.

Inventive Principle:
Principle #26Copying

2Measurement precision

If detailed physical properties are captured and simulated for real objects, then the accuracy of collision effects is improved, but the data processing requirements and system resources increase

Engineering Contradiction:
Improveaccuracy of physical propertiesVSAvoiddata processing requirements
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent extracts only the essential visual and spatial features from captured image data that are necessary for collision detection and effect generation. Instead of processing and simulating all physical properties in detail, the system identifies and uses only the critical attributes needed for realistic collision representation, thereby reducing data processing requirements.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies different levels of detail to different aspects of collision simulation. High-detail image processing is applied only at the collision point where effects are generated, while other areas use standard image data. This localized approach maintains accuracy where needed while reducing overall processing requirements.

Inventive Principle:
Principle #3Local quality

3Ease of operation

If real-time collision detection and effect generation is implemented, then the interactivity and immersion of augmented reality is improved, but the processing speed requirements and system latency increase

Engineering Contradiction:
Improveinteractivity of augmented realityVSAvoidprocessing speed
Core Design Contradiction:
Ease of operationVSSpeed

Solution Approach 1:

The patent pre-processes and stores image data of real objects in advance, preparing it for rapid collision detection and effect generation. By having image data ready beforehand in suitable formats and locations, the system can quickly detect collisions and generate appropriate effects in real-time without extensive processing delays.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent generates collision effects as temporary, disposable visual modifications that are applied only for the duration of the collision event. These effect images are created on-demand from base image data, used briefly to represent the collision, and then discarded, avoiding the need for persistent high-detail models and reducing processing requirements.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Data Source

PatentUS9183676B2Displaying a collision between real and virtual objects
Publication Date: 2015.11.10 MICROSOFT TECHNOLOGY LICENSING LLC
  • US9183676B2 patent drawing
  • US9183676B2 patent drawing
  • US9183676B2 patent drawing

AI summary

Technology is described for displaying a collision between objects by an augmented reality display device system. A collision between a real object and a virtual object is identified based on three dimensional space position data of the objects. At least one effect on at least one physical property of the real object is determined based on physical properties of the real object, like a change in surface shape, and physical interaction characteristics of the collision. Simulation image data is generated and displayed simulating the effect on the real object by the augmented reality display. Virtual objects under control of different executing applications can also interact with one another in collisions.