Augmented Reality Virtual Content Coherence via Particle Synthesis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality systems fail to adequately account for air-born particles and lens-based artifacts, leading to incoherent integration of virtual content with real image content, as virtual content often lacks these elements, resulting in a detached or unrealistic appearance.

Innovation Solution

The implementation of methods and systems that determine the characteristics of air-born particles and lens-based artifacts from images and synthesize computer-generated counterparts to match the real environment, ensuring virtual content appears coherent by layering or masking these elements appropriately within the augmented reality experience.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If virtual content is added to video stream images, then augmented reality content is provided, but the virtual content lacks air-born particles and lens-based artifacts causing incoherent appearance

Engineering Contradiction:
Improvecoherence of virtual content with real environmentVSAvoidcomplexity of processing image characteristics
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent synthesizes computer-generated air-born particles and lens-based artifacts by copying the characteristics observed in the video stream images. The system analyzes real particle properties (size, density, movement patterns) and lens artifact characteristics, then generates synthetic versions that match these observed properties, allowing virtual content to be rendered with coherent atmospheric effects without requiring complex physical simulations

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system performs preliminary analysis of the video stream to identify and characterize air-born particles and lens-based artifacts before rendering virtual content. By pre-processing the video frames to extract particle characteristics and artifact patterns, the system prepares synthesis parameters in advance, enabling efficient generation of matching visual effects for subsequent virtual content without real-time computational overhead during rendering

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If virtual content is combined with image content, then augmented reality experience is enhanced, but the virtual content appears detached and unrealistic without environmental particles

Engineering Contradiction:
Improveadaptability of virtual content to real environmentVSAvoidcomplexity of synthesizing particle images
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system creates synthetic particle images by copying the statistical and visual characteristics of real particles from video stream analysis. By deriving particle properties (distribution, motion vectors, opacity) from real-world observations and generating matching synthetic versions, the system achieves environmental adaptability through parameter matching rather than complex physics-based simulations

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system adjusts particle synthesis parameters (density, size distribution, velocity, opacity) based on environmental conditions detected in the video stream. By dynamically modifying these parameters to match observed real-world conditions, the virtual content adapts to different environments (rainy, foggy, dusty) without requiring fundamentally different rendering approaches

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11182978B1Rendering virtual content with coherent visual properties
Publication Date: 2021.11.23 APPLE INC
  • US11182978B1 patent drawing
  • US11182978B1 patent drawing
  • US11182978B1 patent drawing

AI summary

Various implementations disclosed herein render virtual content while accounting for air-born particles or lens-based artifacts to improve coherence or to otherwise better match the appearance of real content in the images with which the virtual content is combined.