Augmented Reality Effect Placement Through Environment Scanning

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Conventional methods for adding virtual effects in augmented reality environments are inefficient, fail to intelligently determine surfaces and objects in the physical environment, and do not dynamically update based on the position of the device or the presence of individuals, leading to energy waste and unsynchronized virtual effects.

Innovation Solution

The system includes a method for scanning the physical environment to detect features and human subjects, allowing virtual effects to be intelligently applied based on the detected surfaces and positions, and dynamically updated to enhance synchronization with the live view.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If conventional methods are used to add virtual effects, then the implementation is simple, but the method is cumbersome and inefficient, failing to intelligently determine surfaces and objects

Engineering Contradiction:

Improveintelligent determination of surfaces and objectsVSAvoidcomplexity of environment scanning and feature detection

Core Design Contradiction:

Extent of automationVSDevice complexity

Solution Approach 1:

The system performs self-service by automatically scanning the physical environment, detecting surfaces and objects, and applying virtual effects without requiring manual user intervention for each step. The device autonomously determines where to place virtual effects by analyzing the captured image data and identifying suitable surfaces.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The system performs preliminary scanning and detection of the physical environment before applying virtual effects. By pre-identifying surfaces and objects in the scene, the system prepares the environment for efficient virtual effect placement, avoiding the need for complex real-time processing during effect application.

Inventive Principle:

Principle #10Preliminary action

2Reliability

If conventional methods display virtual effects without dynamic updates, then energy consumption is reduced, but the virtual effects are not well synchronized with the live view

Engineering Contradiction:

Improvesynchronization of virtual effects with live viewVSAvoidenergy consumption of the device

Core Design Contradiction:

ReliabilityVSUse of energy by moving object

Solution Approach 1:

The system uses periodic action by updating virtual effects at specific intervals triggered by user interactions or significant device movements. Instead of continuously updating virtual effects, the system refreshes them periodically when needed, maintaining synchronization with the live view while avoiding unnecessary energy consumption from constant updates.

Inventive Principle:

Principle #19Periodic action

Solution Approach 2:

The system applies dynamics by making virtual effects adaptable and responsive to changes in the physical environment. Virtual effects dynamically adjust their position, orientation, and appearance based on detected surfaces and objects, ensuring they remain synchronized with the live view as the device or environment changes.

Inventive Principle:

Principle #15Dynamics

3Adaptability or versatility

If the system scans the physical environment to detect features and human subjects, then virtual effects can be intelligently applied and dynamically updated, but the processing time increases

Engineering Contradiction:

Improveability to adapt virtual effects to detected features and individualsVSAvoidtime required for environment scanning and processing

Core Design Contradiction:

Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system performs preliminary scanning and detection of the physical environment, surfaces, and objects before applying virtual effects. By pre-processing the environment data and identifying suitable targets, the system reduces the time required during actual effect application, as the detection work is done in advance.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The system uses skipping by focusing detection and processing only on relevant portions of the environment rather than analyzing every detail. When adding virtual effects, the system rapidly identifies key surfaces and objects without performing exhaustive analysis, thereby reducing processing time while maintaining adaptability.

Inventive Principle:

Principle #21Skipping (Rushing through)

Data Source

PatentUS12462498B2Systems, methods, and graphical user interfaces for adding effects in augmented reality environments

Publication Date: 2025.11.04 APPLE INC

AI summary

A computer system displays a representation of a field of view of the one or more cameras, including a representation of a portion of a three-dimensional physical environment that is in the field of view of the one or more cameras. The computer system receives a request to add a first virtual effect to the displayed representation of the field of view of the one or more cameras. In response to receiving the request to add the first virtual effect to the displayed representation of the field of view of the one or more cameras and in accordance with a determination that the first virtual effect requires a scan of the physical environment, the computer system initiates a scan of the physical environment to detect one or more features of the physical environment and displays a user interface that indicates a progress of the scan of the physical environment.