3D Environment Light Projections for Low-Burden AR Interaction

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing methods for interacting with virtual and augmented reality environments are cumbersome, inefficient, and create a significant cognitive burden on users due to insufficient feedback, complex manipulation of virtual objects, and lengthy input processes, particularly in battery-operated devices.

Innovation Solution

Implementing a virtual assistant in a three-dimensional environment that provides visual feedback through changing representations of virtual illumination to assist users in interacting with the environment, reducing the need for direct interaction with the assistant by indicating spatial relationships and guiding attention to content display locations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If conventional input devices and interfaces are used to interact with virtual reality environments, then users can perform operations in the virtual environment, but the interaction becomes cumbersome and creates significant cognitive burden on users

Engineering Contradiction:

Improveease of interactionVSAvoidinterface complexity

Core Design Contradiction:

Ease of operationVSDevice complexity

Solution Approach 1:

The patent implements feedback mechanisms where the virtual environment provides visual, auditory, and haptic feedback in response to user inputs. This feedback loop helps users understand the connection between their inputs and system responses, reducing cognitive burden and making interaction more intuitive and easier to perform.

Inventive Principle:

Principle #23Feedback

Solution Approach 2:

The patent introduces intermediary elements such as virtual agents, guides, or automated assistants that mediate between the user and the complex virtual environment. These intermediaries simplify interaction by handling complex tasks, providing step-by-step guidance, or translating user intentions into appropriate actions within the virtual space.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Productivity

If multiple input steps are required to achieve desired outcomes in augmented reality environments, then precise control can be achieved, but the process takes longer than necessary and wastes energy

Engineering Contradiction:

Improveinteraction speedVSAvoidtime delay

Core Design Contradiction:

ProductivityVSLoss of time

Solution Approach 1:

The patent implements preliminary actions by pre-configuring virtual environments, pre-loading necessary resources, and anticipating user needs before interactions occur. This allows the system to be ready for user actions in advance, reducing the time required to execute operations and improving interaction speed without sacrificing precision.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The patent enables users to skip intermediate steps through features like gesture-based shortcuts, voice commands, or automated workflows. By allowing users to bypass unnecessary intermediate actions, the system achieves desired outcomes faster while maintaining control precision for critical operations.

Inventive Principle:

Principle #21Skipping (Rushing through)

3Measurement precision

If complex manipulation of virtual objects is required, then precise control over virtual elements can be achieved, but the process becomes tedious and error-prone

Engineering Contradiction:

Improvecontrol precisionVSAvoidoperation simplicity

Core Design Contradiction:

Measurement precisionVSEase of operation

Solution Approach 1:

The patent replaces complex mechanical manipulation interfaces with alternative interaction modalities such as gaze-based selection, voice commands, or automated positioning systems. These substitutions maintain precise control over virtual objects while eliminating the need for tedious manual manipulation, reducing errors and simplifying operations.

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

4Use of energy by moving object

If battery-operated devices are used to provide virtual reality experiences, then portability is achieved, but energy is wasted due to inefficient interaction methods

Engineering Contradiction:

Improveenergy efficiencyVSAvoidinteraction efficiency

Core Design Contradiction:

Use of energy by moving objectVSProductivity

Solution Approach 1:

The patent implements self-service features where the virtual environment automatically optimizes resource usage, adjusts rendering quality based on device capabilities, and manages power consumption without requiring user intervention. This improves energy efficiency while maintaining high interaction efficiency through automated optimizations.

Inventive Principle:

Principle #25Self-service

Data Source

PatentUS12578835B2Devices, methods, and graphical user interfaces for interacting with three-dimensional environments

Publication Date: 2026.03.17 APPLE INC

AI summary

A system displays, via the first display generation component: a first view of a computer-generated three-dimensional environment, including a representation of a physical environment, and a representation of one or more projections of light. The representation of the one or more projections of light has an appearance that corresponds to a spatial relationship between first virtual content present in the computer-generated three-dimensional environment and the representation of the physical environment. The system displays animated changes of the representation of the one or more projections of light and displays alterations of an appearance of a representation of a first surface in the physical environment in accordance with the animated changes of the representation of the one or more projections of light.