Virtual Object Representation Control for Context-Aware 2D and 3D CGR

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing computer-generated reality (CGR) environments lack robust functionality for controlling the representation of virtual objects based on their location and use context, as well as the concurrent display of two-dimensional (2D) and three-dimensional (3D) representations of these objects.

Innovation Solution

The system adapts the representation of virtual objects within CGR environments based on the use context of their location, allowing for dynamic changes in representation when moved to different locations, and enables concurrent display of 2D and 3D representations at distinct locations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If virtual objects are displayed with fixed representations at different locations, then the display is simple, but the adaptability to different use contexts is poor

Engineering Contradiction:
Improveadaptability to use contextsVSAvoidrepresentation control complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements dynamic representation transformation where virtual objects automatically change their visual form based on detected use contexts. The system transitions from static fixed representations to dynamic adaptive representations that respond to location, device type, and interaction mode changes, resolving the contradiction between simplicity and adaptability.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes visual parameters such as dimensionality (2D/3D), scale, and rendering style based on detected use contexts. By modifying these parameters dynamically according to the context, the system achieves high adaptability without requiring completely different virtual object models for each scenario.

Inventive Principle:
Principle #35Parameter changes

2Adaptability or versatility

If multiple representations of virtual objects are displayed concurrently, then the versatility is improved, but the device complexity increases

Engineering Contradiction:
Improveconcurrent display capabilityVSAvoidrepresentation management complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent segments the representation control into independent modules that handle different use contexts separately. Each use context has its own representation rules and parameters, allowing multiple representations to be managed concurrently through modular control rather than a monolithic complex system.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system employs a universal representation controller that can generate multiple different representations of the same virtual object based on a single set of context-detection mechanisms. This multi-functional approach allows concurrent display of different representations without proportionally increasing system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Ease of operation

If the representation changes based on location use context, then the user interaction is enhanced, but the processing time increases

Engineering Contradiction:
Improveuser interaction qualityVSAvoidrepresentation switching time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system performs preliminary detection and classification of use contexts continuously in the background, preparing representation transformation parameters in advance. When a context change is detected, the appropriate representation is already prepared or can be quickly generated from pre-defined templates, minimizing the perceived switching time while maintaining high interaction quality.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12613572B2Controlling representations of virtual objects in a computer-generated reality environment
Publication Date: 2026.04.28 APPLE INC
  • US12613572B2 patent drawing
  • US12613572B2 patent drawing
  • US12613572B2 patent drawing

AI summary

In accordance with some embodiments, an exemplary process for controlling representations of virtual objects based on respective user contexts that each correspond to different respective locations in a computer-generated reality (CGR) environment is described.