Dynamic Locked Mode Switching for XR Content Occlusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In extended reality (XR) environments, maintaining a locked mode for computer-generated content while a device changes position can lead to user experience issues due to occlusion by physical surfaces and inaccurate user engagement tracking.

Innovation Solution

An electronic device dynamically changes the locked mode of computer-generated content based on distance from a physical surface, shifting from object-locked to world-locked or vice versa when occlusion or remoteness criteria are met, using positional sensors and computer vision to adjust the display mode and prevent occlusion while maintaining accurate user interaction tracking.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the device maintains a locked mode for computer-generated content while changing position, then the content remains anchored to the original position, but the content may be occluded by physical surfaces or user engagement tracking becomes inaccurate

Engineering Contradiction:
Improvecontent anchoring stabilityVSAvoidocclusion and tracking inaccuracy
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The patent applies dynamics by transitioning the locked mode from static to adaptive. The system dynamically switches between different locked modes (e.g., from object-locked to world-locked or room-locked) based on real-time detection of occlusion conditions and device position changes. This allows the content anchoring to adapt to changing environmental conditions, maintaining reliability while avoiding occlusion and tracking inaccuracies.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes the parameter of locked mode type based on detected conditions. When occlusion is detected or device position changes exceed thresholds, the system changes from one locked mode parameter setting to another (e.g., changing anchor point references or locking targets). This parameter change resolves the contradiction by adjusting the anchoring behavior to suit current conditions.

Inventive Principle:
Principle #35Parameter changes

2Object-affected harmful factors

If the device changes locked mode frequently in response to positional changes, then occlusion and tracking accuracy are maintained, but system complexity and computational overhead increase

Engineering Contradiction:
Improveocclusion prevention and tracking accuracyVSAvoidlocked mode management complexity
Core Design Contradiction:
Object-affected harmful factorsVSDevice complexity

Solution Approach 1:

The patent implements feedback mechanisms where the system continuously monitors device position, detects occlusion conditions, and uses this feedback to determine when to switch locked modes. Threshold-based triggering and hysteresis logic are employed to prevent unnecessary mode changes, reducing computational overhead while maintaining content visibility and tracking accuracy.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs self-service by automatically detecting occlusion conditions and positional changes, then autonomously switching locked modes without requiring manual intervention. This self-managing approach reduces the perceived complexity for users while maintaining system performance through automated adaptation.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS20230386093A1Changing Locked Modes Associated with Display of Computer-Generated Content
Publication Date: 2023.11.30 APPLE INC
  • US20230386093A1 patent drawing
  • US20230386093A1 patent drawing
  • US20230386093A1 patent drawing

AI summary

A method is performed at an electronic device with one or more processors, a non-transitory memory, and a display. The method includes, while displaying, on the display, the computer-generated content according to a first locked mode, determining that the electronic device changes from a first distance to a physical surface to a second distance from the physical surface. The method includes, in accordance with a determination that the second distance satisfies a locked mode change criterion, changing display of the computer-generated content from the first locked mode to a second locked mode. The method includes, in accordance with a determination that the second distance does not satisfy the locked mode change criterion, maintaining display of the computer-generated content according to the first locked mode. Examples of the locked mode change criterion include an occlusion criterion and a remoteness criterion.