XR Proximity Detection via Segmented Visual Cues

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Users participating in immersive extended reality experiences may be distracted from their physical surroundings, leading to unawareness of objects in the environment due to the immersive nature of the experience.

Innovation Solution

The system modifies the display presentation to indicate physical objects in proximity by quantizing the environment into blocks and using sensor data from depth cameras or LIDAR to determine occupied status, applying visual treatments such as animations or color changes when a predetermined distance is reached, allowing users to be aware of their physical environment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If immersive XR content is presented to enhance user engagement, then user immersion and engagement are improved, but user awareness of physical surroundings deteriorates

Engineering Contradiction:

Improveuser engagementVSAvoiduser awareness of physical surroundings

Core Design Contradiction:

ProductivityVSLoss of information

Solution Approach 1:

The display is segmented into multiple regions: a central XR content display area and peripheral indicator regions. The peripheral regions display visual indicators that communicate physical object proximity information, allowing users to maintain awareness of surroundings without leaving the immersive XR experience. This spatial segmentation enables simultaneous presentation of XR content and environmental awareness cues.

Inventive Principle:

Principle #1Segmentation

Solution Approach 2:

Visual indicators serve as intermediary elements between the XR content and physical environment. These indicators translate sensor data about physical objects into visual cues that appear within the XR display boundaries, mediating the connection between virtual and physical worlds and enabling users to perceive physical surroundings through the XR interface.

Inventive Principle:

Principle #24Intermediary (Mediator)

2Loss of information

If visual indicators are added to the display to show physical objects, then user awareness of physical objects is improved, but display complexity increases

Engineering Contradiction:

Improveuser awareness of physical objectsVSAvoiddisplay complexity

Core Design Contradiction:

Loss of informationVSDevice complexity

Solution Approach 1:

Different regions of the display have different functional qualities. The central region presents immersive XR content with high visual fidelity, while peripheral regions provide simplified visual indicators for physical object detection. This local differentiation allows each area to optimize for its specific purpose without compromising overall system complexity.

Inventive Principle:

Principle #3Local quality

Solution Approach 2:

Instead of displaying complete information about physical objects throughout the entire display, the system applies visual indicators only to peripheral regions where physical objects are detected. This partial application of visual treatment reduces processing requirements and display complexity while maintaining sufficient user awareness.

Inventive Principle:

Principle #16Partial or excessive action

3Measurement precision

If sensor data processing is enhanced to detect physical objects, then detection accuracy is improved, but computational resources increase

Engineering Contradiction:

Improvephysical object detection accuracyVSAvoidcomputational resources

Core Design Contradiction:

Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system performs preliminary actions by continuously monitoring sensor data and pre-processing information to identify potential physical objects before they require full attention. This allows the system to maintain detection accuracy while reducing real-time computational burden by preparing data structures and spatial maps in advance.

Inventive Principle:

Principle #10Preliminary action

Solution Approach 2:

The sensor system serves itself by automatically generating and updating spatial maps and object detection data without requiring constant external processing intervention. The system leverages its own sensor outputs to maintain awareness of the physical environment, reducing the need for additional computational resources from external sources.

Inventive Principle:

Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enhances user awareness of physical objects in their environment by providing visual cues during immersive experiences without disrupting the XR content, ensuring safety and awareness of surroundings.

Implementation Method 1

sensor data from depth cameras or LIDAR

Methodology Applied

Scientific EffectLIDAR: LIDAR

Data Source

PatentUS20240005511A1Immediate Proximity Detection and Breakthrough with Visual Treatment

Publication Date: 2024.01.04 APPLE INC

AI summary

Providing a visual treatment based on proximity to an obstruction includes collecting, by a device, a sensor data for an environment, determining a status for each of a plurality of regions of the environment, where at least one region of the environment is assigned an occupied status, and in accordance with a determination that the device satisfies a predetermined closeness threshold to the at least one region of the environment assigned an occupied status, causing a visual treatment to be rendered by the device, where the visual treatment indicates a location of the at least one region of the environment having an occupied status.