AR Proximity Layers for Depth Crowding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In augmented reality (AR) experiences on two-dimensional screens, depth crowding leads to difficulty in selecting and interacting with densely populated AR content, as objects and information are overlapped, making it challenging for users to access and engage with the content without inadvertently selecting other elements.

Innovation Solution

A hierarchical AR interface with a gesture-based system using proximity layers organizes AR content into stacked planes based on user proximity, allowing intuitive access and selection by triggering display of relevant content when the user approaches specific objects or locations, while suppressing less relevant content.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If multiple AR objects are displayed in close proximity on a 2D screen, then the information density and content richness are improved, but the user's ability to select and interact with specific objects deteriorates due to overlapping and clutter

Engineering Contradiction:
Improveinformation densityVSAvoidselection accuracy
Core Design Contradiction:
Quantity of substanceVSEase of operation

Solution Approach 1:

The patent applies depth-based layering to organize AR objects into multiple proximity layers along the depth axis. Objects are distributed across foreground, midground, and background layers based on their spatial proximity to the user, allowing dense information to be presented without visual clutter by separating overlapping objects into different depth planes.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent segments the AR interface into multiple proximity layers, dividing the dense set of AR objects into distinct groups based on their spatial relationships. This segmentation allows users to interact with objects in the foreground layer without interference from background objects, resolving the selection accuracy problem while maintaining high information density.

Inventive Principle:
Principle #1Segmentation

2Loss of information

If all AR content is displayed simultaneously, then complete information availability is improved, but user focus and interaction clarity deteriorate due to visual clutter and overlapping elements

Engineering Contradiction:
Improveinformation availabilityVSAvoidcontent distinguishability
Core Design Contradiction:
Loss of informationVSDifficulty of detecting and measuring

Solution Approach 1:

The patent implements dynamic visibility control where AR objects in different proximity layers are selectively displayed or hidden based on user proximity and interaction state. As users move closer to or interact with specific objects, the system dynamically adjusts which layers are visible, maintaining information availability while improving distinguishability through contextual filtering.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent applies different display qualities and visibility states to different regions of the AR interface based on their proximity to the user. Foreground objects receive full visibility and interaction priority, while background objects are dimmed or hidden, creating local quality variations that enhance content distinguishability without losing overall information availability.

Inventive Principle:
Principle #3Local quality

3Productivity

If AR objects are placed close together to maximize screen utilization, then the device complexity and interface efficiency are improved, but the reliability of accurate selection and interaction deteriorates

Engineering Contradiction:
Improveinterface efficiencyVSAvoidinteraction accuracy
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent resolves the conflict between interface efficiency and interaction accuracy by utilizing the depth dimension to separate densely packed AR objects. Objects that would overlap on the 2D screen are distributed across multiple proximity layers, allowing users to reliably select and interact with specific objects while maintaining high screen utilization and interface efficiency.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentEP3764200B1Traversing photo-augmented information through depth using gesture and UI controlled occlusion planes
Publication Date: 2023.09.06 GOOGLE LLC
  • EP3764200B1 patent drawingFigure 1
  • EP3764200B1 patent drawingFigure 2
  • EP3764200B1 patent drawingFigure 3

AI summary

Systems and methods are described that obtain depth data associated with a scene captured by an electronic device, obtain location data associated with a plurality of physical objects within a predetermined distance of the electronic device, generate a plurality of augmented reality objects configured to be displayed over a portion of the plurality of physical objects, and generate a plurality of proximity layers corresponding to the at least one scene, wherein a respective proximity layer is configured to trigger display of the auxiliary data corresponding to AR objects associated with the respective proximity layer while suppressing other AR objects.