AR View Segmentation for Ergonomic Virtual Information Overlay

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing augmented reality methods for mobile devices struggle with providing an ergonomic representation of points of interest in real environments, often restricting the user's field of view and overwhelming them with information, especially when using small screens and improper scaling of virtual objects.

Innovation Solution

A method that subdivides the view of a real environment into regions, allowing virtual information to be overlaid differently in each area based on proximity, using GPS and orientation sensors to determine the system's pose, and considering weather data to enhance the realism and usability of the interface.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If virtual information is overlaid uniformly across the entire view, then the information representation is simple, but the user becomes overwhelmed and the interface becomes cluttered

Engineering Contradiction:
Improveinformation representation completenessVSAvoiduser interface clarity
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The display area is divided into multiple regions (first region, second region, third region) based on distance from the system setup. Different types of virtual information are selectively overlaid in different regions, allowing comprehensive information representation while maintaining interface clarity in each specific area.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different regions of the display are assigned different qualities of virtual information overlay. The first region (closest to system setup) receives one type of virtual information, the second region receives another type, and the third region receives yet another type, optimizing the information presentation for each local area rather than applying a uniform approach.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If the size of virtual objects is scaled to be visible at large distances, then remote elements become distinguishable, but the interface becomes cluttered and unclean

Engineering Contradiction:
Improvedistance perception accuracyVSAvoidinterface complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The display is segmented into multiple distance-based regions, with each region containing virtual objects scaled appropriately for its distance from the system setup. This allows remote elements to be visible and distinguishable without requiring all objects to be uniformly large, thus avoiding interface clutter.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Each region is assigned a specific scaling quality appropriate to its distance from the system setup. Virtual objects in farther regions are scaled differently than those in nearer regions, maintaining visibility and distinguishability while preserving a clean interface appearance.

Inventive Principle:
Principle #3Local quality

3Loss of information

If a bird's eye view is used to show points of interest, then the overview is provided, but the user's field of view is restricted and the interface becomes complex

Engineering Contradiction:
Improvespatial overview completenessVSAvoidfield of view accessibility
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The spatial overview is segmented into multiple distance-based regions rather than presenting a single bird's eye view. This allows users to maintain their natural field of view while receiving comprehensive spatial information organized by distance zones.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Instead of using a traditional 2D bird's eye view that restricts the user's natural field of view, the patent organizes spatial information along the depth dimension by creating multiple regions at different distances from the system setup, providing overview without field of view restriction.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS20230290083A1Method for representing virtual information in a real environment
Publication Date: 2023.09.14 APPLE INC
  • US20230290083A1 patent drawing
  • US20230290083A1 patent drawing
  • US20230290083A1 patent drawing

AI summary

The invention relates to a method for ergonomically representing virtual information in a real environment, including the following steps: providing at least one view of a real environment and of a system setup for blending in virtual information for superimposing with the real environment in at least part of the view, the system setup comprising at least one display device, ascertaining a position and orientation of at least one part of the system setup relative to at least one component of the real environment, subdividing at least part of the view of the real environment into a plurality of regions comprising a first region and a second region, with objects of the real environment within the first region being placed closer to the system setup than objects of the real environment within the second region, and blending in at least one item of virtual information on the display device in at least part of the view of the real environment, considering the position and orientation of said at least one part of the system setup, wherein the virtual information is shown differently in the first region than in the second region with respect to the type of blending in the view of the real environment.