Augmented Reality Out-of-View Object Indication

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Augmented reality computing devices have a limited field of view, causing users to miss out on virtual information associated with objects located outside this field, such as behind them, leading to unawareness of nearby objects with relevant augmented reality data.

Innovation Solution

The implementation of an augmented reality display device that provides visual or audio indications of objects outside the user's field of view, using a combination of sensors like outward-facing image sensors, gaze detection, and motion sensors to alert the user to the presence and location of such objects, allowing for interaction with information in an extended surrounding space.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If the field of view of the augmented reality display device is limited, then the device complexity is reduced and the display system is simplified, but the user loses awareness of objects located outside the field of view

Engineering Contradiction:
Improvedisplay system complexityVSAvoidawareness of out-of-view objects
Core Design Contradiction:
Device complexityVSLoss of information

Solution Approach 1:

The patent extends the limited 2D field of view into a 360-degree spatial awareness system by using multiple sensors (outward-facing image sensors, motion sensors, gaze detection) to detect objects in all directions around the user. This transforms the information display from a single-plane limitation to a multi-dimensional spatial mapping system that provides omnidirectional object detection and notification.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If the field of view is expanded to include all surrounding objects, then awareness of out-of-view objects is improved, but the device complexity and energy consumption increase

Engineering Contradiction:
Improveawareness of out-of-view objectsVSAvoidsensor and processing system complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent divides the surrounding environment into multiple detection zones using outward-facing image sensors positioned at different locations. Each sensor segment covers a specific angular range, and the system processes information from these segmented zones independently. This segmentation allows comprehensive 360-degree monitoring while distributing the processing load and reducing the complexity of any single sensor system.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent employs multi-functional sensor systems that serve multiple purposes: outward-facing image sensors detect objects, motion sensors track user movement, and gaze detection monitors user attention. These universal components handle both in-field and out-of-field object detection, as well as user interaction tracking, reducing the need for separate specialized systems and thereby reducing overall device complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Loss of information

If visual or audio indications are provided for out-of-view objects, then user awareness and interaction capability are enhanced, but the ease of operation is reduced due to additional interface elements

Engineering Contradiction:
Improveinformation about out-of-view objectsVSAvoiduser interface simplicity
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent introduces audio indications as an intermediary channel to convey information about out-of-view objects without requiring complex visual interface elements. Audio notifications serve as a mediator between the external environment and the user's awareness, providing object location and identification information through sound rather than additional visual clutter, thereby maintaining interface simplicity while enhancing information delivery.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS9761057B2Indicating out-of-view augmented reality images
Publication Date: 2017.09.12 MICROSOFT TECHNOLOGY LICENSING LLC
  • US9761057B2 patent drawing
  • US9761057B2 patent drawing
  • US9761057B2 patent drawing

AI summary

Embodiments are disclosed that relate to operating a user interface on an augmented reality computing device comprising a see-through display system. For example, one disclosed embodiment includes identifying one or more objects located outside a field of view of a user, and for each object of the one or more objects, providing to the user an indication of positional information associated with the object.