Head-Mounted AR Display Spatial Marker Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Head-mounted electronic devices struggle to seamlessly integrate augmented reality displays with real-world views, often obscuring the underlying real-world objects with higher detail and control limitations compared to traditional computing device screens.

Innovation Solution

A head-mountable apparatus with a processor, camera, and spatial location tracking mechanism that registers with a computing device to display items coherently, allowing users to control and view augmented reality images on a transparent panel while maintaining visibility of the computing device screen by identifying spatial markers and preventing image overlap.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If augmented reality images are displayed on the transparent panel with higher detail, then information visibility is improved, but real-world objects become obscured

Engineering Contradiction:
Improveinformation visibilityVSAvoidreal-world object obscuration
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The display area is segmented into multiple zones: a first area for augmented reality content and a second area for the computing device screen. This spatial segmentation allows both AR images and real-world views to coexist without mutual obstruction, resolving the contradiction between information visibility and real-world object clarity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different regions of the transparent panel are assigned different functional qualities: the first area displays AR content with specific visual characteristics while the second area remains transparent to show the computing device screen. This local differentiation enables each zone to optimize its purpose without compromising the other.

Inventive Principle:
Principle #3Local quality

2Ease of operation

If augmented reality display control is enhanced on the head-mountable apparatus, then user control capability is improved, but device complexity increases

Engineering Contradiction:
Improveuser control capabilityVSAvoiddevice complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The control functions for both the head-mountable apparatus and the computing device are merged into a unified system. Users can control AR content on the transparent panel and screen content on the computing device through a single interface, simplifying operation while distributing complexity across two coordinated devices rather than concentrating it in one.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The transparent panel serves as an intermediary between the head-mountable apparatus and the computing device. It relay control signals and display information from both sources, enabling integrated control without requiring direct complex interaction between the apparatus and device, thus reducing overall system complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11269183B2Display information on a head-mountable apparatus corresponding to data of a computing device
Publication Date: 2022.03.08 MICROSOFT TECHNOLOGY LICENSING LLC
  • US11269183B2 patent drawing
  • US11269183B2 patent drawing
  • US11269183B2 patent drawing

AI summary

According to examples, an apparatus may include a camera, a transparent panel, and a processor being mounted on a housing to be mounted on a user's head. The processor may access an image captured by the camera of a label and spatial markers displayed on a screen of a computing device, determine data identified in the label, communicate the determined data to an information source, receive, from the information source, information corresponding to the determined data, determine locations of the spatial markers with respect to a display area of the panel, identify a section of the display area defined by the spatial markers, and display an item corresponding to the received information on the panel outside of the identified section.