Augmented Reality Object Annotation Without Obscuration

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Augmented reality systems face challenges with visual clutter and obscuration of real-world objects due to traditional overlay methods, making it difficult to match additional information with the actual objects in view, especially on portable devices with small displays.

Innovation Solution

A method and apparatus that acquire images, identify objects of interest, and provide indications of additional information without obscuring the objects, using a portable device with an image capture device, location circuitry, and a display that allows for highlighting and non-obstructive presentation of information through various orientations and gestures.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If traditional overlay methods are used to display additional information, then information availability is improved, but visual clarity and object visibility deteriorate due to obscuration and visual clutter

Engineering Contradiction:
Improveinformation availabilityVSAvoidvisual clutter and obscuration
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The patent segments the display into multiple functional zones: a main view area for displaying the real-world scene captured by the image capture device, and a separate side panel or popup area for displaying additional information about identified objects. This segmentation prevents information overlays from obscuring the actual objects in the main view, resolving the contradiction between information availability and visual clarity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent moves additional information display from the two-dimensional overlay space (which causes obscuration) to a separate spatial dimension - either a side panel adjacent to the main view or a popup window in a different location. This dimensional separation allows users to access information without the text blocking the real-world objects, thus maintaining both information availability and visual clarity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Weight of moving object

If portable devices with small displays are used, then device portability is improved, but information presentation capability deteriorates due to limited display area

Engineering Contradiction:
Improvedevice portabilityVSAvoiddisplay area
Core Design Contradiction:
Weight of moving objectVSArea of stationary object

Solution Approach 1:

The patent divides the limited display area into functional segments: the primary image capture device view occupies the main display area for real-world visualization, while additional information is presented in a condensed side panel or collapsed state. This segmentation allows the device to remain portable with a small display while still providing comprehensive information when needed.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent implements dynamic display behavior where additional information can be expanded or collapsed based on user interaction. Information panels can be minimized to conserve display space for the real-world view, or expanded when users need detailed information about specific objects. This dynamic adaptation allows the small display to efficiently serve both portability and information presentation requirements.

Inventive Principle:
Principle #15Dynamics

3Adaptability or versatility

If multiple objects are present in the view, then scene complexity is improved, but information matching accuracy deteriorates due to difficulty in matching information with correct objects

Engineering Contradiction:
Improvescene complexityVSAvoidinformation matching accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The patent segments the display of multiple objects by providing individual, separate information panels for each identified object rather than using overlapping overlays. Each object's information is clearly delimited and associated with its corresponding visual representation, making it easy for users to match information with the correct object even when multiple objects are present in the scene.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces visual intermediaries such as bounding boxes, icons, or reference markers that link the additional information panels to their corresponding objects in the main view. These intermediaries act as mediators that help users accurately match information with the correct objects, especially when multiple objects are present, thereby improving information matching accuracy without limiting scene complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10133438B2User interface for augmented reality
Publication Date: 2018.11.20 NOKIA TECHNOLOGIES OY
  • US10133438B2 patent drawing
  • US10133438B2 patent drawing
  • US10133438B2 patent drawing

AI summary

The disclosed embodiments are directed to a method, an apparatus, and a user interface. The disclosed embodiments include acquiring an image, identifying one or more objects of interest in the image, and providing an indication that additional information is available for the one or more of the objects of interest without obscuring the one or more objects of interest.