Perspective-Based Content Placement in Augmented Reality

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current augmented reality systems fail to preserve the three-dimensional structure of the real world, leading to unintuitive experiences due to their inability to account for the three-dimensional structure of geographical areas, which results in suboptimal content placement and rendering.

Innovation Solution

A method that processes and decomposes three-dimensional models of geographical objects into simplified surfaces, selecting portions based on visibility statistics from various viewpoints to create content placement layers that support perspective-based rendering, allowing for intuitive and accurate placement of digital content within the real-world context.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If current augmented reality systems place augmentations based solely on latitude and longitude positions, then the system is simple to implement, but the three-dimensional structure of the real world is not preserved and the user experience is suboptimal

Engineering Contradiction:
Improveuser experience qualityVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent segments the real-world scene into multiple depth layers by processing images through convolutional neural networks to generate depth maps. These depth layers represent different distances from the camera, allowing augmentations to be placed at appropriate depth positions rather than a single flat plane, thereby preserving three-dimensional structure while maintaining manageable system complexity

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from two-dimensional latitude-longitude positioning to three-dimensional spatial positioning by incorporating depth information. The system generates depth maps and calculates three-dimensional coordinates for augmentation placement, adding the depth dimension to the traditional flat mapping approach, which preserves the three-dimensional structure of the real world and improves user experience

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Reliability

If augmentations are rendered without considering three-dimensional structure, then the rendering process is computationally simpler, but the augmentations are seen through real world objects leading to unintuitive augmented reality

Engineering Contradiction:
Improveaugmentation placement accuracyVSAvoidcomputational power
Core Design Contradiction:
ReliabilityVSPower

Solution Approach 1:

The patent performs preliminary processing by generating depth maps and identifying real-world objects before rendering augmentations. The system pre-calculates depth information, object boundaries, and occlusion relationships, allowing the rendering process to efficiently place augmentations at correct three-dimensional positions without requiring complex real-time calculations during augmentation rendering

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces depth maps as an intermediary representation between the real-world scene and the augmentation rendering process. These depth maps serve as a mediator that encodes three-dimensional structural information, enabling the system to accurately determine augmentation placement and occlusion relationships without requiring direct complex geometric calculations between all objects and augmentations

Inventive Principle:
Principle #24Intermediary (Mediator)

3Manufacturing precision

If the system processes detailed three-dimensional models to create accurate content placement layers, then the perspective-based rendering accuracy is improved, but the processing time and computational resources increase

Engineering Contradiction:
Improvecontent placement precisionVSAvoidprocessing time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The patent creates simplified depth map representations that copy the essential three-dimensional structural information from complex real-world scenes. Instead of processing full detailed three-dimensional models, the system generates compressed depth maps that retain sufficient geometric information for accurate content placement while requiring significantly less computational processing time

Inventive Principle:
Principle #26Copying

Data Source

PatentEP2798617B1Method and apparatus for providing perspective-based content placement
Publication Date: 2021.09.15 HERE GLOBAL BV
  • EP2798617B1 patent drawingFigure 1
  • EP2798617B1 patent drawingFigure 2
  • EP2798617B1 patent drawingFigure 3

AI summary

An approach is provided for providing perspective-based content placement. A content placement platform processes and/or facilitates a processing of one or more models of one or more objects associated with a geographical area to cause, at least in part, a decomposition of the one or more models into one or more simplified surfaces. The content placement platform further causes, at least in part, a selection of one or more portions of the one or more simplified surfaces as one or more content placement layers based, at least in part, on one or more viewpoints, with the one or more content placement layers supporting a perspective-based rendering of one or more content items associated with the one or more objects.