Augmented View Generation for Obstructed Navigation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current navigation systems fail to provide users with relevant information when their view of a destination is obstructed by environmental obstacles, such as buildings or vehicles, which can lead to distraction and decreased safety while navigating.

Innovation Solution

A navigation system that captures and overlays an unobstructed image of a location of interest onto the user's real-time field of view using a camera and database images, allowing the user to see through obstructions by determining an appropriate image capture location and direction, and processing the image to match the user's perspective, thereby enabling continuous attention to surroundings.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If the user views database images of the navigation route on a mobile device, then the user becomes more familiar with the environment, but the user's ability to safely navigate surroundings is compromised due to distraction

Engineering Contradiction:
Improvenavigation information visibilityVSAvoiduser safety
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The patent introduces an intermediary system (augmented reality display mounted on the vehicle) that mediates between the navigation information and the user's field of view. This intermediary projects images onto a surface visible to the user without requiring the user to interact with a handheld device, thus maintaining safety while providing navigation information.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Loss of information

If current augmented reality systems overlay information on objects in the surrounding area, then the user can view navigation information in real-time, but the system cannot provide information when obstructions block the user's field of view

Engineering Contradiction:
Improvelocation of interest visibilityVSAvoidobstruction handling capability
Core Design Contradiction:
Loss of informationVSAdaptability or versatility

Solution Approach 1:

The patent applies preliminary action by capturing images of the location of interest from multiple perspectives and storing them in advance. When the user approaches a location that may be obstructed, the system has pre-captured images ready to be displayed, eliminating the need for real-time line-of-sight access to the location.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent creates copies of the location of interest from different viewpoints and displays the appropriate copy based on the user's position and potential obstructions. This allows the user to see a representation of the location even when the actual location is blocked from view.

Inventive Principle:
Principle #26Copying

3Loss of information

If the user stops walking or driving to operate a mobile device and view navigation images, then the user can view the navigation route clearly, but the navigation process is interrupted and time is lost

Engineering Contradiction:
Improvenavigation route visibilityVSAvoidnavigation continuity
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent ensures continuity of useful action by providing navigation information in a continuous, hands-free manner through the augmented reality display. The user can view navigation images while maintaining their current activity (walking or driving) without interruption, eliminating stops and maintaining continuous navigation flow.

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentEP2911041B1Generating an augmented view of a location of interest
Publication Date: 2020.07.08 HARMAN INT IND INC
  • EP2911041B1 patent drawingFigure 1A~1C
  • EP2911041B1 patent drawingFigure 2
  • EP2911041B1 patent drawingFigure 3A~3B

AI summary

One embodiment of the present invention sets forth a technique for generating an augmented view of a location of interest (110) for a user. The technique includes determining an image capture location based on the location of interest, and determining an image capture direction based on the image capture location. The technique further includes receiving an image (112) associated with the image capture location and the image capture direction. The technique further includes processing the image based on a line of sight associated with a location of the user to generate a processed image and displaying the processed image to the user. Advantageously, the disclosed techniques enable a user to see through obstructions in the surrounding environment to view a location of interest.