AR-MR Route Guidance Display for Adverse Driving Conditions

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Augmented Reality (AR) and Mixed Reality (MR) technologies face challenges in providing accurate route guidance due to environmental factors like rain, snow, and complex traffic situations, leading to discrepancies between virtual objects and the real world, while MR struggles to display small objects accurately.

Innovation Solution

A route guidance device and system that integrates AR and MR modules, using sensors and a cloud server to provide accurate guidance by splitting the display into areas for AR and MR views, adjusting camera calibration, and overlaying MR information on AR, based on vehicle conditions and environment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If a general-purpose smartphone is used for navigation, then device cost is reduced, but navigation accuracy and reliability deteriorate due to inability to accurately identify user's line of sight

Engineering Contradiction:
Improvedevice costVSAvoidnavigation accuracy
Core Design Contradiction:
Ease of manufactureVSReliability

Solution Approach 1:

The patent applies universality by using a general-purpose smartphone as the base device for navigation, making the system accessible to ordinary consumers without requiring specialized expensive equipment. The smartphone's camera and processing capabilities are leveraged for multiple functions including AR rendering, line of sight detection, and navigation display.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces an intermediary mechanism (line of sight detection algorithm and AR overlay system) that mediates between the smartphone's general capabilities and the specific navigation requirements. This intermediary layer enables accurate line of sight identification and route guidance without requiring specialized hardware modifications to the smartphone.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Device complexity

If traditional 2D map display is used, then device complexity is reduced, but ease of operation deteriorates due to difficulty in understanding spatial relationships

Engineering Contradiction:
Improvedisplay system complexityVSAvoidspatial understanding
Core Design Contradiction:
Device complexityVSEase of operation

Solution Approach 1:

The patent applies dimensionality change by transitioning from traditional 2D map display to 3D augmented reality visualization. Routes and landmarks are rendered in three-dimensional space overlaid on the real-world camera view, providing intuitive spatial relationships and improving ease of operation without significantly increasing device complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Ease of operation

If augmented reality rendering is implemented, then ease of operation is improved through intuitive spatial display, but device complexity increases due to additional processing requirements

Engineering Contradiction:
Improvespatial display intuitivenessVSAvoidprocessing complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent applies self-service by utilizing the smartphone's existing hardware capabilities (camera, GPS, processor, display) to perform AR rendering and line of sight detection without requiring additional specialized components. The system leverages what the device already has to provide enhanced functionality, minimizing the increase in device complexity.

Inventive Principle:
Principle #25Self-service

Data Source

PatentEP4372316B1Route guidance device and route guidance system based on augmented reality and mixed reality
Publication Date: 2026.05.06 LG ELECTRONICS INC
  • EP4372316B1 patent drawingFigure 1
  • EP4372316B1 patent drawingFigure 2
  • EP4372316B1 patent drawingFigure 3

AI summary

The present invention relates to a route guidance device comprising: a communication unit for communicating with a cloud server; an interface unit which receives, from at least one sensor, an image of a vehicle-adjacent environment, including a road image, and sensing information obtained by sensing the driving state of a vehicle; an AR module for rendering AR information by using the sensing information and POI information received from the cloud server; an MR module for rendering, on the basis of the sensing information and map information received from the cloud server, MR information including a virtual object; and a processor for controlling the interface unit so that an AR view image including the AR information and an MR view image including the MR information are displayed on a display unit of the vehicle, and controlling, on the basis of whether the vehicle enters a specific situation, the interface unit so that a second view image is displayed on a part of the display unit area on which a first view image among the AR view image and the MR view image is displayed.