AR Route Guidance With MR Scene Switching for Occluded Roads
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Augmented Reality (AR) and Mixed Reality (MR) technologies face challenges in providing accurate route guidance due to environmental obstacles and discrepancies between virtual and real-world imagery, especially in adverse weather or complex traffic conditions, limiting their effectiveness in displaying lane information and 3D map accuracy.
Innovation Solution
A route guidance device and system that integrates a communication unit, interface unit, AR module, MR module, and processor to render and control AR/MR views based on sensor data, switching between AR and MR modes to ensure accurate route guidance, and display additional information like POI and route history.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a general-purpose navigation device is used, then it can provide basic route guidance, but it cannot provide appropriate guidance for specific situations such as construction zones or special events
Solution Approach 1:
The patent introduces an intermediary component (route information provision unit) that mediates between the general navigation system and situation-specific requirements. This unit receives route information from external servers and overlays it on the AR display, enabling adaptability to construction zones, events, and other special situations without requiring the entire navigation system to be redesigned for each scenario.
Solution Approach 2:
The navigation device is designed with multi-functionality by integrating both general route guidance capabilities and situation-specific information display through the same AR interface. The system can universally handle different types of route information (standard navigation, construction zone warnings, event notifications) through a unified architecture, eliminating the need for separate specialized devices.
2Loss of information
If detailed route information is displayed on traditional screens, then users can see navigation instructions, but users must shift their eyes from the road to the screen
Solution Approach 1:
The patent transitions navigation information from a traditional 2D screen to a 3D augmented reality overlay that appears to float in the driver's field of view. Route guidance information is projected onto a virtual surface in space, allowing drivers to see navigation instructions without shifting their eyes from the road, effectively adding a spatial dimension to information display.
Solution Approach 2:
The system replaces the mechanical eye-shifting action required by traditional screens with an optical field-based AR display. Instead of requiring physical head or eye movement to view information, the navigation data is rendered as light fields that can be viewed peripherally or directly without breaking visual contact with the road.
3Ease of operation
If AR displays show route guidance information, then drivers can see navigation without shifting eyes, but the accuracy of location recognition may be insufficient
Solution Approach 1:
The patent merges multiple recognition systems (image recognition, GPS location data, inertial sensors) into a unified location determination system. The image recognition unit captures visual features of the environment, while the GPS and sensor data provide positional context, and these are combined through data fusion algorithms to achieve accurate location recognition that supports precise AR overlay positioning.
Solution Approach 2:
The system implements feedback loops where the AR display position and orientation are continuously adjusted based on real-time location recognition results. As the vehicle moves, the system constantly updates the perceived location by comparing expected AR positions with actual sensor data, and makes corrective adjustments to maintain accurate alignment of navigation information with the physical environment.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The present invention provides a route guidance device and a route guidance system. The route guidance device according to an embodiment of the present invention comprises: a communication part that communicates with a cloud server; an interface part that receives, from at least one sensor provided in a vehicle, a camera image including an image of a road on which the vehicle is traveling, and sensing information obtained by sensing a driving state of the vehicle; an MR module that renders MR information including at least one virtual object on the basis of the camera image, the sensing information, and map information received from the cloud server; and a processor that controls the interface part such that an MR view image including the MR information is displayed on a display part of the vehicle, wherein the processor, when a preset condition is satisfied, changes the MR view image to display a scene corresponding to a place at which the vehicle is to travel.