AR-MR Route Guidance Display for Weather and View-Angle Gaps
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Augmented Reality (AR) and Mixed Reality (MR) technologies face challenges in providing accurate route guidance due to environmental factors like rain, snow, and complex traffic situations, leading to discrepancies between virtual objects and the real world, and MR struggles to display small or moving objects accurately.
Innovation Solution
A route guidance device and system that integrates AR and MR modules, using sensors and a cloud server to provide accurate guidance by splitting the display into areas for AR and MR views, with the AR view showing objects within a viewing angle and MR providing information outside it, and adjusting based on vehicle state and environment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If AR technology is used to provide route guidance information based on real-world images, then the driver can intuitively recognize the vehicle and traveling environment, but route guidance information cannot be accurately identified due to obstacles such as rain, snow, shadows, or complex traffic situations
Solution Approach 1:
The patent introduces map information as an intermediary element that mediates between the AR display and the real-world environment. When environmental obstacles prevent accurate identification of route guidance information in real-world images, the system supplements or replaces AR information with corresponding map information, ensuring continuous accurate guidance regardless of environmental conditions.
Solution Approach 2:
The system performs preliminary processing by pre-acquiring and storing map information that corresponds to the vehicle's traveling route. This pre-prepared information is ready to be immediately displayed when environmental conditions deteriorate, eliminating the need for real-time image processing under adverse conditions and ensuring continuous accurate route guidance.
2Reliability
If MR technology is used to provide route guidance information through digitized 3D maps, then various types of information can be provided regardless of real-world image quality, but discrepancy may occur between the 3D map image and the real world around the vehicle
Solution Approach 1:
The patent merges AR technology and MR technology into a unified route guidance system. The system combines real-world images processed through AR with digitized 3D map information from MR, allowing the strengths of both technologies to complement each other. AR provides accurate spatial correspondence when environmental conditions are good, while MR ensures reliable information provision when conditions deteriorate.
Solution Approach 2:
The system dynamically adjusts the balance between AR and MR information display based on environmental conditions. When real-world images are clear and obstacles are absent, the system prioritizes AR display for accurate spatial correspondence. When environmental obstacles appear, the system transitions to MR display for reliable information provision, creating a dynamic adaptation mechanism.
3Area of stationary object
If only AR technology is used, then objects within the viewing angle can be displayed, but objects outside the viewing angle or small moving objects cannot be displayed
Solution Approach 1:
The patent transitions from the two-dimensional AR view limited by the camera's viewing angle to a three-dimensional map-based view. The digitized 3D map provides omnidirectional information about the surrounding environment, allowing the system to display objects located anywhere relative to the vehicle, not just those within the camera's field of view.
Data Source
AI summary
The present invention relates to a route guidance device comprising: a communication unit for communicating with a cloud server; an interface unit which receives, from at least one sensor, an image of a vehicle-adjacent environment, including a road image, and sensing information obtained by sensing the driving state of a vehicle; an AR module for rendering AR information by using the sensing information and POI information received from the cloud server; an MR module for rendering, on the basis of the sensing information and map information received from the cloud server, MR information including a virtual object; and a processor for controlling the interface unit so that an AR view image including the AR information and an MR view image including the MR information are displayed on a display unit of the vehicle, and controlling, on the basis of whether the vehicle enters a specific situation, the interface unit so that a second view image is displayed on a part of the display unit area on which a first view image among the AR view image and the MR view image is displayed.