AR-MR Route Guidance Switching for Obscured Driving Conditions
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Augmented Reality (AR) and Mixed Reality (MR) technologies face challenges in providing accurate route guidance due to environmental complexities, such as bad weather and road conditions, leading to discrepancies between displayed information and the real world, with MR struggling to accurately represent small or dynamic objects like people and animals.
Innovation Solution
A route guiding device and system that combines AR and MR capabilities, using sensors and a cloud server to render AR and MR information, with a processor controlling the display to adapt the view image based on real-time sensing information, ensuring accurate and comprehensive route guidance by switching between AR and MR views when necessary.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If AR technology is used to provide route guidance information based on real-world images, then the driver can intuitively recognize the vehicle and traveling environment, but route guidance information cannot be accurately identified due to obstacles such as rain, snow, shadows, or vehicles ahead
Solution Approach 1:
The patent combines AR and MR technologies into a unified route guidance system. The AR module processes real-world images for intuitive display, while the MR module generates virtual 3D map views. The system dynamically switches between or merges these modules based on environmental conditions, allowing the driver to benefit from both the intuitive real-world overlay and the reliable virtual map representation when real-world images are obscured by rain, snow, shadows, or traffic
Solution Approach 2:
The MR module acts as an intermediary when AR fails. The system detects when real-world images are insufficient (due to weather or traffic obstacles) and transitions to the MR module, which provides a virtual 3D map view that is not affected by real-world obstructions. This intermediary approach ensures continuous reliable route guidance information delivery
2Reliability
If MR technology is used to provide route guidance through virtual objects on a digitized 3D map, then information can be provided regardless of real-world image quality, but discrepancy may occur between the graphic object and the real environment
Solution Approach 1:
The system dynamically adjusts between AR and MR modules based on real-world conditions. When real-world images are clear and correspondence is good, the system uses AR for accurate real-time positioning. When conditions deteriorate, it transitions to MR for reliable information delivery. This dynamic switching optimizes both reliability and precision depending on environmental factors
Solution Approach 2:
The system continuously monitors the quality and correspondence of real-world images and adjusts its operation accordingly. When discrepancy between AR overlay and real environment is detected (due to weather, shadows, or obstacles), the system provides feedback to switch to or enhance MR module usage, ensuring that route guidance remains accurate and reliable
3Illumination intensity
If only AR is used to display route guidance information, then real-time environment can be visualized, but information outside the viewing angle cannot be provided
Solution Approach 1:
The system adds a third dimension to route guidance by incorporating the MR module's virtual 3D map view. While AR provides a 2D overlay limited to the camera's viewing angle, the MR module generates a 3D virtual environment that can display information beyond the immediate field of view, including upcoming intersections, routes, and environmental context that cannot be captured in the current camera view
Data Source
AI summary
The present invention provides a route guiding device and a route guiding system. A route guiding device, according to one embodiment of the present invention, comprises: a communication unit which communicates with a cloud server; an interface unit which receives, from at least one sensor provided in a vehicle, a camera image including an image of a road on which the vehicle drives, and sensing information obtained by sensing a driving state of the vehicle; an MR module which renders MR information including at least one virtual object, on the basis of the camera image, the sensing information, and map information received from the cloud server; and a processor which controls the interface unit such that an MR view image including the MR information is displayed on a display unit of the vehicle, wherein the processor outputs, as a replay image, an MR view image reproduced when the vehicle was driving in the past, on the basis of satisfaction of a specific condition.