In-Vehicle MR Navigation Platform for Context-Aware UX Delivery
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing vehicle systems lack an optimized mixed reality (MR) service platform that can provide tailored information and interfaces to enhance driving experiences, considering the vehicle's environment and user requests.
Innovation Solution
An MR service platform comprising an MR AMS server, client, and DTaaS server, which integrate with various service providers to deliver optimized MR automotive meta services through a context manager, scene manager, and MR renderer, utilizing interface APIs, data integration, and three-dimensional assets to create immersive MR experiences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If mixed reality technologies are used to provide various information and interfaces for vehicle driving, then the user experience and information provision are improved, but the system complexity and computational requirements increase
Solution Approach 1:
The system is divided into multiple functional modules including AR service device, navigation system, object detection device, and sensor units. Each module handles specific tasks independently, allowing the complex MR system to manage information provision through segmented, specialized components rather than a monolithic structure.
Solution Approach 2:
The processor acts as an intermediary that receives data from multiple sources (sensors, navigation, object detection), processes this information, and generates appropriate MR outputs. This mediator component coordinates between the various subsystems, managing the overall system complexity while enabling versatile information provision.
2Reliability
If multiple sensors and electronic devices are disposed at the vehicle for ADAS and autonomous driving, then the driving assistance capability is improved, but the device complexity and cost increase
Solution Approach 1:
The system combines multiple sensors (cameras, microphones, radar, LIDAR, ultrasonic sensors) and electronic devices into an integrated sensing system that works together through a central processor. This merging approach maintains high driving assistance capability while reducing overall system complexity compared to separate, independent systems.
Solution Approach 2:
The processor serves multiple functions simultaneously: it processes navigation data, object detection results, sensor inputs, and generates AR/MR outputs. This multi-functional component reduces the need for separate dedicated processors for each function, thereby reducing device complexity while maintaining comprehensive driving assistance capability.
3Ease of operation
If AR, VR, and MR services are integrated into the vehicle system, then the user experience and information delivery are improved, but the processing power and energy consumption increase
Solution Approach 1:
The system updates AR/MR information at periodic intervals rather than continuously, processing and displaying navigation updates, object detection results, and sensor data at optimized frequencies. This periodic action maintains high user experience by providing timely updates while reducing overall energy consumption compared to continuous high-frequency processing.
Data Source
AI summary
A mixed reality (MR) navigation engine for providing an MR automotive meta service (AMS) in which augmented reality (AR) and virtual reality (VR) are mixed can include an interface API that calls a function for communicating with an external device that provides the MR AMS and is disposed outside a vehicle, a context manager requesting a context corresponding to a user request from the external device, a scene manager that manages MR scene information provided to a display disposed in the vehicle, and a user experience (UX) scenario database that provides a UX rule to at least one of the context manager and the scene manager. The interface API can receive metadata of the context from the external device and a three-dimensional asset corresponding to the context and transmits the received metadata and three-dimensional asset to the scene manager, and the scene manager generates user interface (UI) data.