Automotive AR Overlay Failover Using Dual Virtualized Engines
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In-vehicle augmented reality systems face instability when the augmented reality engine stops, leading to a loss of safe driving guidance.
Innovation Solution
A signal processing device with a memory and processor that executes multiple virtual machines on a hypervisor, generating graphical overlays using a first and second augmented reality engine, switching to the second engine for reduced data when the first engine stops, and utilizing a shared memory and input/output resource manager for seamless data transmission.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a single augmented reality engine is used to generate graphical overlays, then the system is simple, but the system becomes unstable when the engine stops and cannot provide safe driving guidance
Solution Approach 1:
The augmented reality engine is segmented into two independent engines (first AR engine and second AR engine) that can operate separately. When the first AR engine stops, the second AR engine can take over to generate graphical overlays, ensuring continuous safe driving guidance while maintaining system stability.
Solution Approach 2:
The system prepares a second AR engine in advance as a backup mechanism. This beforehand cushioning ensures that when the first AR engine fails, there is already a ready-to-use alternative that can immediately take over, preventing system instability and ensuring continuous operation.
2Reliability
If a first augmented reality engine generates complete graphical overlay data, then the guidance information is comprehensive, but when the engine stops the system cannot rapidly switch to provide continued guidance
Solution Approach 1:
The second AR engine is prepared in advance with the capability to generate graphical overlay data. This preliminary action ensures that when the first AR engine stops, the second engine can immediately take over without delay, rapidly providing continued safe driving guidance.
Solution Approach 2:
The second AR engine serves as a functional copy of the first AR engine, capable of generating the same type of graphical overlay data. This copying approach allows for rapid engine switching while maintaining the comprehensiveness of guidance information, as the second engine can produce equivalent output to the first.
3Reliability
If the second augmented reality engine generates reduced data compared to the first engine, then the system can rapidly switch engines, but the guidance information becomes less comprehensive
Solution Approach 1:
The second AR engine generates reduced graphical overlay data compared to the first engine, implementing partial action. This approach allows for rapid engine switching and failover capability, while still providing essential safe driving guidance information, even if less comprehensive than the first engine's output.
Data Source
AI summary
A signal processing device and an augmented reality apparatus for a vehicle including the same are disclosed. The signal processing device according to an embodiment of the present disclosure includes: a memory to store map data; and a processor to generate a graphical overlay based on camera data from a camera, the map data, or sensor data from a sensor device, wherein the processor is configured to execute a plurality of virtual machines on an hypervisor, and generate a first graphical overlay through a first augmented reality engine or generate a second graphical overlay, including less data than the first graphical overlay, through a second augmented reality engine, in response to the first augmented reality engine being stopped, output the second graphical overlay instead of the first graphical overlay. Accordingly, an augmented reality-based overlay may be stably provided.


