Augmented Reality Display for Autonomous Vehicle Occupant Training
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current autonomous driving systems face challenges in effectively training and monitoring occupants, particularly safety drivers, to take control of vehicles from autonomous modes, especially in critical situations like night driving or fatigue, due to the lack of realistic and controlled simulation of obstacles and errors.
Innovation Solution
The method involves using an augmented reality display device, such as head-mounted or head-up displays, to present virtual obstacles or simulated errors to occupants during semi-autonomous or autonomous driving modes, allowing for training and monitoring of their reactions, which can be abstract or realistic, and includes detection of responses like reaction time and heart rate, with optional warnings for vehicle control takeover.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If autonomous driving systems operate in fully autonomous mode, then productivity and safety are improved, but the occupant's ability to take over control in critical situations deteriorates due to lack of training and situational awareness
Solution Approach 1:
The system performs preliminary training actions by displaying virtual obstacles and simulated faults to the occupant before actual critical situations occur. This prepares the occupant in advance for potential takeover scenarios, ensuring they maintain the necessary skills and situational awareness even during extended autonomous operation.
Solution Approach 2:
The augmented reality display device serves as an intermediary between the autonomous driving system and the occupant. It presents virtual training elements that bridge the gap between fully autonomous operation and manual control, allowing the occupant to train for takeover situations without leaving autonomous mode.
2Reliability
If virtual obstacles and simulated faults are displayed to train occupants, then occupant takeover readiness is improved, but device complexity increases due to augmented reality display requirements
Solution Approach 1:
The augmented reality display device performs multiple functions: it displays real-world visual information to the occupant, overlays virtual obstacles for training, presents simulated faults, and monitors occupant responses. This multi-functionality reduces the need for separate training systems and integrates training capabilities into the existing autonomous driving interface.
3Reliability
If realistic virtual obstacles are displayed during autonomous driving, then training effectiveness is improved, but safety risks increase due to potential confusion with real obstacles
Solution Approach 1:
The virtual obstacles are displayed with distinct visual characteristics that differ from real obstacles in specific local properties. The system can adjust the appearance, brightness, or visual style of virtual elements to make them distinguishable from real-world objects, reducing confusion while maintaining training effectiveness.
4Ease of operation
If augmented reality display is used for training, then ease of operation is improved by maintaining autonomous mode, but loss of information occurs if occupant does not perceive virtual elements correctly
Solution Approach 1:
The system monitors the occupant's reactions and responses to virtual obstacles and simulated faults, providing feedback on whether the training elements are being perceived and processed correctly. This allows the system to adjust the training presentation to ensure effective information transfer while maintaining autonomous operation.
Data Source
Figure 1~2
Figure 3~4
Figure 5~6
AI summary
The invention relates to a method for operating a semi-autonomous or autonomous motor vehicle (10). The method comprises operating the motor vehicle (10) in a semi-autonomous or autonomous operating mode and displaying a virtual obstacle (D) for the motor vehicle (10) and/or a simulated fault (E) of the semi-autonomous or autonomous operating mode by means of an augmented reality display device (20) of the motor vehicle (10). The method includes detecting a reaction of an occupant, in particular a driver, of the motor vehicle (10). The method enables the training of an occupant of an autonomous motor vehicle and the acquisition of knowledge about how an occupant of an autonomous motor vehicle reacts to an obstacle or fault under certain conditions.