Autonomous Vehicle Rider Interface Using NLU and Multimodal Input
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Autonomous vehicles lack the ability to effectively communicate with riders, as there is no human interface for discussions or changes in destination or unexpected stops, making it difficult for riders to interact with the vehicle.
Innovation Solution
A computer-implemented method that monitors the interior of an autonomous vehicle for information provided by the rider, using microphone assemblies for verbal information and input devices for non-verbal information, and processes this information using Natural Language Understanding (NLU) to generate responses, which can be verbal or non-verbal, to interact with the rider.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If autonomous vehicles use traditional vehicle interfaces, then the vehicle structure remains simple, but the ability to communicate with riders is insufficient
Solution Approach 1:
The system integrates multiple communication modalities (voice recognition, touch screens, gesture recognition) into a single unified interface system that can handle various types of rider interactions through different input methods, allowing one system to serve multiple communication functions
Solution Approach 2:
A natural language processing module serves as an intermediary between the rider's verbal commands and the vehicle's control systems, translating spoken language into actionable commands for navigation, climate control, and other vehicle functions
2Ease of operation
If autonomous vehicles add human interface components for communication, then rider interaction improves, but the device complexity increases
Solution Approach 1:
The system employs automatic speech recognition and natural language processing algorithms that autonomously interpret rider commands without requiring manual configuration or complex setup, allowing the interface to adapt to rider preferences and patterns over time
Solution Approach 2:
The interface system dynamically adjusts its response characteristics based on the type of command, rider preferences, and contextual information, providing different levels of detail and interaction styles depending on the situation rather than using a fixed rigid interface
Data Source
AI summary
A method, computer program product, and computing system for monitoring the interior of an autonomous vehicle for information being provided by a rider of the autonomous vehicle to the autonomous vehicle; and processing the information provided by the rider of the autonomous vehicle to the autonomous vehicle to generate a response based, at least in part, upon the information provided by the rider of the autonomous vehicle.