In-Cabin Audio Anomaly Detection for Autonomous Vehicle Safety
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Autonomous vehicles without a safety driver face challenges in ensuring passenger safety during ride-sharing and ride-hailing activities, particularly in detecting internal anomalies such as distress signals, which existing technologies have not adequately addressed.
Innovation Solution
A sensor system that includes interior cameras and microphones, integrated with an autonomous operation module and anomaly detection module, uses machine learning algorithms to differentiate between external and internal sounds, detect anomalies like shouting or impacts, and trigger alerts or adjust vehicle trajectory based on human operator instructions, with a machine learning model trained to autonomously respond to such events.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a sensor system with interior cameras and microphones is implemented, then the ability to detect internal anomalies is improved, but the device complexity increases
Solution Approach 1:
The sensor system is divided into multiple independent sensor units (cameras, microphones, sensors) distributed throughout the vehicle interior, each monitoring specific zones. This segmentation allows the system to detect anomalies across different areas while maintaining modular architecture that manages complexity.
Solution Approach 2:
The sensor system is designed to perform multiple functions: detecting distress signals, monitoring passenger safety, identifying anomalies, and providing data for both immediate responses and historical analysis. This multi-functionality consolidates what could be separate systems into one integrated platform, managing overall system complexity.
2Measurement precision
If machine learning algorithms are used to differentiate between external and internal sounds, then the measurement precision of anomaly detection is improved, but the use of energy increases
Solution Approach 1:
The machine learning models are trained offline beforehand with extensive datasets of internal and external sounds. This preliminary training allows the system to make rapid, energy-efficient classifications during actual operation, as the complex computational work has already been performed during the training phase.
Solution Approach 2:
The system applies machine learning algorithms selectively to sound data that meets certain criteria for potential anomaly detection, rather than processing all audio data continuously. This partial application of complex processing reduces energy consumption while maintaining detection precision for relevant events.
3Productivity
If the vehicle trajectory is adjusted based on anomaly detection, then the response effectiveness to distress situations is improved, but the device complexity increases
Solution Approach 1:
The system implements a feedback loop where anomaly detection results automatically trigger predetermined response actions, including trajectory adjustments. The system continuously monitors the situation, detects anomalies, executes responses, and adjusts based on ongoing sensor data, creating an automated feedback mechanism that improves response effectiveness without requiring constant human intervention.
Solution Approach 2:
The vehicle system is designed to autonomously respond to detected anomalies by automatically adjusting its trajectory and operations without requiring external human input. The integrated system performs self-diagnosis and self-correction, allowing the vehicle to service its own safety needs and reduce the complexity of human-system coordination.
Data Source
AI summary
An autonomous vehicle includes a microphone sensing sounds in the interior of the vehicle. The output of the interior microphone is processed according to an unsupervised machine learning model such that anomalies are indicated by the model. In response to detection of an anomaly, a remote dispatcher is notified, who may then dismiss the anomaly or transmit an instruction to the vehicle to alter its trajectory. The output of an exterior microphone and infotainment system may be removed from the output of the interior microphone prior to processing. An anomaly may be found to occur in response to detecting speaking of a keyword in the output of the interior microphone.