IVI Camera Processing to Augment ADAS Without Real-Time Load
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional advanced driver assistance systems (ADAS) often rely on laser sensors and infrared sensors, which may be limited in their capability to provide comprehensive and efficient image processing support for enhancing vehicle safety and convenience features.
Innovation Solution
Integrating an in-vehicle infotainment (IVI) system with image processing capabilities to augment ADAS features by processing images from vehicle cameras at a low frequency, leveraging remote servers and electronic devices for additional support, while maintaining non-mission-critical functionality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional ADAS systems use laser sensors and infrared sensors, then they can provide real-time safety features, but they are limited in comprehensive image processing capabilities
Solution Approach 1:
The system divides ADAS functionality into two segments: mission-critical real-time features handled by dedicated ADAS processors with laser/infrared sensors, and non-mission-critical augmented features handled by the IVI system with standard cameras. This segmentation allows each subsystem to optimize for its specific requirements without compromise.
Solution Approach 2:
The IVI system, originally designed for infotainment purposes, is made multi-functional by enabling it to process camera images for augmented ADAS features. This allows the same hardware to serve both entertainment and enhanced safety/convenience functions.
2Adaptability or versatility
If the IVI system processes images at low frequency, then computational resources can be leveraged for additional ADAS features, but real-time performance requirements are not met
Solution Approach 1:
The system dynamically assigns different processing frequencies to different ADAS features based on their criticality. Mission-critical features maintain high-frequency real-time processing, while augmented features operate at lower frequencies where delays are acceptable, optimizing overall system resource utilization.
Solution Approach 2:
The image processing workload is segmented into time-critical paths handled by ADAS processors and non-time-critical paths handled by the IVI system, allowing each to operate at appropriate frequencies for their specific functions.
3Reliability
If dedicated ADAS processors are used for mission-critical features, then real-time safety functions are ensured, but the system cannot provide additional non-critical safety and convenience features
Solution Approach 1:
The system creates a multi-functional architecture where the IVI system, beyond its original infotainment purpose, also provides augmented ADAS capabilities. This allows the vehicle to offer both dedicated real-time safety features and additional convenience/features without requiring completely separate systems.
Solution Approach 2:
The IVI system acts as an intermediary that receives camera inputs and processes augmented ADAS features, bridging the gap between dedicated safety systems and the need for additional functionality. It complements rather than competes with the dedicated ADAS processor.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Systems and methods directed to augmenting advanced driver assistance systems (ADAS) features of a vehicle with image processing support in on-board vehicle platform are described herein. Images may be received from one or more image sensors associated with an ADAS of a vehicle. The received images may be processed. An action is determined based upon, at least in part, the processed images. A message is transmitted to an ADAS controller responsive to the determination.