Connected Vehicle Camera Fusion for Extended Rear View Depth
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing vehicle rear view systems have limitations in field of view due to technical constraints, distances, and visual obstructions, which hinder complete situational awareness and safe vehicle maneuvering.
Innovation Solution
A method and system that utilizes AI algorithms, particularly transversal neural networks, to evaluate image data from multiple connected camera-based systems, combining data to extend the field of view and assess safety criteria for vehicle maneuvers.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a single camera-based rear view system is used, then the system complexity is reduced, but the field of view depth and object detection capability are insufficient
Solution Approach 1:
The patent combines image data from multiple camera systems (own vehicle's camera and other vehicles' cameras) to create a composite view that extends the field of view depth. The data fusion unit merges images from different sources to provide extended rearward visibility beyond what a single camera can achieve.
Solution Approach 2:
The patent extends the field of view in the depth dimension by incorporating images from other vehicles that are positioned at different distances from the own vehicle. This allows observation of objects that are too far away to be captured by the own vehicle's camera alone.
2Area of stationary object
If the field of view depth is extended using multiple connected camera systems, then object detection capability is improved, but the device complexity increases
Solution Approach 1:
The patent introduces a data fusion unit as an intermediary component that processes and combines image data from multiple camera systems. This mediator handles the complexity of data integration, allowing the camera systems themselves to remain relatively simple while achieving extended field of view through intelligent data processing.
Solution Approach 2:
The patent uses image data from other vehicles as virtual copies of their camera views to extend the own vehicle's field of view. Instead of physically installing cameras on the own vehicle at multiple positions, it copies and integrates image data from other vehicles in the vicinity.
3Loss of information
If image data from multiple vehicles is combined, then situational awareness is enhanced, but the data processing requirements and time increase
Solution Approach 1:
The patent performs preliminary actions by having other vehicles continuously capture and transmit their camera images in advance. The data fusion unit receives these pre-captured images, which are already available when needed for extended field of view observation, reducing the processing time required at the moment of need.
Solution Approach 2:
The patent maintains continuous image capture and transmission from multiple vehicle cameras, ensuring that updated situational information is always available. This continuous data flow allows the data fusion unit to process images in real-time or near-real-time without significant delays.
Data Source
AI summary
A vehicle safety and/or driver assistance method, arrangement and data processing program product using a first image capturing system having a first field of view, adapted for detecting speed data, generating first field of view depth data and/or object detection distance data, using an artificial intelligence algorithm, evaluating, if a minimum field of view depth criteria and/or minimum object distance safety criteria is fulfilled, in case the minimum field of view depth criteria and/or the minimum object distance safety criteria is not fulfilled, combining first and second image capturing system image data to create a combined image data, evaluating if a minimum field of view depth criteria and/or minimum object distance safety criteria is fulfilled, and outputting and/or displaying safety data, the safety data being indicative if performing a certain vehicle maneuver is safe.