Vehicle 3D Surround View Rendering for Lower Driver Cognitive Load
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing vehicle driver assistance systems provide overwhelming and inconsistent information, leading to reduced visibility and increased risk of accidents due to the need to switch between multiple sensors and interfaces, especially in scenarios like reversing.
Innovation Solution
A computer-implemented method that aggregates sensor data from various sources to create a unified 3D visual model of the vehicle's environment, rendering it as an augmented layer over the physical view, highlighting relevant objects and adjusting the user's perspective for optimal visibility.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If multiple sensors and interfaces (cameras, mirrors, ultrasonic sensors, radar) are provided to improve driver vision, then the amount of information available to the driver increases, but the information becomes overwhelming and challenging for the driver to process
Solution Approach 1:
The patent merges data from multiple sensors (cameras, ultrasonic sensors, radar, mirrors) into a single unified 3D visual world model. This consolidation integrates information that would otherwise be分散 across multiple interfaces into one coherent representation, reducing the cognitive load of processing separate information streams while maintaining complete environmental awareness.
Solution Approach 2:
The perception module acts as an intermediary between the raw sensor data and the driver. It processes, filters, and synthesizes information from multiple sources into a manageable 3D visual model, mediating the complexity of multiple sensor inputs into a form that is easier for the driver to interpret and act upon.
2Loss of information
If the driver turns around to see the monitor when driving in reverse gear, then the monitor gets out of sight, but the driver needs to see the situation behind the vehicle
Solution Approach 1:
The patent transitions from a 2D monitor display to a 3D visual world model that can be overlaid on the driver's actual field of view. This dimensional change allows the rear environment information to be presented in the same spatial dimension as the driver's natural view, eliminating the need to physically turn around or switch between separate viewing interfaces.
Solution Approach 2:
The system creates a virtual copy of the rear environment through the 3D visual world model that can be superimposed on the driver's actual view. This virtual copy provides the necessary rear visibility information without requiring the driver to physically reposition themselves or switch between separate viewing interfaces.
3Loss of information
If camera monitors are used to show the scenery around the vehicle, then a view is provided, but objects may appear small and distant, and stereoscopic depth is not possible
Solution Approach 1:
The patent merges data from multiple sensor types (cameras, ultrasonic sensors, radar) into a unified 3D visual world model. This combination integrates depth information from ultrasonic sensors and radar with visual data from cameras, restoring stereoscopic depth perception that would be lost in a camera-only system while maintaining comprehensive environmental visibility.
Solution Approach 2:
The system changes the parameter of depth representation from 2D image coordinates to 3D spatial coordinates. By transforming camera images into a 3D visual world model with accurate depth information from multiple sensors, the system restores stereoscopic depth perception and improves measurement precision for distance and position.
4Loss of information
If the driver relies solely on camera monitor information, then the wider environment outside the camera's visual field is not visible, but the driver needs comprehensive awareness
Solution Approach 1:
The 3D visual world model serves multiple functions simultaneously: it provides the camera's direct view, extends visibility to areas outside the camera's field of view through sensor fusion, and presents all information in a single unified interface. This multi-functionality eliminates the need for the driver to distribute attention across multiple separate interfaces while maintaining complete environmental awareness.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The present invention concerns a computer-implemented method for improving vision of a vehicle's environment for one or more users of the vehicle. The method comprises the steps of aggregating, by a perception module of the vehicle, sensor data provided by a plurality of sensors of the vehicle; constructing, by the perception module, a three-dimensional, 3D, visual world model, based on the aggregated sensor data, the 3D visual world model representing the vehicle and the vehicle's environment; rendering, by a visualization module of the vehicle, a user's view of the vehicle's environment, based on the constructed 3D visual world model; and providing, by the visualization module, the rendered view to one or more displays for use by one or more users of the vehicle. Further aspects relate to a corresponding system, and a corresponding computer-readable storage medium.