Vehicle 3D World Modeling for Unified Surround Vision
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing vehicle driver assistance systems provide overwhelming and inconsistent information, leading to reduced visibility and increased risk of accidents due to the need to switch between multiple sensors and views, especially in low-speed maneuvers.
Innovation Solution
A computer-implemented method that aggregates sensor data from various sources to create a unified 3D visual world model, rendering a consolidated augmented reality view of the vehicle's environment, highlighting relevant objects and adjusting to the user's perspective.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If multiple sensors and views are provided to improve driver vision, then the amount of information available to the driver increases, but the information becomes overwhelming and challenging for the driver to process
Solution Approach 1:
The patent merges data from multiple sensors (cameras, radar, LIDAR, ultrasonic sensors) and multiple views (front, rear, side cameras, mirrors) into a single unified 3D visual world model. This consolidation integrates fragmented information sources into one coherent representation, reducing the cognitive burden of processing separate data streams while maintaining complete environmental awareness.
Solution Approach 2:
The patent transforms 2D camera images and sensor data into a 3D visual world model that represents the environment in three-dimensional space. This dimensional transformation allows the system to consolidate information from multiple angles and depths into a single spatial representation, making complex environmental data more intuitive and easier for the driver to comprehend.
2Illumination intensity
If the driver turns around to see the situation behind the vehicle, then the driver can see directly, but the monitor gets out of sight
Solution Approach 1:
The patent combines rear camera views, side mirror information, and ultrasonic sensor data into the unified 3D visual world model. This allows the driver to access rear and side environment information without physically turning around or switching between separate displays, as all information is integrated into one continuous visual representation.
Solution Approach 2:
The unified 3D visual world model serves multiple functions simultaneously: it provides forward view, rear view, side view, and collision warning information all in one display. This multi-functional approach eliminates the need for separate monitors and mirrors, allowing the driver to obtain comprehensive environmental awareness from a single source.
3Area of stationary object
If camera monitors are used to show the scenery around the vehicle, then the driver can see the environment, but objects may appear small and distant and stereoscopic depth is not provided
Solution Approach 1:
The patent converts 2D camera images into a 3D visual world model by integrating depth information from radar and LIDAR sensors. This dimensional transformation restores stereoscopic depth perception, allowing the driver to accurately judge distances and spatial relationships of objects in the environment, which is lost in traditional 2D monitor displays.
Solution Approach 2:
The patent creates a composite visual representation by merging data from different sensor types (optical cameras, electromagnetic radar, laser LIDAR, acoustic ultrasonic sensors). This composite approach combines the strengths of each sensor type to produce a unified 3D model that provides both wide field of view coverage and accurate depth perception.
4Illumination intensity
If mirrors and windows are used to provide driver vision, then the driver can see the environment, but the view is obstructed by the vehicle's hull and pillars
Solution Approach 1:
The patent uses cameras positioned at various locations on the vehicle to capture images of the environment that would otherwise be blocked by the vehicle's hull and pillars. These camera views are then integrated into the 3D visual world model, creating a virtual copy of the obstructed fields of view and presenting them to the driver without physical obstructions.
Data Source
AI summary
A computer-implemented method for improving vision of a vehicle's environment for one or more users of the vehicle. The method includes aggregating, by a perception module of the vehicle, sensor data provided by a plurality of sensors of the vehicle. The method includes constructing, by the perception module, a three-dimensional (3D) visual world model, based on the aggregated sensor data. The 3D visual world model represents the vehicle and the vehicle's environment. The method includes rendering, by a visualization module of the vehicle, a user's view of the vehicle's environment, based on the constructed 3D visual world model. The method includes providing, by the visualization module, the rendered view to one or more displays for use by the one or more users of the vehicle.