Vehicle Surround View Using Bowl Projection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current vehicle surround view systems fail to provide a comprehensive and realistic view of the vehicle's surroundings, particularly in blind spots, and can be inaccurate in snowy conditions, leading to potential accidents due to incorrect distance measurements by ultrasound sensors and misleading rear-view images.
Innovation Solution
A vehicle surround view system utilizing multiple image sensors, such as fish-eye cameras, and an image processing unit that projects and combines image data onto a bowl-shaped virtual space, allowing drivers to adjust the view position and angle, with optional distance correction from sensors like PMD sensors, to create a clear and undistorted representation of the vehicle's environment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If ultrasound sensors are used to determine distance to objects, then distance measurement capability is improved, but measurement precision deteriorates in snow conditions
Solution Approach 1:
The system segments the sensing function across multiple sensor types (ultrasound sensors for general distance detection, image sensors for visual confirmation, and PMD sensors for precise distance measurement). This segmentation allows the system to compensate for the weaknesses of individual sensors in specific conditions like snow.
Solution Approach 2:
The image processing unit acts as an intermediary that integrates data from multiple sensors. When ultrasound sensors provide incorrect results in snow conditions, the system uses image data from image sensors and distance data from PMD sensors to correct and validate the measurements, ensuring reliable distance determination.
2Area of stationary object
If multiple image sensors are used to generate surround view, then coverage of vehicle surroundings is improved, but device complexity increases
Solution Approach 1:
The image processing unit merges image data from multiple image sensors (front, rear, left, and right cameras) into a single integrated surround view display. This combining approach allows comprehensive coverage of the vehicle surroundings while presenting a unified, manageable view to the driver, effectively reducing the perceived complexity.
Solution Approach 2:
The system projects the three-dimensional spatial information from multiple sensors onto a two-dimensional display surface using a bowl-shaped projection model. This dimensional transformation allows comprehensive surround coverage to be represented in a compact, easily interpretable format on the display, managing the complexity of multiple sensor inputs.
3Area of stationary object
If rear-vision systems provide extended view, then visibility of rear area is improved, but perception of actual distance deteriorates
Solution Approach 1:
The system replaces traditional mechanical rear-view mirrors with an electronic image-based rear-vision system using image sensors and digital processing. This substitution allows the system to not only extend the visible area but also to provide accurate distance information through PMD sensors and image processing, correcting the distance perception issue inherent in optical mirror systems.
Solution Approach 2:
The image processing unit serves as an intermediary that processes raw image data from rear cameras and integrates it with distance data from PMD sensors. This intermediary processing layer adds accurate distance information to the extended rear view, allowing drivers to see both farther areas and understand actual distances to objects in those areas.
4Shape
If bowl-shaped projection is used to generate surround view, then realism of surround view is improved, but image processing complexity increases
Solution Approach 1:
The system uses a bowl-shaped (spheroidal) projection surface to map the surround view images, which naturally provides a more realistic and intuitive representation of the three-dimensional environment. This curved projection model better matches human spatial perception compared to flat displays, enhancing visual realism while the image processing unit handles the computational complexity of the transformation.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The invention relates to a vehicle surround view system comprising: a plurality of image sensors provided at different locations of the vehicle, the image sensors generating image data of the vehicle surroundings that cover the complete surroundings of the vehicle, an image processing unit processing the image data of the plurality of image sensors, the image processing unit being configured to generate the surround view of the vehicle based on the image data of the different image sensors, wherein the image processing unit, for generating the surround view, projects the image data inversely on a bowl surrounding the vehicle, the bowl having a flat bottom with a substantially rectangular shape, the bowl continuing above the bottom in horizontal slices, the top slice of the bowl being substantially ellipsoidal in shape, a display displaying the surround view generated by the image processing unit, a manipulator changing a position and an angle of view with which the generated surround view is displayed.