Adaptive Surround View System Using Dynamic Virtual Camera
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing surround view systems provide fixed synthetic scenes, failing to adapt to varying vehicle speeds and turning directions, which limits the detail and relevance of the displayed information for drivers.
Innovation Solution
A surround view system that includes a surround image sensing module, a vehicle status retrieval module, and a processing module to generate an adaptive surround view by transforming the viewport based on vehicle speed and turning angle, using a virtual camera positioned within a bowl-shaped spherical virtual environment, allowing dynamic adjustment of the camera's position and view angle.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If a fixed viewport is used in the surround view system, then the system structure is simple, but the adaptability to different driving conditions is poor
Solution Approach 1:
The patent implements a dynamic viewport transformation mechanism that automatically adjusts the virtual camera position and field of view based on real-time driving conditions including vehicle speed, steering angle, and acceleration. The processing module dynamically modifies the surround view parameters to match the current driving state, enabling the system to adapt to various scenarios such as low-speed maneuvering, high-speed driving, and turning operations without requiring manual intervention or complex hardware changes
Solution Approach 2:
The system changes key parameters of the surround view display based on driving conditions: the virtual camera position is adjusted according to steering angle, the field of view angle is modified based on vehicle speed, and the viewport transformation matrix is updated in real-time. These parameter changes allow the same hardware system to provide optimized visual information for different driving scenarios, from detailed close-up views at low speeds to broader panoramic views at high speeds
2Loss of information
If the virtual camera is fixed at a predetermined position, then the system is simple to implement, but the field of view cannot be optimized for different driving speeds
Solution Approach 1:
The virtual camera position and field of view are dynamically adjusted based on vehicle speed. At low speeds, the system provides a wider field of view with greater detail for nearby objects to assist with maneuvering. At high speeds, the field of view is optimized to show broader surroundings while maintaining adequate detail. This dynamic adjustment ensures that the most relevant information is always displayed with appropriate detail levels
Solution Approach 2:
The processing module modifies the viewport transformation parameters including the virtual camera position coordinates, field of view angle, and projection matrix based on real-time speed data. These parameter changes enable the system to optimize the balance between field of view coverage and detail resolution according to driving conditions, maximizing the useful information displayed without requiring additional sensors or hardware
3Loss of information
If the surround view uses a fixed field of view, then the display is consistent, but the relevance to the direction of vehicle turning is reduced
Solution Approach 1:
The system dynamically rotates and repositions the virtual camera based on the vehicle's steering angle and turning direction. When the vehicle is turning, the surround view automatically shifts to provide enhanced detail in the direction of the turn, allowing the driver to better see obstacles or features in the path of travel. This dynamic orientation ensures that the most relevant spatial information is always centered and detailed in the display
Solution Approach 2:
The processing module adjusts the virtual camera's orientation angles and position coordinates based on steering wheel angle and vehicle turning rate. The viewport transformation parameters are modified to shift the field of view toward the turning direction while maintaining a balanced overall view. This parameter adjustment enables the system to prioritize information in the direction of travel without losing complete situational awareness
Data Source
Figure 1~2
Figure 3
Figure 4
AI summary
The present invention is directed to a surround view system and method thereof. The surround view system comprises a surround image sensing module which obtains images of surrounding view and output image data, a vehicle status retrieval module which retrieves vehicle status information, a processing module which generates adaptive surround view based on the image data and the vehicle status information; and an outputting module which outputs the adaptive surround view.