Vehicle Surround View Display With IMU-Stabilized Composite Imaging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current surround view display systems for vehicles, particularly aircraft, have limited applicability and do not provide a realistic, stable composite view from multiple cameras, offering restricted situational awareness, especially during landing operations and tactical maneuvers.
Innovation Solution
The system processes images from cameras mounted around and under the vehicle using perspective transformation and inertial stabilization to project a composite view onto a common reference plane, simulating a virtual camera view above the vehicle, with adjustable parameters for enhanced situational awareness and obstacle detection.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If images from multiple cameras are combined to create a surround view display, then situational awareness is improved, but image stability and realism deteriorate due to vehicle movement
Solution Approach 1:
An inertial measurement unit (IMU) is introduced as an intermediary device that measures vehicle acceleration and orientation. The IMU data serves as a mediator between the camera images and the display processing, providing correction information that compensates for vehicle movement. This allows the system to maintain stable, realistic images while preserving complete situational awareness information.
Solution Approach 2:
The system implements a feedback loop where IMU data about vehicle movement is continuously fed back to the image processing algorithm. The processing algorithm uses this feedback to dynamically adjust and correct the camera images in real-time, compensating for pitch, roll, and yaw movements. This feedback mechanism maintains image stability without losing the comprehensive surround view information.
2Stability of the object's composition
If a virtual camera view from above the vehicle is simulated, then a realistic composite view is achieved, but applicability is limited to slow vehicle movement
Solution Approach 1:
The system changes the parameter of vehicle speed applicability by introducing inertial stabilization. The IMU-based correction allows the realistic composite virtual camera view to remain stable even during faster vehicle movements, tactical maneuvers, and landing operations. This parameter change expands the system from slow-speed parking assistance to high-speed tactical applications.
Solution Approach 2:
The system transitions from a static composite view approach to a dynamic stabilization approach. The image processing is no longer fixed but dynamically adjusts based on real-time IMU data about vehicle movement. This dynamic adaptation allows the virtual camera view to maintain realism and stability across a wide range of vehicle speeds and maneuvers.
3Ease of manufacture
If traditional surround view systems are used for parking assistance, then the system is simple to implement, but the system lacks versatility for other operations
Solution Approach 1:
The system achieves multi-functionality by adding an IMU and inertial stabilization processing to the traditional surround view camera system. This enhancement allows the same basic system architecture to serve multiple purposes: slow-speed parking assistance, high-speed tactical maneuvers, and aircraft landing operations. The core camera system remains simple while the added inertial processing provides universal applicability across different operational contexts.
Data Source
AI summary
An image processing system for generating a display for a vehicle. The image processing system receives images, respectively, from a plurality of cameras mounted on the vehicle. The field of view of the plurality of cameras at least partially overlaps. The field of view of one or more of the plurality of cameras includes a region underneath the vehicle. The images are transformed to a common reference plane using a perspective transformation algorithm and based on intrinsic and extrinsic parameters of the plurality of cameras, to thereby obtain a projected image. The projected image is projected to the common reference plane. A display is generated based on the projected image. The display includes a synthetic depiction of the vehicle including an outer profile. The display includes an image area within the outer profile that is based on the projected image for the region underneath the vehicle.