Multi-Display Surround View With 3D Vehicle Overlay and Touch Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing vehicle surrounding-view systems lack interactivity and flexibility, particularly when used in multi-display setups, and do not effectively utilize multiple camera inputs to provide a comprehensive and interactive view of the vehicle's surroundings.
Innovation Solution
An interactive multi-display surrounding-view system that receives outputs from multiple cameras, stitches them into a top-down image, adds a 3D model of the vehicle, and presents enhanced images on multiple display devices with touchscreen input controls, allowing for perspective changes, zooming, and augmented reality object representation of obstacles.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If multiple cameras are used to generate a top-down view, then the completeness of surrounding view is improved, but the system complexity increases
Solution Approach 1:
The system divides the surrounding view into multiple camera fields of view (front, rear, left, right) and processes each separately before stitching. This segmentation allows manageable processing of complex multi-camera data while achieving complete 360-degree coverage through the stitching module.
Solution Approach 2:
The stitching module combines multiple camera outputs into a unified top-down bird's-eye view image. This merging process integrates information from separate camera sources into a single comprehensive view, achieving complete surrounding coverage without requiring each individual camera to capture the entire scene.
2Ease of operation
If a single display shows the surrounding view, then the system simplicity is maintained, but the interactivity and flexibility are reduced
Solution Approach 1:
The system divides the display output into multiple independent display devices, each showing different aspects of the surrounding view. This allows different users or the same user to interact with different views simultaneously, enhancing interactivity while maintaining manageable system architecture through independent display processing.
Solution Approach 2:
The system transitions from a single 2D display to multiple 2D displays arranged in a spatial configuration that provides different viewing angles and perspectives. This dimensional expansion enables simultaneous multi-user interaction and flexible view selection without requiring a single complex interactive interface.
3Ease of operation
If touchscreen controls are added to displays, then the ease of operation is improved, but the device complexity increases
Solution Approach 1:
The display devices incorporate touchscreen capabilities that allow users to directly interact with and control the displayed content without requiring external control devices. This self-service approach enables intuitive gesture-based control of camera views, stitching parameters, and display configurations, improving ease of operation while keeping the control system integrated and manageable.
4Adaptability or versatility
If multiple display devices are used simultaneously, then the flexibility for multi-user interaction is improved, but the coordination complexity increases
Solution Approach 1:
The system assigns different camera views and display content to different display devices, allowing independent control and interaction on each display. This segmentation of display content and control functions enables multiple users to interact simultaneously with different aspects of the surrounding view without requiring complex real-time coordination between displays.
Solution Approach 2:
Each display device is designed to be universally controllable through touchscreen interfaces, allowing any user to control any display from any position. This universal control capability provides flexible multi-user interaction while simplifying the coordination system by using a standardized control interface across all displays rather than requiring device-specific control mechanisms.
Data Source
AI summary
Managing camera outputs in an interactive multi-display surrounding view system comprises: receiving outputs from at least four cameras of the vehicle; stitching together the outputs into a first image of a top-down view of vehicle surroundings; adding a three-dimensional (3D) model of the vehicle to the first image, based on the vehicle surroundings, to generate a first enhanced image; and simultaneously presenting (i) the first enhanced image on a first display device of the vehicle, the first display device providing a first touchscreen input control for a first aspect of the first enhanced image, and (ii) a second image on a second display device of the vehicle, the second image comprising one of the outputs, the second display device providing a second touchscreen input control for a second aspect of the second image, wherein the first and second touchscreen input controls accept inputs simultaneously and non-simultaneously with each other.