Multi-Camera Vehicle Surroundings Monitoring System

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current vehicle driver assistance systems, particularly those using monocular cameras, are inadequate for securing the driving path and lateral area due to limitations in coverage, accuracy, and real-time capability, especially for curb detection and low-speed maneuvers.

Innovation Solution

A multi-camera system with at least six wide-angle cameras arranged to form multiple stereo and mono viewing areas, allowing for comprehensive environment monitoring, including the use of a stereo system for the driving path and a monocular system for sides, with adjustable camera angles and computing power allocation for real-time object recognition.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a monocular camera system is used for recording the driving path, then the system complexity is reduced, but the measurement precision and ability to detect objects at close range deteriorates

Engineering Contradiction:
Improvesystem complexityVSAvoidmeasurement precision
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The monitoring area is segmented into driving path area and lateral area, with different camera configurations optimized for each function. The driving path uses stereo cameras for precision, while lateral areas use monocular cameras for coverage, resolving the contradiction between complexity and precision by applying different principles to different functional zones.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The camera system is designed with multi-functionality where cameras serve dual purposes: front cameras contribute to both driving path monitoring and lateral area monitoring, and side cameras provide both lateral coverage and supplementary driving path information. This reduces overall system complexity while maintaining measurement precision through coordinated multi-camera operation.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Device complexity

If small-angle front camera systems are used, then the device complexity is reduced, but the area of coverage deteriorates for close-range driving path monitoring

Engineering Contradiction:
Improvedevice complexityVSAvoidarea of coverage
Core Design Contradiction:
Device complexityVSArea of stationary object

Solution Approach 1:

The system transitions from single-dimension small-angle cameras to multi-dimension wide-angle stereo camera configuration. By introducing the stereo dimension (multiple cameras at different positions) and wide-angle field of view, the system achieves comprehensive close-range coverage without proportionally increasing complexity, as the wide-angle lenses capture broader areas per camera.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

Multiple camera views are merged to create a comprehensive driving path monitor image. The front cameras and side cameras are combined in the calculation unit to provide unified coverage of the driving path area, achieving extensive area monitoring through coordinated integration rather than requiring each individual camera to cover the entire area.

Inventive Principle:
Principle #5Merging (Combining)

3Measurement precision

If six wide-angle cameras are arranged to form multiple stereo and mono viewing areas, then the measurement precision and area of coverage are improved, but the device complexity increases

Engineering Contradiction:
Improvemonitoring accuracyVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

Different camera configurations are applied to different spatial zones: stereo camera pairs are positioned for driving path monitoring where high precision is critical, while monocular cameras are used for lateral area monitoring where broad coverage is prioritized. This local differentiation optimizes measurement precision where needed while controlling overall device complexity through selective application of camera types.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system dynamically allocates computing resources based on operational mode: in parking assistance mode, full stereo processing is activated for maximum precision; in normal driving, processing is adjusted. This dynamic adaptation allows the complex six-camera system to operate at optimal precision levels while managing computational complexity through adaptive resource allocation.

Inventive Principle:
Principle #15Dynamics

4Measurement precision

If stereo camera systems are used for the entire surrounding area, then the measurement precision is improved, but the use of energy and device complexity increase

Engineering Contradiction:
Improvemonitoring accuracyVSAvoidenergy consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The monitoring system is segmented into driving path area (requiring stereo precision) and lateral area (sufficient with monocular coverage). By applying stereo processing only where critical for safety and precision, and using energy-efficient monocular processing for lateral monitoring, the system achieves necessary measurement precision while significantly reducing overall energy consumption compared to full-stereo coverage.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Stereo processing is applied partially only to the driving path area where maximum measurement precision is essential for obstacle detection, while lateral areas use simpler monocular processing. This partial application of the more energy-intensive stereo method achieves sufficient monitoring accuracy for critical zones without the excessive energy consumption of applying stereo processing uniformly across all monitoring areas.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentEP3409541B1Device for securing drive path
Publication Date: 2019.10.09 VOLKSWAGEN AG
  • EP3409541B1 patent drawingFigure 1
  • EP3409541B1 patent drawingFigure 2
  • EP3409541B1 patent drawingFigure 3

AI summary

The device according to the invention for monitoring the driving lane of a vehicle comprises at least six cameras arranged on the vehicle for monitoring the surroundings and a processing unit, wherein the cameras are wide-angle cameras with an effective field of view of at least 165°, wherein: - two cameras are arranged at the front of the vehicle at a predetermined distance such that the camera axis of each camera is inclined outwards at a predetermined angle relative to the longitudinal axis of the vehicle, - two cameras are arranged at the rear of the vehicle at a predetermined distance such that the camera axis of each camera is inclined outwards at a predetermined angle relative to the longitudinal axis of the vehicle, - one camera is arranged on each side of the vehicle such that the camera axis of each camera is parallel to the transverse axis of the vehicle.- the two front cameras form a front stereo field of view, - the two rear cameras form a rear stereo field of view, - the left side camera forms a left front stereo field with the front left camera, and the right side camera forms a right front stereo field with the front right camera, - the left side camera forms a left rear stereo field with the rear left camera, and the right side camera forms a right rear stereo field with the rear right camera, - the left side camera forms a left side mono field, and - the right side camera forms a right side mono field, and - the image data from the cameras are combined in the processing unit to form at least eight fields of view.