Motor Vehicle 360 View Ground Plane Sensor Validation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current motor vehicle systems that display a 360° environment using cameras struggle to accurately represent the area below the vehicle due to limited availability of buffered image data, leading to potential misses of objects like balls or children, as the data becomes outdated quickly, especially when the vehicle is stationary or moving slowly.

Innovation Solution

Incorporating a sensor device to monitor the area below the vehicle, which communicates with the control device to determine the presence of obstacles, allowing the use of older image data for the 'ground plane' representation only if no objects are detected, and modifying the image representation when obstacles are present to alert the driver.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If buffered image data from previous recordings is used to fill the ground plane area, then the completeness of the 360° environment representation is improved, but the reliability and accuracy of the displayed objects deteriorate due to temporal offset

Engineering Contradiction:
Improvecompleteness of ground plane representationVSAvoidaccuracy of displayed objects
Core Design Contradiction:
Loss of informationVSReliability

Solution Approach 1:

The system performs preliminary actions by recording images with cameras positioned before the vehicle (front and rear cameras) in advance, buffering this image data before it is needed for ground plane representation. This allows the buffered data to be available when creating the top view display, improving completeness while managing the temporal offset issue through subsequent validation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system introduces feedback by using sensor information (from ultrasonic, optical, or other sensors) to verify whether objects detected in the buffered image data are still present and valid at the current time. This feedback mechanism allows the system to confirm the reliability of buffered data before displaying it, or to update/replace it with current sensor data if objects have moved or changed, thus resolving the contradiction between using historical data and maintaining accuracy.

Inventive Principle:
Principle #23Feedback

2Reliability

If the vehicle is stationary or moving slowly, buffered image data becomes outdated quickly, then the availability of valid buffered data is reduced, but using current images alone creates gaps in the ground plane area

Engineering Contradiction:
Improveavailability of valid buffered dataVSAvoidgaps in ground plane representation
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The feedback principle is applied by continuously monitoring the vehicle's movement state and the validity of buffered data. When the vehicle is stationary or moving slowly, the system uses sensor feedback to verify if buffered image data remains valid. If validation succeeds, the buffered data is used to fill ground plane gaps; if validation fails (objects have moved or appeared), the system updates the buffered data or uses alternative representation methods, thus maintaining both reliability and completeness.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system applies dynamics by adapting its data usage strategy based on vehicle movement state. When the vehicle is moving quickly, buffered data from earlier recordings remains valid longer and is readily used. When stationary or moving slowly, the system dynamically adjusts by incorporating real-time sensor validation and updating buffered data more frequently, thus maintaining reliability across different operational conditions while preventing ground plane gaps.

Inventive Principle:
Principle #15Dynamics

3Measurement precision

If objects are detected below the vehicle using sensor devices, then the accuracy of obstacle detection is improved, but the system complexity increases due to additional sensors and processing

Engineering Contradiction:
Improveobstacle detection accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system applies universality by using sensor devices that serve multiple functions: they detect objects below the vehicle for ground plane validation, provide obstacle detection for safety systems, and contribute to the overall 360° environment perception. This multi-functionality allows the system to improve obstacle detection accuracy without proportionally increasing complexity, as the same sensors support multiple objectives including validating buffered image data and detecting real-time obstacles.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system merges the validation of buffered image data with the obstacle detection function. Instead of separate systems for validating historical image data and detecting current obstacles, the patent combines these functions by using the same sensor devices and processing logic to both verify the accuracy of buffered data and detect present obstacles. This integration reduces overall system complexity while improving measurement precision through unified multi-functional processing.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS11161454B2Motor vehicle
Publication Date: 2021.11.02 AUDI AG
  • US11161454B2 patent drawing
  • US11161454B2 patent drawing

AI summary

A motor vehicle, having a plurality of image recording devices arranged across the entire vehicle for recording images of the vehicle environment, includes a control device for generating an image representation showing the 360° environment around the motor vehicle on the basis of the images. The motor vehicle further includes a display device for displaying the image representation. The control device is designed to generate an additional partial image representation showing the area below the motor vehicle on the basis of images recorded, and to integrate the partial image representation into the displayed image representation for outputting an overall image representation. At least one sensor device is provided which detects the area below the motor vehicle and communicates with the control device. The overall image representation can be modifiable at least in the area of the partial image representation on the basis of the sensor information.