3D Vehicle Surround Display with Adjustable Viewpoint

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current vehicle surrounding display systems using wide angle optics and non-intuitive camera mounts create distorted images, making it difficult for drivers to accurately judge distances to objects, especially in complex driving situations like parallel parking.

Innovation Solution

A system and method that utilize multiple sensors (time-of-flight, lidar, radar, ultrasound, and stereo) to generate a three-dimensional environment map, allowing for an adjustable point of view that highlights relevant objects based on measured distances and driving situations, with a processor performing sensor fusion, object recognition, and scene rendering to display distances and a vehicle model.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If wide angle optics are used in cameras to capture larger area of vehicle surrounding, then the coverage area is improved, but image distortion increases making distance judgment difficult

Engineering Contradiction:
Improvecoverage areaVSAvoiddistance judgment accuracy
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

The patent introduces an intermediary processing system that includes a processor that receives images from wide-angle cameras and applies computational corrections. The processor uses algorithms to compensate for distortion effects, generating corrected images that maintain the wide coverage area while restoring accurate distance representation. This intermediary processing layer mediates between the wide-angle capture requirement and the distance accuracy requirement.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent applies parameter changes by modifying image parameters through digital processing. The system adjusts geometric parameters of the captured images to correct distortion while preserving the wide field of view. By changing the parameter representation of the image data (from distorted to corrected coordinates), the system achieves both wide coverage and accurate distance measurement.

Inventive Principle:
Principle #35Parameter changes

2Area of stationary object

If cameras are mounted at non-intuitive locations around the vehicle to improve coverage, then the visibility of hidden zones is improved, but the intuitiveness of the images deteriorates

Engineering Contradiction:
Improvevisibility of hidden zonesVSAvoidintuitiveness of images
Core Design Contradiction:
Area of stationary objectVSEase of operation

Solution Approach 1:

The patent applies dimensionality change by transforming images from camera coordinate systems to a standardized vehicle-centered coordinate system. Even though cameras are mounted at various locations around the vehicle, the processing system reprojects the images to appear as if captured from intuitive, standardized positions. This dimensional transformation allows non-intuitive camera placements to produce intuitively understood images.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent creates virtual copies of the vehicle surrounding from standardized perspectives. Instead of displaying images directly from their actual camera mounting positions, the system generates copied representations that show the surrounding as if viewed from intuitive locations. This copying approach allows the use of optimally positioned cameras while maintaining intuitive image presentation.

Inventive Principle:
Principle #26Copying

3Measurement precision

If multiple sensors are used to generate three-dimensional environment map, then the accuracy of distance measurement is improved, but the device complexity increases

Engineering Contradiction:
Improvedistance measurement accuracyVSAvoidsensor system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent merges multiple sensor types (cameras, LIDAR, radar, ultrasound) into a unified sensor system that collectively generates a three-dimensional environment map. By combining these different sensing modalities, the system achieves high measurement precision through sensor fusion. The merging of multiple sensors allows the system to overcome the limitations of individual sensors and achieve accurate distance measurement while managing complexity through integrated processing.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent implements a multi-functional processing system that handles data from multiple sensor types through a single unified processor. The processor performs multiple functions including receiving data from various sensors, generating three-dimensional maps, correcting distortions, and producing final output images. This universal processing approach manages the complexity introduced by multiple sensors by consolidating the processing functions into a single multi-capable system.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enhances driver understanding by providing a clear, adjustable perspective of the vehicle's surroundings, aiding in accurate distance judgment and obstacle recognition, particularly in challenging maneuvers like parallel parking.

Implementation Method 1

measuring, by at least one sensor device (2) on the vehicle, distances (3) to objects of the vehicle surrounding

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Implementation Method 2

measuring, by at least one sensor device (2) on the vehicle, distances (3) to objects of the vehicle surrounding

Methodology Applied
Scientific EffectLIDAR: LIDAR

Data Source

PatentUS8044781B2System and method for displaying a 3D vehicle surrounding with adjustable point of view including a distance sensor
Publication Date: 2011.10.25 VOLKSWAGEN AG
  • US8044781B2 patent drawing
  • US8044781B2 patent drawing
  • US8044781B2 patent drawing

AI summary

A system and method relates to displaying a vehicle surrounding with an adjustable point of view, including at least one sensor device on the vehicle, a processor, and a display. The sensor device is configured to measure distances to objects of the vehicle surrounding. In addition, the processor is configured to generate a three-dimensional environment map based on the measured distances of the sensor device. Further, the display is configured to display the three-dimensional environment map having an adjustable point of view based on a particular driving situation.