Surround View Monitoring System with Depth Camera Distance Overlay

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional Surround View Monitoring (SVM) systems struggle to accurately display distance information to obstacles, particularly on the sides of vehicles, due to image distortion and lack of effective distance sensing methods.

Innovation Solution

The system incorporates multiple registration cameras and depth cameras that photograph and synthesize images around a vehicle, using infrared sensing to acquire distance information, which is then displayed on a display device with obstacles highlighted in preset colors based on distance, allowing for intuitive distance recognition by the driver.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If multiple registration cameras are used to create a 360-degree surround view, then the coverage area is improved, but image distortion occurs making it difficult to determine obstacle distance

Engineering Contradiction:
Improvecoverage areaVSAvoiddistance determination accuracy
Core Design Contradiction:
Area of stationary objectVSMeasurement precision

Solution Approach 1:

The system divides the surround view display into multiple regions: a first region showing the synthesized 360-degree view and a second region showing an enlarged view of the obstacle area. This segmentation allows the main view to maintain wide coverage while the enlarged region provides distortion-corrected, accurate distance information for obstacle measurement.

Inventive Principle:
Principle #1Segmentation

2Loss of information

If conventional SVM systems display surrounding images, then obstacles can be visualized, but distance information cannot be accurately determined due to image distortion

Engineering Contradiction:
Improveobstacle visualizationVSAvoiddistance information accuracy
Core Design Contradiction:
Loss of informationVSMeasurement precision

Solution Approach 1:

The system introduces an intermediary enlarged view that acts as a mediator between the distorted surround view and the driver's need for accurate distance information. This intermediate display shows the same obstacle area with corrected geometry and overlaid distance markers, allowing drivers to accurately judge distances while maintaining the benefits of the full surround view.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Measurement precision

If ultrasonic sensors are used for front and rear distance assistance, then short-range detection is possible, but side obstacle distance information remains unavailable

Engineering Contradiction:
Improveshort-range detection accuracyVSAvoidside obstacle detection coverage
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The system uses the registration cameras intended for visual coverage to also provide distance measurement functionality through the enlarged view with overlaid distance information. This multi-functional use of the camera system eliminates blind spots on all sides of the vehicle, not just front and rear, providing universal obstacle detection capability throughout the entire surround view.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables drivers to intuitively recognize obstacle distances through clear and accurate display of distance information on a 360-degree surround view, enhancing safety by clearly indicating close obstacles and allowing for timely maneuvers.

Implementation Method 1

The depth camera may sense a distance with respect to the obstacle existing around the vehicle by transmitting and receiving infrared ray around the vehicle.

Methodology Applied
Scientific EffectInfrared sensing: Infrared Radiation

Data Source

PatentUS11648888B2Surround view monitoring system and providing method of the same
Publication Date: 2023.05.16 HYUNDAI MOBIS CO LTD
  • US11648888B2 patent drawing
  • US11648888B2 patent drawing
  • US11648888B2 patent drawing

AI summary

A surround view monitoring system and a method for providing the same, including a plurality of registration cameras, each mounted on a vehicle and photographing different areas around the vehicle; a depth camera that acquires distance information with respect to an obstacle existing around the vehicle; an image synthesis unit that generates a synthesis image by synthesizing images photographed by the plurality of registration cameras, and displays the distance information with respect to the obstacle acquired by the depth camera on an obstacle existing in the synthesis image; and an image control unit that displays the synthesized synthesis image on a display device are disclosed.