Surround View Virtual Camera Positioning for Driver Assistance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing driver assistance systems, including surround view systems, face challenges in automatically adjusting the virtual camera position and viewing direction to effectively enhance driver spatial awareness, especially in obstructed views and dynamic driving situations, without providing obstructed views from the driver's perspective.

Innovation Solution

The system integrates a combination of cameras, sensors, and image processing to generate a surround view from multiple virtual camera positions and directions, using inputs from positioning sensors, object detection sensors, and radio receivers to select the most relevant view based on driving scenarios and potential threats, while allowing driver input for preferred views.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a fixed virtual camera position is used for surround view, then the system structure is simple, but the system cannot adapt to different driving situations and obstructed views

Engineering Contradiction:
Improveadaptability to driving situationsVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent implements dynamic adjustment of virtual camera position and viewing direction based on detected driving situations. The image processing device automatically selects from multiple pre-defined virtual camera positions and viewing directions according to the current driving context, making the system adaptive without requiring complex real-time optimization algorithms.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system pre-defines multiple virtual camera positions and viewing directions corresponding to different driving situations. By preparing these configurations in advance, the system can quickly adapt to changing driving conditions by simply selecting the appropriate pre-configured view, avoiding the need for complex real-time calculations.

Inventive Principle:
Principle #10Preliminary action

2Loss of information

If multiple virtual camera positions are provided, then driver spatial awareness is enhanced, but the device complexity increases

Engineering Contradiction:
Improvespatial awareness informationVSAvoidimage processing complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The system dynamically selects from multiple pre-defined virtual camera positions and viewing directions based on the detected driving situation. This approach provides comprehensive spatial information when needed while keeping the processing logic relatively simple through rule-based selection rather than complex real-time optimization.

Inventive Principle:
Principle #15Dynamics

3Ease of operation

If automatic view selection is implemented, then driver attention is directed to relevant threats, but the system requires complex sensor integration and processing

Engineering Contradiction:
Improvedriver attention managementVSAvoidsensor integration complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system pre-establishes the correspondence between different driving situations and optimal virtual camera positions. By preparing these mappings in advance, the automatic view selection can be achieved through relatively simple sensor data evaluation and lookup operations, rather than complex real-time optimization.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system continuously monitors driving situation through sensors and automatically adjusts the virtual camera position and viewing direction based on the detected context. This closed-loop feedback mechanism enables automatic attention management while keeping the control logic relatively simple through rule-based adjustments.

Inventive Principle:
Principle #23Feedback

Data Source

PatentEP3683102B1Systems for driver assistance
Publication Date: 2021.08.25 HARMAN INT IND INC
  • EP3683102B1 patent drawingFigure 1
  • EP3683102B1 patent drawingFigure 2
  • EP3683102B1 patent drawingFigure 3

AI summary

Systems and method for a driver assistance system including a surround view system are provided. In an example surround view system for a host vehicle, the surround view system comprises a front camera, a left side camera, a right side camera, a rear camera, a display, a positioning sensor, and an image processing device operatively connected to the cameras and to the display. The image processing device is configured to generate a view having a viewing direction from a virtual camera position, the viewing direction and the virtual camera position being selected from a plurality of virtual camera positions and viewing directions. An image from a default view is displayed to a driver of the host vehicle, and a viewing direction and a virtual camera position of the default view are selected by the image processing device in response to an output of the positioning sensor.