Vehicle Surroundings Display Adaptation for Off-Screen Object Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current display systems in motor vehicles, which use cameras and sensors to show the surroundings, are limited by fixed focal lengths and do not dynamically adapt to relevant objects, potentially missing critical information outside the displayed image detail.

Innovation Solution

A computer-implemented method and device that acquires and processes image data using algorithms for object recognition and image processing to dynamically adapt the display, ensuring relevant objects are highlighted based on criteria such as distance or correspondence with reference objects, allowing for real-time awareness of important traffic elements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a camera with fixed focal length is used to display a specific region, then the display system is simple and easy to operate, but critical objects outside the fixed image detail may be missed

Engineering Contradiction:
Improvedetection reliabilityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system performs preliminary object recognition on a second partial area before final display composition. By pre-processing and identifying relevant objects in the second partial area that is not initially displayed, the system can proactively adjust the display to include critical objects, improving detection reliability without requiring complex real-time processing of the entire scene

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The display system dynamically adapts by adjusting the image detail based on detected objects. The focal length and displayed region are no longer fixed but can be modified in real-time based on object recognition results, allowing the system to prioritize displaying relevant objects while maintaining operational simplicity through automated control

Inventive Principle:
Principle #15Dynamics

2Loss of information

If the entire spatial area is displayed, then complete information is provided, but the display becomes overwhelming and critical information may be lost in the clutter

Engineering Contradiction:
Improveinformation completenessVSAvoiddisplay usability
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The system applies different processing qualities to different partial areas. The first partial area receives high-quality detailed display suitable for driver attention, while the second partial area undergoes object recognition and selective enhancement. This local differentiation ensures complete information capture without overwhelming the driver with uniformly detailed display of all areas

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The spatial area is segmented into a first partial area and a second partial area with different processing and display priorities. This segmentation allows the system to manage information completeness by processing the second partial area for object detection while displaying the first partial area with higher detail, preventing information loss while maintaining display usability

Inventive Principle:
Principle #1Segmentation

3Reliability

If object recognition is performed on the entire spatial area, then all objects are detected, but the processing time and computational resources increase significantly

Engineering Contradiction:
Improveobject detection reliabilityVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system extracts and performs object recognition only on the second partial area that is not currently displayed, rather than processing the entire spatial area. This extraction approach maintains detection reliability for objects that would otherwise be missed, while significantly reducing processing time by limiting the recognition scope to only the necessary region

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS20240246417A1Method and Device for Adapting a Display of the Surroundings of a Motor Vehicle
Publication Date: 2024.07.25 BAYERISCHE MOTOREN WERKE AG
  • US20240246417A1 patent drawing
  • US20240246417A1 patent drawing

AI summary

A method for adapting a display of the surroundings of a motor vehicle includes: (i) acquiring a first spatial area formed in the surroundings of the motor vehicle having a first partial area and a second partial area by way of a first image sensor; (ii) displaying an image detail which includes the first partial area by way of a display device; (iii) carrying out object recognition on the second partial area by way of an algorithm for object recognition stored in an evaluation device; and (iv) adapting the image detail by way of an algorithm for image processing stored in the evaluation device such that at least the object of the second partial area is displayed by the display device when carrying out the object recognition has had the result that an object is displayed in the second partial area and when the object meets a specified criterion.