NLOS Sensor Hazard Detection for Obscured Vehicle Objects

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In traffic scenarios, especially with autonomously driving vehicles, detecting and avoiding collisions with obscured or non-visible moving objects is challenging when they become visible only later, leading to delayed recognition and reaction times.

Innovation Solution

Employing a combination of line-of-sight (LOS) and non-line-of-sight (NLOS) sensors, where NLOS sensors detect obscured objects using indirect electromagnetic signals and transmit data to an edge cloud device for processing, enabling early detection and calculation of object position, direction, and speed, which is then used by LOS sensors for faster and more precise recognition upon visibility.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If only LOS sensors are used for object detection, then the device complexity is reduced, but the response time to obscured objects increases

Engineering Contradiction:
Improveresponse timeVSAvoidsensor system complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The system performs preliminary detection of obscured objects using NLOS sensors before they enter the LOS detection range. By detecting objects indirectly through reflections earlier in time and space, the system prepares for potential hazards before they become directly visible, reducing the overall response time to obscured objects.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The invention introduces NLOS sensors as intermediary detection devices that use indirect reflection paths to detect objects that are not directly visible. These sensors act as mediators between the vehicle and obscured objects, providing early warning information that complements the direct LOS sensor detection.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If NLOS sensors are added to detect obscured objects, then the detection capability for obscured objects improves, but the device complexity increases

Engineering Contradiction:
Improvedetection reliabilityVSAvoidsensor system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The detection system is segmented into two distinct functional components: LOS sensors for direct line-of-sight detection and NLOS sensors for non-line-of-sight detection through reflections. This segmentation allows each sensor type to specialize in its optimal detection mode, improving overall reliability while maintaining manageable system complexity through modular architecture.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The sensor system is designed with multi-functionality, where the same vehicle platform integrates both LOS and NLOS detection capabilities. This universal approach allows a single system to handle both directly visible and obscured objects, improving detection reliability without requiring entirely separate systems.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If data processing is performed outside the vehicle, then the calculation accuracy for object parameters improves, but the communication requirements and system complexity increase

Engineering Contradiction:
Improveobject parameter calculation accuracyVSAvoidsystem integration complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

An edge cloud device serves as an intermediary between the vehicle sensors and the central processing system. This intermediary handles the computationally intensive tasks of calculating object parameters from sensor data, providing high measurement precision while offloading complexity from the vehicle's onboard systems to the edge cloud infrastructure.

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach reduces response time by allowing vehicles to prepare for potential dangers earlier and react faster to obscured objects, improving hazard detection and collision avoidance by leveraging edge cloud processing for accurate and quick calculations.

Implementation Method 1

the first sensor signals generated at the first time by means of the at least one NLOS sensor, wherein - after an evaluation of the first sensor signals - the moving object is detected

Methodology Applied
Scientific EffectReflection: Reflection

Implementation Method 2

the moving object is detected and/or recognized at the second time by means of second sensor signals generated by the at least one LOS sensor

Methodology Applied
Scientific EffectElectromagnetic radiation detection: Electromagnetic Induction

Data Source

PatentEP4099297B1Method for detecting hazards and / or collision avoidance in a moving vehicle, system, computer program and computer readable medium
Publication Date: 2024.02.21 DEUTSCHE TELEKOM AG
  • EP4099297B1 patent drawingFigure 1

AI summary

A method for hazard detection and/or collision avoidance of a moving vehicle with at least one moving object is proposed, wherein the at least one moving object is optically obscured or not visible in a straight line of sight from the vehicle at a first time point in time and is visible or detectable from the vehicle at a second time point in time, wherein the vehicle has at least one line-of-sight sensor and at least one non-line-of-sight sensor, wherein the method comprises the following steps: -- in a first step, initial sensor signals are generated at the first time point by means of the at least one NLOS sensor, wherein - after an evaluation of the initial sensor signals - the moving object is detected, wherein data regarding the position and/or direction of movement and/or speed and/or size of the moving object are determined or calculated.wherein the data or at least part of the data regarding the position and/or direction of movement and/or speed and/or size of the moving object outside the vehicle are determined or calculated, -- in a second step the moving object is detected and/or recognized at a second time by means of second sensor signals generated by the at least one LOS sensor, in particular on the basis of the data regarding the position and/or direction of movement and/or speed and/or size of the moving object.