Vehicle Cabin Imaging Using Reflections to Overcome Occlusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Digital imaging devices in vehicles often face occlusions, leading to inaccurate or impossible observation of interior areas, such as rear seats, due to obstructed lines of sight, which hampers seat occupancy detection and other safety features.

Innovation Solution

A method utilizing a camera to capture images of vehicle interiors by combining direct and reflected electromagnetic waves, where the reflected waves from a reflective surface, such as a glass roof, provide an additional image region to determine characteristics even when the direct line of sight is occluded, using machine learning techniques for analysis and correction of distortions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a single camera is used to observe the vehicle interior, then the device complexity is reduced, but the observation reliability deteriorates due to occlusions

Engineering Contradiction:
Improvecamera system complexityVSAvoidobservation reliability
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent utilizes the reflective surface (glass roof) to create an indirect line of sight dimension, allowing the camera to observe areas occluded in the direct line of sight. This adds a spatial dimension (reflected path) to the observation, enabling the single camera to overcome occlusion problems without adding more cameras.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The glass roof acts as an intermediary element that reflects electromagnetic waves from occluded areas to the camera. This intermediary surface enables the camera to indirectly observe regions that would otherwise be hidden, resolving the contradiction between using a simple single-camera system and achieving reliable observation.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If the camera is mounted at extreme positions to avoid occlusions, then the observation reliability improves, but the ease of operation and installation deteriorates

Engineering Contradiction:
Improveobservation reliabilityVSAvoidcamera mounting ease
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The glass roof serves as a mediator that enables the camera to be mounted in conventional, easily accessible positions while still achieving observation of occluded areas through reflection. This eliminates the need for extreme mounting positions, maintaining ease of installation while improving observation reliability.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The glass roof performs multiple functions: it serves as both the vehicle's roof structure and as a reflective surface for indirect observation. This multi-functionality allows the system to achieve reliable observation without requiring special mounting positions or additional components.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Reliability

If multiple cameras are deployed to eliminate occlusion blind spots, then the observation reliability improves, but the device complexity and cost increases

Engineering Contradiction:
Improveobservation reliabilityVSAvoidcamera system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

Instead of adding more cameras to cover blind spots, the patent uses the reflective surface to create an indirect observation dimension. This allows a single camera to capture both direct and reflected views, achieving comprehensive coverage without increasing the number of cameras or system complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The reflective surface creates an optical copy or virtual image of the occluded area, allowing the camera to observe the scene indirectly. This copying mechanism enables the single camera system to achieve the same observation reliability as multiple cameras would provide.

Inventive Principle:
Principle #26Copying

4Measurement precision

If the camera relies solely on direct line of sight, then the measurement precision is high, but the reliability deteriorates when occlusions occur

Engineering Contradiction:
Improvedetection precisionVSAvoidobservation reliability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The system merges information from both direct line of sight regions and reflected line of sight regions to determine characteristics inside the cabin. This combination allows the system to maintain high detection precision when the direct view is available and switch to or supplement with reflected views when occlusions occur, ensuring continuous reliable observation.

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables continuous and accurate detection of objects and occupants within the vehicle interior, even under occlusions, without the need for additional cameras or extreme mounting positions, enhancing safety features like seat occupancy detection and awareness monitoring.

Implementation Method 1

The image comprises at least one first region representing the area reflected by at least one reflective surface provided in the cabin

Methodology Applied
Scientific EffectReflection: Reflection

Data Source

PatentUS20230377352A1Methods and Systems for Determining One or More Characteristics Inside a Cabin of a Vehicle
Publication Date: 2023.11.23 APTIV TECHNOLOGIES AG
  • US20230377352A1 patent drawing
  • US20230377352A1 patent drawing
  • US20230377352A1 patent drawing

AI summary

Methods and systems are described that implement determining one or more characteristics of the interior of a vehicle that lead to a reliable detection or observation of objects even if the direct line of sight between the objects and the camera is occluded. In an aspect, a computer implemented method includes the following operations carried out by computer hardware components: determining an image of an area of a cabin inside a vehicle using a sensor, the image including at least one first region representing the area reflected by at least one reflective surface provided in the cabin and at least one second region representing the area in a direct line of sight; and determining one or more characteristics inside the cabin of the vehicle based on at least one of: the at least one first region of the image; or the at least one second region of the image.