Vision-Based Vehicle Interior Sensing Using Baseline Image Deviation Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current systems for monitoring the interior environment of autonomous vehicles lack effective methods to detect changes and deviations post-passenger events, such as forgotten items or cabin conditions, which can lead to inefficiencies and discomfort for subsequent passengers.

Innovation Solution

A vehicle sensing system that generates baseline and event image models using imaging devices, identifies image deviations, and operates based on these differences to notify passengers of forgotten items, schedule maintenance, and ensure cabin readiness.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If human operators manually inspect the vehicle interior after passenger events, then detection accuracy of forgotten items and cabin conditions is improved, but labor costs and time consumption increase

Engineering Contradiction:
Improvedetection accuracyVSAvoidtime consumption
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The vehicle sensing system performs self-inspection of the interior environment using imaging devices and processing systems, eliminating the need for manual human inspection while maintaining detection accuracy through automated image comparison against baseline models

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces manual mechanical inspection with an automated electronic sensing system that uses imaging devices, processors, and computational algorithms to detect deviations in the vehicle interior environment

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Device complexity

If no monitoring system is implemented, then device complexity is reduced, but reliability of passenger comfort and safety is worsened

Engineering Contradiction:
Improvesystem complexityVSAvoidpassenger comfort reliability
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The monitoring system is segmented into modular components including imaging devices positioned at specific locations, a processing system that compares images against baseline models, and notification systems that alert passengers or operators of detected deviations

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system establishes a feedback loop where the sensing system continuously monitors the interior environment, compares current images against stored baseline models, and provides notifications when deviations are detected, enabling timely responses to maintain passenger comfort and safety

Inventive Principle:
Principle #23Feedback

3Productivity

If automated sensing systems are deployed to monitor cabin conditions, then productivity of vehicle operations is improved, but energy consumption increases

Engineering Contradiction:
Improvevehicle operation efficiencyVSAvoidenergy consumption
Core Design Contradiction:
ProductivityVSUse of energy by moving object

Solution Approach 1:

The imaging devices operate periodically rather than continuously, capturing images at specific intervals or when triggered by events such as door opening/closing or completion of passenger events, thereby reducing energy consumption while maintaining effective monitoring

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

Baseline image models are generated and stored in advance during vehicle manufacturing or initial setup, eliminating the need for continuous real-time processing and comparison, thus reducing computational energy requirements during actual vehicle operation

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11410436B2Method and system for vision-based vehicle interior environment sensing guided by vehicle prior information
Publication Date: 2022.08.09 ROBERT BOSCH GMBH
  • US11410436B2 patent drawing
  • US11410436B2 patent drawing
  • US11410436B2 patent drawing

AI summary

A method for operating a vehicle including a vehicle sensing system includes generating a baseline image model of an cabin of the vehicle based on image data of the cabin of the vehicle generated by an imaging device of the vehicle sensing system, the baseline image model generated before a passenger event, and generating an event image model of the cabin of the vehicle based on image data of the cabin of the vehicle generated by the imaging device, the event image model generated after the passenger event. The method further includes identifying image deviations by comparing the event image model to the baseline image model with a controller of the vehicle sensing system, the image deviations corresponding to differences in the cabin of the vehicle from before the passenger event to after the passenger event, and operating the vehicle based on the identified image deviations.