Autonomous Vehicle Interior Sensor Fusion for Cleaning Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Autonomous vehicles face challenges in effectively evaluating and maintaining the interior condition of taxis, including passenger safety and comfort, due to limitations in sensor systems and decision-making processes for navigation and obstacle avoidance.

Innovation Solution

A sensor system and method that integrates exterior sensors for navigation and collision avoidance with interior sensors to evaluate the vehicle's interior state, using a controller and machine learning models to assess conditions and decide on necessary actions, such as cleaning or route adjustments, based on data from cameras, IR cameras, humidity sensors, and electro-chemical sensors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If exterior sensors are used for navigation and collision avoidance, then the vehicle can navigate and avoid obstacles, but the interior condition cannot be evaluated

Engineering Contradiction:
Improvenavigation and collision avoidance capabilityVSAvoidinterior evaluation capability
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The sensor system is designed to perform multiple functions: exterior sensors (cameras, LIDAR, radar) handle navigation and collision avoidance, while interior sensors (cameras, humidity sensors, electro-chemical sensors) evaluate interior conditions. The controller integrates data from both sensor sets to make comprehensive decisions about vehicle operation and interior maintenance, allowing a single system to achieve both navigation reliability and interior evaluation versatility.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Reliability

If interior sensors are added to evaluate vehicle interior state, then passenger safety and comfort can be assessed, but the system complexity increases

Engineering Contradiction:
Improvepassenger safety and comfort assessmentVSAvoidsensor system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent combines interior sensors (cameras, humidity sensors, electro-chemical sensors) with the existing exterior sensor system and controller. The controller integrates data from both interior and exterior sensors to make unified decisions about vehicle operation, cleaning needs, and passenger safety, thereby managing system complexity through centralized processing while achieving comprehensive monitoring.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The sensor system is segmented into distinct functional modules: exterior sensors for navigation, interior sensors for environment monitoring, and a controller that processes data from both. This segmentation allows each component to be optimized for its specific function while the controller coordinates their combined operation, managing overall system complexity through modular architecture.

Inventive Principle:
Principle #1Segmentation

3Measurement precision

If multiple sensors are integrated to assess interior conditions, then measurement precision improves, but device complexity increases

Engineering Contradiction:
Improveinterior condition assessment accuracyVSAvoidsensor integration complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

Multiple interior sensors (cameras for visual inspection, humidity sensors for moisture detection, electro-chemical sensors for contaminant detection) are merged into a coordinated monitoring system. The controller processes data from all sensor types simultaneously, combining their measurements to achieve comprehensive and precise interior condition assessment while managing complexity through integrated processing.

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enhances passenger safety and comfort by accurately assessing interior conditions and making informed decisions to maintain a clean and safe environment, improving the overall autonomous taxi service experience.

Implementation Method 1

outputs of interior sensors, including one or more cameras, one or more infrared (IR) cameras

Methodology Applied
Scientific EffectInfrared radiation detection: Infrared Radiation

Implementation Method 2

one or more humidity sensors

Methodology Applied
Scientific EffectHumidity detection: Hygrometer

Implementation Method 3

one or more electro-chemical sensors

Methodology Applied
Scientific EffectElectro-chemical detection: Electrochemiluminescence

Data Source

PatentUS10479328B2System and methods for assessing the interior of an autonomous vehicle
Publication Date: 2019.11.19 FORD GLOBAL TECH LLC
  • US10479328B2 patent drawing
  • US10479328B2 patent drawing
  • US10479328B2 patent drawing

AI summary

An autonomous vehicle includes interior sensors including a camera, IR camera, electro-chemical sensor, humidity sensor, and temperature sensor. Initial and final outputs of these sensors are captured for a trip conveying one or more passengers. If changes in the outputs of the sensors are detected, whether the final outputs of the sensors are acceptable may be evaluated. In some embodiments, an aggregation of the outputs is evaluated and found unacceptable even where individual outputs are acceptable. Outputs may be presented to a dispatcher to confirm that the outputs are unacceptable. If the outputs are found to be unacceptable, the vehicle may be autonomously driven to a cleaning station. Personal items may be identified in camera outputs and alerts generated in response.