In-Vehicle Camera Detection for Autonomous Cabin State Response

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Autonomous vehicles lack an efficient method to determine their internal state, such as occupancy and passenger conditions, especially in areas without cellular service or when a human operator is unavailable, leading to potential safety issues and inefficiencies.

Innovation Solution

A system using cameras and machine learning models to process images of the vehicle's interior, identifying visible markers and determining the internal state, which allows the vehicle to respond accordingly, such as providing notifications or controlling its actions, without relying on human intervention.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If autonomous vehicles use traditional methods to determine internal state, then they can operate with human assistance, but they become dependent on cellular service and human operators which reduces reliability in areas without service

Engineering Contradiction:
Improveinternal state determination reliabilityVSAvoidoperational independence
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The vehicle performs self-monitoring of its internal state using onboard cameras and machine learning models, eliminating dependence on human operators or external cellular service for occupancy detection and safety monitoring

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

Manual inspection and human operator intervention are replaced by automated computer vision systems and machine learning algorithms that process camera images to determine internal vehicle state

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Loss of information

If autonomous vehicles process internal state data locally, then privacy is improved and response time is reduced, but device complexity increases

Engineering Contradiction:
Improveprivacy protectionVSAvoidonboard processing system complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

Machine learning models act as intermediaries that process sensitive internal state data locally on the vehicle, preventing raw data from leaving the vehicle while still enabling remote systems to receive processed results if needed

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The processing system is divided into modular components including cameras, machine learning models, and control systems, allowing distributed processing that balances local privacy protection with system capabilities

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS12099365B2Determining and responding to an internal status of a vehicle
Publication Date: 2024.09.24 WAYMO LLC
  • US12099365B2 patent drawing
  • US12099365B2 patent drawing
  • US12099365B2 patent drawing

AI summary

Aspects of the disclosure relate to determining and responding to an internal state of a self-driving vehicle. For instance, an image of an interior of the vehicle captured by a camera mounted in the vehicle is received. The image is processed in order to identify one or more visible markers at predetermined locations within the vehicle. The internal state of the vehicle is determined based on the identified one or more visible markers. A responsive action is identified action using the determined internal state, and the vehicle is controlled in order to perform the responsive action.