In-Cabin Occupant Action Detection Using Standardized Driver Postures

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The increasing complexity of vehicle operating environments and systems poses a challenge in effectively detecting vehicle occupant actions, which contributes to driver risk, necessitating methods and systems for generating data representative of vehicle occupant actions.

Innovation Solution

A device and method that utilize previously classified image data from databases and current image data from vehicle interior sensors to detect vehicle occupant actions by comparing the two, allowing for the tracking of driver postures, hand positions, and attention levels, with a system capable of generating reports and providing warnings or advisories on in-cabin insurance risk evaluations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If vehicle systems and operating environments become more complex to provide better functionality, then vehicle capabilities and features are improved, but driver risk increases due to increased complexity

Engineering Contradiction:
Improvevehicle capabilitiesVSAvoiddriver risk
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system continuously monitors driver behavior through image capture devices and provides feedback by comparing current driver actions against previously classified image data. This feedback mechanism enables real-time detection of risky behaviors and allows the system to adapt to changing driving conditions while maintaining safety standards.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent introduces an intermediary classification system that processes and interprets complex driver behaviors. The system uses trained classifiers and image data processing as intermediaries between the complex vehicle environment and the driver, enabling accurate risk assessment without directly increasing driver workload or complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If image data processing is used to detect vehicle occupant actions, then detection accuracy is improved, but processing time and computational resources increase

Engineering Contradiction:
Improvedetection accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary classification of image data during normal operation, building a database of previously classified driver actions. This preliminary action enables faster real-time detection by comparing current images against pre-classified data, reducing processing time while maintaining high accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system processes only the necessary portions of image data required for detection. Rather than analyzing entire images in full detail, the system focuses on key regions and features relevant to driver behavior classification, reducing computational load while maintaining detection precision.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11861917B2Apparatuses, systems, and methods for detecting vehicle occupant actions
Publication Date: 2024.01.02 STATE FARM MUTAL AUTOMOBILE INSURANCE COMPANY
  • US11861917B2 patent drawing
  • US11861917B2 patent drawing
  • US11861917B2 patent drawing

AI summary

Method and system for detecting vehicle occupant actions are disclosed. For example, the method includes receiving, by one or more processors, previously classified image data from a previously classified image database, the previously classified image data representing driver postures that are rotated and scaled to be standardized for a range of different drivers and different locations of a vehicle interior sensor within a given vehicle, wherein the previously classified image data is representative of previously classified vehicle occupant actions; receiving, by the one or more processors, current image data from the vehicle interior sensor subsequent to the vehicle interior sensor being registered within the given vehicle, wherein the current image data is representative of current vehicle occupant actions; and determining, by the one or more processors, a vehicle occupant action based at least in part upon a comparison of the current image data and the previously classified image data.