Stereo Vision Operator Alertness Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Monocular machine vision is inadequate for reliably detecting operator alertness, especially when the operator does not face forward or wears eyeglasses, as it lacks depth perception and is inefficient in determining three-dimensional characteristics.

Innovation Solution

A system using stereo vision with an image processor and analyzer to determine if an operator's eye is visible and assess their alertness by analyzing three-dimensional representations of the operator's position and movement, even when they are not facing forward or wearing eyeglasses.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If monocular machine vision is used to detect operator alertness, then the system complexity is reduced, but the measurement precision and reliability of operator position and movement detection deteriorate due to lack of depth perception

Engineering Contradiction:
Improvesystem complexityVSAvoidoperator position and movement detection precision
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent transitions from monocular (2D) vision to stereo (3D) vision by introducing a second imaging unit positioned at a different location. This dimensional change enables depth perception through triangulation, allowing accurate determination of operator position and movement in three-dimensional space, which directly resolves the measurement precision problem while maintaining reasonable system complexity

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Device complexity

If monocular vision is used to detect operator alertness, then the device complexity is lower, but the reliability of detection deteriorates when operator does not face forward or wears eyeglasses

Engineering Contradiction:
Improvedevice complexityVSAvoidoperator alertness detection reliability
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

By adding the depth dimension through stereo vision, the system can accurately locate the operator's head position and orientation in 3D space regardless of facial direction. This enables reliable detection of alertness indicators even when the operator looks away or wears eyeglasses, as the system can track head position and movement patterns from multiple viewing angles

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The stereo vision system provides multi-functional capability by simultaneously capturing images from two different positions, enabling the system to analyze operator alertness through multiple parameters (head position, movement patterns, orientation) rather than relying on a single viewing angle, thus improving detection reliability across various operator states

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Device complexity

If monocular vision is used, then the system is simpler, but the capability to determine three-dimensional characteristics of operator position and movement is insufficient

Engineering Contradiction:
Improvesystem simplicityVSAvoidthree-dimensional characteristic detection capability
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The patent directly addresses the three-dimensional detection requirement by implementing stereo vision with two imaging units positioned at different locations. This configuration enables the system to calculate depth through triangulation and accurately determine spatial coordinates (x, y, z) of the operator's head, providing complete three-dimensional characterization of position and movement

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS7692551B2Method and system for detecting operator alertness
Publication Date: 2010.04.06 DEERE & CO
  • US7692551B2 patent drawing
  • US7692551B2 patent drawing
  • US7692551B2 patent drawing

AI summary

A method and system for detecting operator alertness of an operator of a vehicle or machine comprises an image processor and an analyzer. The image processor determines whether at least one eye of an operator is visible and determines whether the operator is generally facing forward with respect to the vehicle. The analyzer applies at least one of position analysis and motion analysis to a three dimensional representation of an operator to determine alertness of the operator if at least one eye of operator is not visible or If the operator is generally facing forward.