Stereo Vision Operator Alertness Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Monocular machine vision is inadequate for reliably detecting operator alertness, especially when the operator does not face forward or wears eyeglasses, as it lacks depth perception and is insufficient for three-dimensional analysis.

Innovation Solution

A stereo vision system that collects and processes three-dimensional data using a pair of imaging units offset by a known spatial amount, combining images to create a three-dimensional representation of the operator, which allows for the detection of angular shifts and motion thresholds to determine alertness.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If monocular machine vision is used to detect operator alertness, then the system complexity is reduced, but the measurement precision and reliability of operator position and movement detection deteriorates due to lack of depth perception

Engineering Contradiction:
Improvesystem complexityVSAvoidoperator position and movement detection precision
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent transitions from monocular (2D) vision to stereo (3D) vision by adding a second imaging unit offset from the first. This dimensional change enables depth perception through parallax, allowing accurate three-dimensional reconstruction of operator head position and orientation, thereby resolving the measurement precision problem while accepting increased system complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Device complexity

If monocular vision is used, then the device complexity is lower, but the reliability of alertness detection deteriorates when operator does not face forward or wears eyeglasses

Engineering Contradiction:
Improveimaging system complexityVSAvoidalertness detection reliability
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

By implementing stereo vision with two offset imaging units, the system captures images from different spatial perspectives. This enables three-dimensional reconstruction of the operator's head position and orientation, allowing reliable detection of alertness states regardless of head direction or eyeglass presence, as the system can distinguish between actual head position and artifacts from single-view imaging.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Measurement precision

If stereo vision system is implemented, then the measurement precision and reliability of operator alertness detection is improved, but the device complexity increases due to additional imaging units and processing requirements

Engineering Contradiction:
Improveoperator alertness detection precisionVSAvoidimaging and processing system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent implements stereo vision by adding a second imaging unit offset from the first, enabling three-dimensional reconstruction of operator head position. This dimensional enhancement improves measurement precision and reliability of alertness detection, accepting the trade-off of increased device complexity in imaging hardware and processing requirements.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

4Reliability

If stereo vision is used to detect angular shifts, then the reliability of alertness detection is improved, but the difficulty of detecting and measuring increases due to complex three-dimensional data processing

Engineering Contradiction:
Improvealertness detection reliabilityVSAvoidangular shift detection difficulty
Core Design Contradiction:
ReliabilityVSDifficulty of detecting and measuring

Solution Approach 1:

The system uses stereo vision to capture images from two offset perspectives, enabling three-dimensional reconstruction of head position. The processor then calculates angular shifts by comparing the three-dimensional coordinates of head features between successive images, providing reliable alertness detection through systematic mathematical processing of the additional dimensional data.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS7692550B2Method and system for detecting operator alertness
Publication Date: 2010.04.06 DEERE & CO
  • US7692550B2 patent drawing
  • US7692550B2 patent drawing
  • US7692550B2 patent drawing

AI summary

A method and system for detecting operator alertness of an operator of a vehicle or machine comprises an image collection system. The image collection system collects reference position data and reference motion data associated with an operator, or a portion thereof, when the operator is in an alert state. An image, processor determines observed position data and observed motion data of one or more points of a three dimensional representation of the operator during a time interval. An analyzer sends an alert signal to alert the operator if a detected angular shift of one or more reference points of the representation exceeds at feast one of a displacement threshold and a motion threshold.