Camera Mirror Display Calibration for Driver Gaze Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current driver distraction detection systems in vehicles face reliability issues due to inaccuracies in determining the position of cameras relative to the driver, which affects the ability to identify and respond to distracted driving events effectively.

Innovation Solution

A camera mirror system incorporating first and second exterior cameras, displays, and interior cameras with a controller that initiates a calibration procedure using patterns to establish accurate camera positions and distances for monitoring driver activity, including gaze and pose, within the vehicle cabin.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a single interior camera is used for driver monitoring, then the device complexity is reduced, but the measurement precision of driver gaze and pose deteriorates

Engineering Contradiction:
Improvenumber of interior camerasVSAvoiddriver gaze and pose detection accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The driver monitoring function is segmented into multiple interior cameras positioned at different locations within the vehicle cabin. Each camera captures a specific field of view, and the controller integrates data from multiple cameras to achieve comprehensive and precise driver monitoring, resolving the contradiction between device complexity and measurement precision.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system transitions from a single-camera two-dimensional view to a multi-camera three-dimensional spatial understanding of the driver's position, gaze direction, and pose. By adding spatial dimensions through multiple camera perspectives, the system achieves higher measurement precision without excessive complexity increase.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Ease of operation

If camera positions are not calibrated, then the ease of operation is improved, but the reliability of driver distraction detection deteriorates

Engineering Contradiction:
Improvesystem setup simplicityVSAvoiddriver distraction detection accuracy
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system performs preliminary calibration action automatically during vehicle startup or when triggers are activated. The calibration process establishes accurate camera position and orientation data before normal operation begins, ensuring reliable driver distraction detection without requiring manual setup by the operator.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The calibration process is designed to be self-executing, where the system automatically calibrates the interior cameras using visible features in the cabin environment. This self-service calibration maintains reliability while preserving ease of operation, as no manual intervention is required.

Inventive Principle:
Principle #25Self-service

3Measurement precision

If multiple interior cameras are positioned to cover overlapping fields of view, then the measurement precision of driver activity is improved, but the device complexity increases

Engineering Contradiction:
Improvedriver activity monitoring accuracyVSAvoidcamera system configuration
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

Multiple interior cameras are designed with universal functionality to perform the same driver monitoring tasks from different positions. Each camera is configured to capture driver activity within its field of view, and the controller universally processes data from all cameras using the same algorithms, achieving high measurement precision while managing complexity through functional uniformity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11999299B2Camera mirror system display camera calibration
Publication Date: 2024.06.04 STONERIDGE ELECTRONICS
  • US11999299B2 patent drawing
  • US11999299B2 patent drawing
  • US11999299B2 patent drawing

AI summary

A camera mirror system for a vehicle includes, among other things, first and second exterior cameras that are configured to provide capture images outside of the vehicle that correspond to legally prescribed views. The system further includes first and second displays within a vehicle cabin that are configured to depict the captured images respectively from the first and second exterior cameras. The system further includes first and second interior cameras that are configured to capture driver images within the vehicle cabin. The first and second interior cameras respectively have first and second interior fields of view that overlap one another in a vehicle driver region within the vehicle cabin, the first display is in the second interior field of view, and the second display is in the first interior field of view. The system further includes a controller that is in communication with the first and second displays and the first and second interior cameras. The controller is configured to monitor a driver activity in the vehicle driver region using the first and second interior cameras. The controller is configured to initiate a calibration procedure in response to a calibration event. The calibration procedure includes first and second displays that respectively depict first and second patterns, and the first and second interior cameras detect respectively the second and first patterns to calibrate the first and second cameras in relation to the vehicle driver region to establish a distance between each of the first and second interior cameras and the second and first patterns respectively.