A-Pillar Display Gaze Detection Using Coordinate Conversion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

It is difficult to determine whether a driver is gazing at an A-pillar-mounted display assembly based solely on the spatial positions of the display assembly and the driver's eyes, due to the structural complexity of the A-pillar and the need to acquire accurate facial posture information.

Innovation Solution

The method involves establishing a world coordinate system, acquiring facial posture information of the driver, and converting display assembly coordinates from the world coordinate system to the camera coordinate system using a conversion relationship between the camera and world coordinate systems, allowing determination of whether the display assembly is within the driver's visual field and capturing external images for display.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If spatial positions of display assembly and driver's eyes are used to determine gaze, then the method is simple, but the accuracy is insufficient due to A-pillar structural complexity

Engineering Contradiction:
Improvedetermination method complexityVSAvoidgaze detection accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent introduces a target feature model as an intermediary between the camera coordinate system and the world coordinate system. By establishing conversion relationships through this intermediate model, the system accurately determines the display assembly's position relative to the driver's visual field without being affected by A-pillar structural complexity. This intermediary approach enables precise gaze detection while maintaining systematic simplicity.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent transforms the gaze determination problem from direct spatial position comparison to a coordinate system conversion problem. By changing the parameter representation from raw spatial coordinates to converted coordinates through established conversion relationships, the system achieves accurate visual field assessment independent of A-pillar structural variations.

Inventive Principle:
Principle #35Parameter changes

2Loss of time

If direct spatial position comparison is used, then the process is fast, but the accuracy of visual field assessment is reduced

Engineering Contradiction:
Improvedetermination timeVSAvoidvisual field assessment accuracy
Core Design Contradiction:
Loss of timeVSMeasurement precision

Solution Approach 1:

The patent performs preliminary actions by pre-establishing conversion relationships between coordinate systems before actual gaze determination. The target feature model is pre-configured with known coordinates, and conversion relationships are established in advance. When gaze determination is needed, the system only needs to apply these pre-established relationships to convert coordinates and compare positions, achieving both speed and accuracy.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If facial posture information is acquired through complex coordinate conversions, then the accuracy of eye position detection is improved, but the system complexity increases

Engineering Contradiction:
Improveeye position detection accuracyVSAvoidcoordinate system conversion complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The target feature model serves as a standardized intermediary that simplifies the coordinate conversion process. Instead of directly converting between arbitrary camera and world coordinate systems, the system uses the target feature model with known coordinates as a reference framework. This intermediary structure provides a systematic and repeatable conversion process that improves measurement precision while maintaining manageable system complexity.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11884214B2Display method for A-pillar-mounted display assemblies, and display device of A-pillars of vehicle, and storage medium thereof
Publication Date: 2024.01.30 BEIJING BOE OPTOELECTRONCIS TECH CO LTD
  • US11884214B2 patent drawing
  • US11884214B2 patent drawing
  • US11884214B2 patent drawing

AI summary

Provided is a display method for A-pillar-mounted display assemblies of a vehicle. The method includes: acquiring facial posture information of a driver of the vehicle in a camera coordinate system by any one driver monitoring assembly of at least one driver monitoring assembly, determining a visual field of the driver based on a gaze direction of the driver and the eye position of the driver, acquiring coordinates of the two display assemblies in a world coordinate system, converting the coordinates of the two display assemblies in the world coordinate system into coordinates in the camera coordinate system based on a first conversion relationship, determining whether any one display assembly of the two display assemblies is within the visual field, and capturing an external image of the vehicle captured by the imaging assembly.