Dual Camera Driver Line of Sight Tracking for Adaptive Interface Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current vehicle infotainment systems lack personalized interfaces that adapt to individual driver characteristics and habits, leading to reduced driver concentration and safety due to the need for fixed line of sight and inefficient multimedia interaction.

Innovation Solution

A system utilizing dual cameras and voice recognition to track a driver's line of sight, detect facial features, and build customized learning data for intuitive interface control, enabling adaptive multi-modal interaction based on driver-specific patterns.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a conventional vehicle interface is used, then the driver can manipulate multimedia entities, but the driver must fix the line of sight which reduces driving concentration

Engineering Contradiction:
Improvemultimedia manipulationVSAvoiddriving concentration
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent replaces manual mechanical interaction (touching, clicking) with voice recognition and gesture recognition systems. The driver can issue voice commands or make simple gestures to manipulate multimedia entities without moving their hands or shifting their gaze, thus maintaining driving concentration while enabling ease of operation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system introduces an intermediary processing layer that interprets voice commands and gestures, translating them into interface operations. This intermediary system processes the driver's intent without requiring direct manual interaction with controls, allowing the driver to maintain forward-facing line of sight while still manipulating multimedia entities effectively.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Stability of the object's composition

If a restricted order interface is used, then the vehicle stability is maintained, but the driver receives no feedback of necessary and sufficient conditions

Engineering Contradiction:
Improvevehicle stabilityVSAvoiddriver feedback
Core Design Contradiction:
Stability of the object's compositionVSLoss of information

Solution Approach 1:

The system implements feedback mechanisms that provide the driver with information about the system's state and the results of their commands. Through voice and gesture recognition, the system can confirm command recognition, display relevant information, and provide status updates, ensuring the driver receives necessary feedback while maintaining vehicle stability through controlled interface interactions.

Inventive Principle:
Principle #23Feedback

3Ease of manufacture

If each interface is commonly applied for all drivers, then the system is simple to implement, but it does not learn the characteristics of individual drivers

Engineering Contradiction:
Improveinterface implementationVSAvoiddriver characteristic learning
Core Design Contradiction:
Ease of manufactureVSAdaptability or versatility

Solution Approach 1:

The system transitions from a static, one-size-fits-all interface to a dynamic adaptive interface that learns and adjusts to individual driver characteristics. By monitoring voice patterns, gesture preferences, and interaction behaviors, the system dynamically customizes the interface to match each driver's preferences, improving adaptability while maintaining implementation feasibility through modular learning algorithms.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS9485474B2System and method for learning driving information in vehicle
Publication Date: 2016.11.01 ELECTRONICS & TELECOMM RES INST
  • US9485474B2 patent drawing
  • US9485474B2 patent drawing
  • US9485474B2 patent drawing

AI summary

A system for learning driving information in a vehicle, includes a first camera mounted on an inner ceiling of the vehicle and configured to detect a projected position of a nose of a driver; and a second camera mounted on an inner front of the vehicle and configured to detect a front position of the nose of the driver. Further, the system includes a driver's status information processing unit configured to detect the line of sight of the driver by calibrating an image corresponding to the projected position and an image corresponding to the front position in real time, to analyze information about the line of sight that is detected, and to store the analyzed information in a learning data database.