Driver Gaze Interaction for Faster In-Vehicle AI Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing vehicle interaction systems require users to perform specific actions, such as speaking or pressing buttons, to enable and disable devices, which can disrupt driving operations and slow down responses.
Innovation Solution
A vehicle interactive system that uses data from multiple cameras to determine user intentions based on gaze direction and line-of-sight data, allowing for automatic control of vehicle-mounted AI devices and other in-vehicle systems without manual intervention.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If users perform manual actions (speaking or pressing buttons) to enable and disable vehicle interaction devices, then the devices can be controlled, but driving operations are disrupted and response time increases
Solution Approach 1:
The system performs preliminary action by continuously monitoring user gaze direction and facial expressions before actual interaction is needed. The camera captures user eye movements and the processor analyzes gaze direction in advance, so when the user looks at a control interface, the system is already prepared to respond, eliminating the need for manual activation actions and reducing response time
Solution Approach 2:
The patent replaces manual mechanical actions (pressing buttons, speaking commands) with optical-based gaze tracking. The camera system detects eye direction and the processor interprets gaze data to automatically determine user intent, substituting the mechanical interaction system with an optical detection and computational interpretation system that operates more quickly and naturally
2Reliability
If manual actions are required to control vehicle devices, then device functions can be activated, but driving safety is compromised due to distraction
Solution Approach 1:
The system implements self-service by automatically detecting and responding to user gaze direction without requiring manual activation. The camera continuously monitors eye movements, the processor analyzes gaze data to determine which interface the user is looking at, and the system automatically activates or responds to the relevant function, making the interface serve itself based on user attention rather than requiring explicit commands
Solution Approach 2:
The system uses feedback by continuously monitoring user gaze direction and facial expressions through the camera, processing this visual data in real-time, and adjusting the vehicle interface responses based on detected user intent. This closed-loop feedback mechanism ensures the system responds appropriately to user needs while maintaining natural driving behavior
Data Source
Figure 1
Figure 2
Figure 3
AI summary
The invention relates to a vehicle interactive system and method, a storage medium, and a vehicle. The vehicle interactive system includes: a data acquisition device configured to acquire first data indicating a user intention; a data processing device configured to obtain the user intention based on the first data; and an execution device configured to control a vehicle based on the user intention, where the first data is data about a user line of sight. According to the solutions in one or more embodiments of the invention, processing of information about a user line of sight is combined with vehicle control, so that a user does not need to control an apparatus on a vehicle by hand or voice, thereby having experience of more natural and convenient human-vehicle interaction.