Vehicle Display Control Using Gaze-Touch Intent Verification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current vehicle systems rely solely on single user interactions, such as touch screen contacts, which can lead to inaccurate or unintended operation of vehicle features, failing to correct for inadvertent gestures or selections.

Innovation Solution

A system that utilizes multiple sensors, including cameras and touch sensors, to detect user orientation and interaction data, determining if the distance between the user's gaze and touch satisfies a threshold, thereby controlling vehicle operations accurately and preventing unintended actions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple sensors are used to detect user orientation and interaction, then user intent recognition accuracy is improved, but device complexity increases

Engineering Contradiction:
Improveuser intent recognition accuracyVSAvoidsensor system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system divides the sensing function into multiple independent sensors (camera for gaze detection, touch sensor for contact detection, proximity sensor for distance measurement). Each sensor handles a specific aspect of user interaction, allowing the system to achieve high measurement precision through segmented functional decomposition while managing complexity through modular design.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The computing device integrates multiple sensing functions (gaze detection, touch detection, proximity measurement) into a single unified system that controls vehicle features. This multi-functional integration improves user intent recognition accuracy by combining multiple data sources while managing overall system complexity through centralized processing.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If gaze and touch interaction are both detected, then accuracy of vehicle feature control is improved, but ease of operation deteriorates

Engineering Contradiction:
Improvevehicle feature control accuracyVSAvoiduser interaction simplicity
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system uses proximity sensing to detect when a user approaches the display, automatically switching to a mode that requires both gaze and touch for confirmation. This feedback mechanism ensures accurate vehicle feature control by verifying user intent through multiple interaction modalities while adapting to user proximity, thereby managing operational complexity dynamically.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system dynamically adjusts its interaction requirements based on user proximity and context. When the user is close to the display, the system requires both gaze and touch detection for confirmed control actions. This dynamic adjustment ensures high control accuracy while adapting to different usage scenarios, balancing precision with ease of operation.

Inventive Principle:
Principle #15Dynamics

3Reliability

If distance threshold verification is implemented, then prevention of unintended actions is improved, but loss of time increases

Engineering Contradiction:
Improveprevention of unintended actionsVSAvoidinteraction response time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The proximity sensor continuously monitors user distance from the display in advance, preparing the system to verify intent when the user approaches. This preliminary detection allows the system to quickly transition to confirmed interaction mode (requiring both gaze and touch) when needed, preventing unintended actions while minimizing time loss by being ready before the interaction occurs.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses distance threshold verification as a preliminary protective measure to prevent unintended vehicle feature control. By checking whether the user is within the appropriate distance range before responding to touch input, the system adds a safety layer that prevents accidental operations while keeping the verification process efficient through pre-established threshold criteria.

Inventive Principle:
Principle #9Preliminary anti-action

Data Source

PatentUS11768536B2Systems and methods for user interaction based vehicle feature control
Publication Date: 2023.09.26 TOYOTA JIDOSHA KK
  • US11768536B2 patent drawing
  • US11768536B2 patent drawing
  • US11768536B2 patent drawing

AI summary

A method for controlling vehicle operations based on user orientation and user interaction data is provided. The method includes detecting, using a sensor operating in conjunction with the computing device of the vehicle, an orientation of a part of a user relative to a location on a display that is positioned in an interior of the vehicle, detecting, using an additional sensor, an interaction between the user and a portion of the display positioned in the interior of the vehicle, determining, using the computing device, whether a distance between the location and the portion of the display satisfies a threshold, and controlling, by the computing device, an operation associated with the vehicle responsive to determining that the distance between the location and the portion of the display satisfies the threshold.