Gaze-Assisted Voice Control for Unique Apparatus Selection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems struggle to accurately specify a unique apparatus for operation based on driver voice recognition, leading to potential incorrect operations.

Innovation Solution

An information processing device that utilizes line-of-sight data to specify a target apparatus for operation, generating control commands based on both line-of-sight and voice data to reduce incorrect operations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If voice recognition alone is used to specify the target apparatus, then the ease of operation is improved, but the reliability deteriorates due to inability to uniquely identify the apparatus

Engineering Contradiction:
Improveease of operationVSAvoidreliability
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent combines voice recognition data with line-of-sight direction data to specify the target apparatus. The controller integrates both types of information, using the line-of-sight direction from the imaging device and the voice recognition result to uniquely identify which apparatus the driver intends to operate, thereby resolving the ambiguity that occurs with voice recognition alone.

Inventive Principle:
Principle #5Merging (Combining)

2Device complexity

If only voice data is used for apparatus specification, then the device complexity is reduced, but the measurement precision deteriorates in identifying the target apparatus

Engineering Contradiction:
Improvedevice complexityVSAvoidmeasurement precision
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The system merges voice data processing with line-of-sight direction detection. The controller receives both the voice recognition result and the line-of-sight direction from the imaging device, combining these two information sources to precisely identify the target apparatus, thereby improving measurement precision without adding excessive complexity.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS12475891B2Information processing device and information processing method
Publication Date: 2025.11.18 NISSAN MOTOR CO LTD
  • US12475891B2 patent drawing
  • US12475891B2 patent drawing

AI summary

An information processing device and an information processing method each stores line-of-sight data pertaining to a user's line of sight direction of acquired by a line-of-sight-data-receiving unit, and specifies a target apparatus to be operated based on the line-of-sight data when the voice data was acquired and the target apparatus to be operated cannot be specified based on the voice data. A control command is generated that is directed at the target apparatus to be operated based on the voice data, and the target apparatus to be operated is controlled.