Gaze-Guided Voice Control for Accurate Apparatus Selection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems struggle to accurately specify a unique apparatus for operation based on voice recognition, leading to potential incorrect operations.

Innovation Solution

An information processing device that specifies a target apparatus using line-of-sight data to determine the direction of a user's gaze, followed by voice data to generate control commands, thereby reducing the likelihood of incorrect operations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If voice recognition alone is used to specify the target apparatus, then the operation process is simple, but the accuracy of specifying the target apparatus deteriorates leading to incorrect operations

Engineering Contradiction:
Improveoperation process simplicityVSAvoidtarget apparatus specification accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent combines voice recognition results with line-of-sight direction information to specify the target apparatus. The controller integrates both inputs: voice data identifies potential apparatuses while line-of-sight data determines which specific apparatus the user is looking at, merging multiple information sources to achieve accurate target specification without increasing operational complexity for the user

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The line-of-sight detection function serves as an intermediary that bridges the gap between voice recognition and target apparatus selection. When voice recognition alone cannot uniquely identify the target apparatus, the line-of-sight direction acts as a mediator to disambiguate and precisely specify the intended target

Inventive Principle:
Principle #24Intermediary (Mediator)

2Device complexity

If voice recognition is used without line-of-sight data, then the device complexity is low, but the reliability of operation control deteriorates due to inability to specify unique target apparatus

Engineering Contradiction:
Improvedevice structure simplicityVSAvoidoperation control reliability
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The system merges voice recognition functionality with line-of-sight detection functionality in a unified control system. The controller processes both voice data and line-of-sight direction data together to reliably specify the target apparatus, combining the advantages of both methods while maintaining a relatively simple overall device structure

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system performs preliminary line-of-sight detection to pre-identify the direction of user attention before processing voice commands. This preliminary action of determining line-of-sight direction prepares the system to accurately resolve ambiguities in voice recognition, thereby improving operational reliability without significantly increasing complexity

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12454273B2Information processing device and information processing method
Publication Date: 2025.10.28 NISSAN MOTOR CO LTD
  • US12454273B2 patent drawing
  • US12454273B2 patent drawing

AI summary

An information processing device and an information processing method each perform specifying a target apparatus to be operated from a plurality of apparatuses based on line-of-sight data pertaining to a user's line of sight direction. After the target apparatus is specified, voice data is acquired to generate a control command for the target apparatus to be operated during a predetermined time span. Finally, the target apparatus to be operated is controlled.