In-Car Agent Interface Using Gesture and Voice for Driver Trust

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing agent apparatuses struggle to establish a trust relationship with drivers and effectively communicate danger avoidance actions, leading to delayed responses in critical situations.

Innovation Solution

An agent apparatus equipped with a shift position detector and controller that positions a personified agent to face the driver, uses voice output, and arm movements to convey information and express gratitude, establishing a trust relationship and facilitating prompt action in danger scenarios.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If voice notification is used to warn the driver, then the notification can be heard, but it is not intuitive enough to prompt the driver to take immediate action

Engineering Contradiction:
Improvenotification effectivenessVSAvoiddriver response speed
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

A personified agent character is introduced as an intermediary between the danger warning system and the driver. The agent uses expressive body movements, gestures, and facial expressions to convey danger information, making the notification more intuitive and actionable than voice alone. The agent acts as a mediator that translates abstract warnings into concrete, easily understood visual cues.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces purely acoustic notification (voice) with a visual embodiment system. The agent's physical movements and expressions substitute for verbal commands, providing more immediate and intuitive understanding. This substitution of mechanical/acoustic signaling with visual-anthropomorphic signaling enhances driver comprehension and response speed.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Loss of information

If the agent faces the driver to communicate information, then communication is more direct, but the agent cannot monitor the road ahead simultaneously

Engineering Contradiction:
Improvecommunication clarityVSAvoidroad monitoring capability
Core Design Contradiction:
Loss of informationVSReliability

Solution Approach 1:

The agent's orientation is made dynamic rather than fixed. The agent can rotate and face different directions depending on the situation - facing the driver during communication, facing forward during road monitoring, or facing sideways to indicate directional information. This dynamic repositioning allows the agent to fulfill multiple functional roles without compromise.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The agent is designed as a multi-functional entity that can simultaneously perform communication, road monitoring, and directional indication functions. By making the agent's facing direction controllable and context-dependent, a single agent unit serves multiple purposes that would otherwise require separate systems.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Device complexity

If the agent uses only voice output to communicate, then the system is simple, but the communication lacks empathy and trust-building capability

Engineering Contradiction:
Improvecommunication system complexityVSAvoidtrust relationship establishment
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent merges multiple communication modalities - voice output, body movements, gestures, and facial expressions - into a single integrated agent communication system. This combination creates a more empathetic and trustworthy interaction than voice alone, as the agent can convey emotion and intent through multiple synchronized channels, enhancing the driver-agent trust relationship.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS12054049B2Agent apparatus
Publication Date: 2024.08.06 SUBARU CORP
  • US12054049B2 patent drawing
  • US12054049B2 patent drawing
  • US12054049B2 patent drawing

AI summary

An agent apparatus includes a shift position detector and an agent controller. The shift position detector is configured to detect a shift position of a vehicle. The agent controller is configured to control a personified agent. The agent controller is configured to cause the agent to face a driver of the vehicle in a case where the shift position is in a parking range. Upon communicating information, the agent controller is configured to cause the agent to output the information using voice and a movement of arms of the agent.