Onboard Merge Display Cues for Autonomous Driving Handovers

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing onboard display systems for autonomous vehicles do not effectively communicate the need for driver intervention during merging operations, lacking clear visual cues for when autonomous driving will cease and requiring manual control.

Innovation Solution

An onboard display control device that acquires information about the point at which autonomous merging attempts will be aborted and displays this information visually within the vehicle cabin, using combined images of the traveling lane and fixed segments to indicate the need for driver intervention, including driving hand-over request and braking segments, to alert occupants before arrival at the abort point.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If autonomous merging is attempted without clear visual warnings, then automation continues uninterrupted, but driver understanding and preparation for intervention deteriorates

Engineering Contradiction:
Improveautonomous merging operationVSAvoiddriver understanding of intervention need
Core Design Contradiction:
Extent of automationVSLoss of information

Solution Approach 1:

The system performs preliminary action by displaying warning information about the abort point before the vehicle actually reaches it. The display control section shows the distance to the abort point and visual cues in advance, allowing the driver to prepare for potential intervention while the autonomous merging is still ongoing.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements feedback by continuously providing the driver with information about the merging status and distance to the abort point. The display control section updates the visual information dynamically, giving the driver real-time feedback about when intervention will be needed.

Inventive Principle:
Principle #23Feedback

2Loss of information

If detailed visual information about abort point is displayed, then driver understanding improves, but device complexity increases

Engineering Contradiction:
Improvedriver understanding of intervention needVSAvoiddisplay control system
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The information is segmented into distinct visual elements: the abort point position, the distance measurement, and visual cues indicating the merging status. This segmentation allows the complex information to be presented in an organized, easily comprehensible manner without overwhelming the driver.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system uses visual copying by displaying a graphical representation of the road layout with the abort point marked. Instead of using complex text descriptions, the system creates a simplified visual copy of the spatial relationship between the vehicle and the abort point.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS12157488B2Onboard display control device, onboard display device, display control method, and display control program
Publication Date: 2024.12.03 TOYOTA JIDOSHA KK
  • US12157488B2 patent drawing
  • US12157488B2 patent drawing
  • US12157488B2 patent drawing

AI summary

An onboard display device is installed in a vehicle configured to enable autonomous driving. The onboard display device includes an information acquisition section and a display control section. In a case in which the vehicle attempts to merge from a traveling lane into a merging destination lane during autonomous driving, the information acquisition section acquires information regarding a point at which the attempt will be aborted, before the vehicle arrives at the point. The display control section displays the information regarding the point that is acquired by the information acquisition section, before the arrival at the point, at a display portion that is provided within a vehicle cabin of the vehicle.