Autonomous Vehicle Driver Notification via Multi-Recognizer Selection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Autonomous vehicles lack effective notification to drivers of changes in driving actions due to sensor glitches or communication speed issues, as existing display devices do not account for changes in recognition apparatuses or targets, leading to incomplete driver information during automated driving.

Innovation Solution

An information presentation control apparatus that obtains selection information from multiple recognition units and presents driving information to the driver through a presentation device, including details of actions to be performed by the driver, using sound, image, or indicator lights, based on the status of recognition units and communication quality.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If multiple recognition units are used to improve recognition accuracy and coverage, then the system can detect more targets and improve reliability, but the device complexity and information processing burden increase

Engineering Contradiction:
Improverecognition reliabilityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system divides the recognition function into multiple specialized recognition units (e.g., object recognition, lane recognition, traffic light recognition) that operate independently. Each unit focuses on specific recognition tasks, improving overall reliability while keeping individual unit complexity manageable. The control device coordinates these segmented units rather than managing a monolithic complex system.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The control device serves multiple functions: it manages the automated driving system, selects appropriate recognizers based on communication quality, and controls information presentation to the driver. This multi-functionality reduces the need for separate dedicated systems, managing complexity while maintaining reliability through a centralized intelligent controller.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Reliability

If detailed driving information is provided to the driver to improve safety awareness, then the driver can better understand system limitations and take appropriate actions, but the information presentation complexity increases

Engineering Contradiction:
Improvedriving safetyVSAvoidinformation presentation complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The information presentation is tailored to specific situations and driver needs. The control device selectively presents different types of information (recognizer selection, target recognition status, communication quality indicators) based on the current driving context and detected driver state, rather than providing uniform detailed information in all situations. This reduces presentation complexity while maintaining safety.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system implements feedback loops where the control device monitors driver responses to presented information and adjusts subsequent information delivery. The driver's operational status and reactions provide feedback that helps the control device optimize information presentation, reducing complexity through adaptive rather than static information delivery.

Inventive Principle:
Principle #23Feedback

3Productivity

If the automated driving system operates autonomously without driver intervention to improve productivity, then the driving efficiency increases, but the loss of information about system limitations and operational status occurs

Engineering Contradiction:
Improvedriving efficiencyVSAvoiddriver awareness information
Core Design Contradiction:
ProductivityVSLoss of information

Solution Approach 1:

The control device proactively presents information about recognizer selection and system status to the driver before critical situations arise. By providing advance notice of system limitations and operational status, the driver is prepared to intervene if needed, maintaining high productivity while preventing information loss that could compromise safety.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The control device acts as an intermediary between the automated driving system and the driver. It translates complex system internal states (recognizer selection, communication quality) into comprehensible information for the driver, enabling the driver to maintain awareness without requiring direct involvement in system operations, thus preserving both productivity and information.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentEP3232289B1Information presentation control method and autonomous vehicle, and autonomous-vehicle driving support system
Publication Date: 2021.11.03 PANASONIC INTELLECTUAL PROPERTY CORP OF AMERICA
  • EP3232289B1 patent drawingFigure 1
  • EP3232289B1 patent drawingFigure 2
  • EP3232289B1 patent drawingFigure 3

AI summary

An information presentation control apparatus includes a selection information obtainer and a presentation controller. The selection information obtainer obtains selection information representing a selection status of a plurality of recognizers that recognize different targets in surroundings of an autonomous vehicle. The presentation controller causes a presentation device mounted in the autonomous vehicle to present driving information in accordance with the selection information, the driving information being based on at least one of control that is executable by the autonomous vehicle and control that is not executable by the autonomous vehicle and being information about at least one of driving by an automated driving system of the autonomous vehicle and driving by a driver.