Autonomous Vehicle Passenger Visualization System

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Passengers in autonomous vehicles experience discomfort and exhibit unexpected behavior due to the loss of control when the vehicle is operated by a computer, particularly when anticipating potential threats, which poses technical challenges for service providers to minimize these issues.

Innovation Solution

A system that collects sensor and contextual data to predict future events and generates a simulation of these events, presenting them to passengers through a user interface, such as augmented or virtual reality, to enhance their anticipation and confidence in the vehicle's decisions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If autonomous vehicles are operated by computer without human intervention, then productivity and automation are improved, but passenger comfort and control perception deteriorate

Engineering Contradiction:
Improveautonomous vehicle operationVSAvoidpassenger comfort
Core Design Contradiction:
Extent of automationVSEase of operation

Solution Approach 1:

The system provides continuous visual feedback to passengers through a display showing simulated future events and actual sensor data. This feedback loop allows passengers to see what the autonomous vehicle is detecting and planning, transforming the black-box operation into a transparent process that reduces discomfort while maintaining full automation.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent introduces an intermediary visualization system that mediates between the autonomous vehicle's computer operations and the passenger's perception. The display acts as a mediator, translating complex sensor data and future event predictions into comprehensible visual representations that enhance passenger understanding and comfort without requiring human intervention in vehicle control.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Ease of operation

If passengers anticipate potential threats without accurate information, then psychological comfort deteriorates, but providing detailed future event information increases system complexity

Engineering Contradiction:
Improvepassenger psychological comfortVSAvoidinformation processing and display system
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system applies partial action by selectively displaying only the most relevant future events and sensor data to passengers. Rather than overwhelming passengers with all possible information, the system prioritizes displaying threats and events that are most likely to impact passenger comfort and safety, processing complex data internally but presenting a focused, manageable visualization.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The visualization system segments complex future events into discrete, comprehensible components. The display breaks down predicted trajectories, sensor detections, and potential threats into separate visual elements that passengers can process individually, reducing the perceived complexity while maintaining comprehensive information delivery.

Inventive Principle:
Principle #1Segmentation

3Reliability

If passengers perceive loss of control, then unexpected behavior increases, but providing more control information may reduce automation effectiveness

Engineering Contradiction:
Improvepassenger behavior predictabilityVSAvoidvehicle control autonomy
Core Design Contradiction:
ReliabilityVSExtent of automation

Solution Approach 1:

The system performs preliminary action by displaying simulated future events before they actually occur. This allows passengers to mentally prepare for upcoming maneuvers or potential threats, reducing surprise and unexpected behavior. The advance visualization of vehicle trajectories and detected objects enables passengers to understand the autonomous system's intentions before executing actions.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10663963B2Method and apparatus for visualizing future events for passengers of autonomous vehicles
Publication Date: 2020.05.26 HERE GLOBAL BV
  • US10663963B2 patent drawing
  • US10663963B2 patent drawing
  • US10663963B2 patent drawing

AI summary

An approach is provided for visualizing future events to a passenger of a vehicle. The approach involves collecting sensor data, contextual data, or a combination thereof during an operation of a vehicle. The approach also involves processing the sensor data, the contextual data, or a combination thereof to predict a future event that is expected to occur proximate to the vehicle. The approach further involves generating a simulation of the future event. The approach further involves presenting the simulation in a user interface.