Autonomous Vehicle Handover Control for Multi-Stage Teleoperation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Autonomous vehicles require human interaction for dynamic driving tasks, especially during handovers between automated driving systems and remote operators, which can be challenging due to communication delays and varying environmental conditions.

Innovation Solution

A vehicle operation system that enables multi-stage teleoperation by implementing a process based on sensor information and automation levels, allowing for handovers to occur while the vehicle is moving or stopped, and maintaining assistance features during teleoperation, using real-time interactions with remote operators and simulating the environment for control inputs.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If teleoperation is implemented for autonomous vehicles, then human interaction and control are improved, but communication delays and handover challenges worsen system reliability

Engineering Contradiction:
Improvehuman interactionVSAvoidhandover process
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The system performs preliminary actions by proactively identifying handover triggers and initiating handover sequences before critical situations arise. The automated driving system monitors for trigger conditions (sensor failures, environmental changes, operator availability) and starts the handover process in advance, allowing smooth transition without sudden loss of control during critical moments.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary handover management layer that mediates between the automated driving system and remote operator. This intermediary handles the complex handover coordination, monitoring both autonomous system status and operator availability, and managing the transition process to ensure reliability despite communication delays.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Adaptability or versatility

If multi-stage operation modes are implemented, then adaptability to different conditions is improved, but system complexity worsens

Engineering Contradiction:
Improveoperation modesVSAvoidsystem structure
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system segments autonomous operation into multiple distinct stages (full autonomy, partial autonomy, teleoperation) with clearly defined boundaries and transition criteria. Each stage has specific automation levels and operational characteristics, allowing the system to adapt to different conditions by switching between segmented modes rather than managing continuous complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system implements dynamic adaptability by allowing operation modes to change based on real-time conditions. The automated driving system can dynamically transition between autonomy stages and teleoperation based on sensor status, environmental factors, and operator availability, making the system versatile without requiring fixed complex configurations for each scenario.

Inventive Principle:
Principle #15Dynamics

3Productivity

If handovers occur while vehicle is moving, then operational continuity is improved, but safety risks worsen

Engineering Contradiction:
Improveoperational continuityVSAvoidsafety risks
Core Design Contradiction:
ProductivityVSObject-affected harmful factors

Solution Approach 1:

The system performs preliminary safety assessments and preparations before executing handovers during motion. It identifies suitable handover triggers, evaluates current operational conditions, and prepares the teleoperation interface in advance, ensuring that handovers can occur safely while maintaining operational continuity without sudden disruptions.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements continuous feedback monitoring during handover processes to detect safety concerns. It monitors sensor status, vehicle state, and operator response in real-time, allowing dynamic adjustment of the handover process to maintain safety while preserving operational continuity when conditions permit.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11644831B2Multi-stage operation of autonomous vehicles
Publication Date: 2023.05.09 UDELV INC
  • US11644831B2 patent drawing
  • US11644831B2 patent drawing
  • US11644831B2 patent drawing

AI summary

Systems and methods for operating a vehicle by switching between an autonomous control system within the vehicle and a remote operator are described herein. For the handover between the autonomous control system and the remote operator, the system can process current maneuvering parameters of the vehicle to at least select a teleoperation control type. The system can also generate a concurrent feature profile including a set of automated features that are configured to be implemented during teleoperation of the vehicle. The system can implement the handover of vehicle control according to the teleoperation control type while the vehicle autonomously or semi-autonomously operates according to the concurrent feature profile.