Teleoperation System for Autonomous Vehicle Intervention

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Autonomous vehicles (AVs) face challenges in handling unexpected events such as system faults, extreme weather, and temporary detours, which can lead to risks like collisions or traffic jams, and existing systems lack effective remote intervention capabilities to manage these situations.

Innovation Solution

A teleoperation system that allows a remote operator to interact with an AV's onboard client and server, enabling intervention in the vehicle's autonomous driving capabilities by analyzing signals for malfunctions or unusual events, and allowing fallback interventions such as switching to manual mode, identifying safe locations, and updating trajectories or speed profiles.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If autonomous driving capabilities are implemented without remote intervention, then automation level is improved, but reliability deteriorates when unexpected events occur

Engineering Contradiction:
Improveautonomous driving capabilityVSAvoidhandling of unexpected events
Core Design Contradiction:
Extent of automationVSReliability

Solution Approach 1:

A teleoperation system acts as an intermediary between the autonomous vehicle and remote operators. The system includes a teleoperation client in the vehicle and a teleoperation server that can establish communication channels with remote operators when unexpected events occur, allowing human intervention while maintaining autonomous operation during normal conditions.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system dynamically transitions between fully autonomous mode and teleoperated mode based on the situation. An event processing component monitors vehicle operations and automatically initiates teleoperation when unexpected events are detected, allowing the automation level to adapt to changing conditions rather than remaining static.

Inventive Principle:
Principle #15Dynamics

2Reliability

If remote intervention capabilities are added to handle unexpected events, then reliability is improved, but device complexity increases

Engineering Contradiction:
Improvehandling of unexpected eventsVSAvoidteleoperation system structure
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The teleoperation system is segmented into distinct functional components: a teleoperation client module in the vehicle, a teleoperation server, an event processing component, and a fallback operation component. This modular architecture allows each component to perform specific functions independently, making the overall complex system more manageable and maintainable.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary actions by pre-establishing teleoperation communication channels and pre-defining fallback operations before unexpected events occur. When events happen, the system can quickly activate pre-prepared intervention protocols rather than creating responses in real-time, reducing the operational complexity during critical moments.

Inventive Principle:
Principle #10Preliminary action

3Ease of operation

If teleoperation communication channels are established, then intervention capability is improved, but loss of time occurs during channel establishment

Engineering Contradiction:
Improveremote intervention capabilityVSAvoidchannel establishment time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The teleoperation client and server establish communication channels in advance before unexpected events occur. The system maintains ready-to-use communication pathways so that when an event requires human intervention, operators can immediately connect without experiencing delays from establishing new channels.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The communication channel establishment is made dynamic based on event urgency. The event processing component can prioritize different types of events and adjust the speed at which teleoperation channels are established, with critical events receiving immediate channel allocation while less urgent events can wait for standard channel availability.

Inventive Principle:
Principle #15Dynamics

4Reliability

If fallback interventions are implemented, then reliability is improved, but device complexity increases

Engineering Contradiction:
Improvesafe operation under faultsVSAvoidfallback intervention mechanisms
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system implements beforehand cushioning by pre-defining multiple fallback operations that can be executed when the autonomous driving system encounters unexpected events. These fallback operations include safe stopping procedures, mode switching protocols, and emergency communication protocols that are prepared in advance to cushion against potential failures.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

Solution Approach 2:

Different fallback interventions are applied based on the specific type and severity of the unexpected event. Rather than using a single universal fallback mechanism, the event processing component analyzes the event characteristics and selects appropriate localized fallback operations, such as different stopping procedures for different road conditions or different communication priorities for different event types.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10599141B2Intervention in operation of a vehicle having autonomous driving capabilities
Publication Date: 2020.03.24 MOTIONAL AD LLC
  • US10599141B2 patent drawing
  • US10599141B2 patent drawing
  • US10599141B2 patent drawing

AI summary

Among other things, a determination is made that intervention in an operation of one or more autonomous driving capabilities of a vehicle is appropriate. Based on the determination, a person is enabled to provide information for an intervention. The intervention is caused in the operation of the one or more autonomous driving capabilities of the vehicle.