AV Teleoperation Intervention for Unexpected Driving Events

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Autonomous vehicles (AVs) face challenges in handling unexpected events such as system faults, extreme weather, and temporary detours, which can lead to risks like collisions or traffic jams, and existing systems lack effective remote intervention capabilities to safely navigate these situations.

Innovation Solution

A teleoperation system that allows a remote operator to interact with an AV's onboard client and server, enabling intervention by analyzing signals from hardware and software components, detecting malfunctions or unknown objects, and adjusting the vehicle's mode or trajectory through an interactive interface, using machine learning and inference algorithms to ensure safe operation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If autonomous driving capabilities are implemented, then productivity and automation are improved, but reliability deteriorates when unexpected events occur

Engineering Contradiction:
Improveautonomous driving capabilityVSAvoidsystem reliability during unexpected events
Core Design Contradiction:
Extent of automationVSReliability

Solution Approach 1:

A teleoperation system serves as an intermediary between the autonomous vehicle system and human operators. When the AV system encounters unexpected events it cannot handle, the system automatically connects to a remote operator who can intervene and provide assistance, thus maintaining reliability while preserving autonomous operation for normal conditions

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs preliminary actions by establishing teleoperation capabilities and connection infrastructure before unexpected events occur. The AV system is pre-configured with teleoperation clients and servers that can be activated when needed, ensuring immediate response capability without compromising normal autonomous operation

Inventive Principle:
Principle #10Preliminary action

2Reliability

If teleoperation intervention is enabled, then reliability is improved during unexpected events, but device complexity increases

Engineering Contradiction:
Improvesystem reliability with teleoperationVSAvoidteleoperation system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The teleoperation system is segmented into distinct functional modules: an AV system module that handles autonomous driving, a teleoperation client module that manages communication requests, and a teleoperation server module that processes operator interventions. This segmentation allows each component to be developed, tested, and maintained independently, reducing overall system complexity while maintaining reliability

Inventive Principle:
Principle #1Segmentation

3Object-affected harmful factors

If remote operator intervention is implemented, then safety is improved during critical events, but loss of time occurs during operator allocation and intervention

Engineering Contradiction:
Improvesafety risks during critical eventsVSAvoidtime for operator allocation and intervention
Core Design Contradiction:
Object-affected harmful factorsVSLoss of time

Solution Approach 1:

The system performs preliminary actions by pre-establishing teleoperation infrastructure and maintaining ready-state connections with operators. When critical events occur, the system can immediately activate teleoperation capabilities without time-consuming setup, reducing intervention delay while maintaining safety

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements continuous feedback mechanisms that monitor AV system status and automatically detect when teleoperation intervention is needed. This automated detection and triggering system eliminates manual assessment time and ensures rapid response to critical events, balancing safety improvement with minimal time loss

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12067810B2Intervention in operation of a vehicle having autonomous driving capabilities
Publication Date: 2024.08.20 MOTIONAL AD LLC
  • US12067810B2 patent drawing
  • US12067810B2 patent drawing
  • US12067810B2 patent drawing

AI summary

Among other things, a determination is made that intervention in an operation of one or more autonomous driving capabilities of a vehicle is appropriate. Based on the determination, a person is enabled to provide information for an intervention. The intervention is caused in the operation of the one or more autonomous driving capabilities of the vehicle.