Remote Assistance Matching for Repetitive Autonomous Vehicle Requests

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing vehicle remote assistance systems for autonomous vehicles are inefficient as they require frequent remote operator intervention, leading to increased workload when multiple autonomous vehicles on the same lane encounter similar assistance requests, such as lane deviation avoidance from obstacles.

Innovation Solution

A vehicle remote assistance system and server that determine if a current assistance request is similar to past requests, allowing pre-stored assistance content to be transmitted to the autonomous vehicle instead of requiring continuous remote operator input, reducing the frequency of operator intervention by using a database to match request situations and automatically transmitting relevant assistance content.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If remote operator performs continuous assistance for each autonomous vehicle encountering similar situations, then assistance reliability is maintained, but remote operator workload increases significantly

Engineering Contradiction:
Improveassistance reliabilityVSAvoidremote operator workload
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The system creates a virtual model (digital twin) of the autonomous vehicle that replicates its state, sensor data, and operational context. This virtual copy allows remote operators to interact with a simulated representation rather than directly managing multiple physical vehicles, significantly reducing workload while maintaining assistance reliability through accurate state replication.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The system pre-processes and transmits relevant vehicle data, sensor information, and contextual parameters to the remote operator before assistance is needed. By preparing assistance packages in advance and maintaining updated virtual models, the system eliminates the need for operators to gather information in real-time during critical situations, reducing response time and workload.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If remote assistance is provided for every autonomous vehicle on the same lane encountering similar obstacles, then comprehensive safety is ensured, but operational efficiency decreases due to repetitive assistance

Engineering Contradiction:
Improvesafety coverageVSAvoidoperational efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system creates a single virtual model that can serve multiple autonomous vehicles simultaneously. When one vehicle encounters an obstacle, the remote operator provides assistance through the virtual model, and this assistance can be automatically applied or adapted for other vehicles facing similar situations on the same lane, ensuring comprehensive safety coverage while eliminating repetitive manual intervention.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system merges multiple vehicle assistance requests into a single unified remote operation when vehicles are in similar situations. By combining assistance needs and applying a single remote control action that benefits multiple vehicles, the system maintains safety coverage for all vehicles while dramatically improving operational efficiency by reducing the number of separate assistance operations required.

Inventive Principle:
Principle #5Merging (Combining)

3Measurement precision

If real-time remote control is implemented for minute steering operations, then precise vehicle control is achieved, but system complexity and response time requirements increase

Engineering Contradiction:
Improvesteering control precisionVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The virtual model acts as an intermediary between the autonomous vehicle's sensors and the remote operator's control inputs. It processes and filters sensor data, maintaining precise steering control information in a simplified format, and translates remote operator actions into appropriate control commands. This intermediary layer maintains control precision while reducing the complexity of direct real-time communication between multiple vehicles and operators.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentEP3982226B1Vehicle remote assistance system, vehicle remote assistance server, and vehicle remote assistance method
Publication Date: 2024.04.17 TOYOTA JIDOSHA KK
  • EP3982226B1 patent drawingFigure 1
  • EP3982226B1 patent drawingFigure 2
  • EP3982226B1 patent drawingFigure 3

AI summary

A vehicle remote assistance system (1) including: a remote assistance example database (4) in which a past assistance request situation and a remote assistance content made by a remote operator are stored in association with each other, and a server (10). The server (10) is configured to, upon receipt of a remote assistance request from an autonomous vehicle (2), determine whether or not a remote assistance request situation of the autonomous vehicle (2) is similar to the past assistance request situation stored in the remote assistance example database, based on a position of the autonomous vehicle (2) transmitting the remote assistance request and an external environment around the autonomous vehicle (2); and the server (10) is configured to, when the server (10) determines that the remote assistance request situation is similar to the past assistance request situation, transmit the remote assistance content corresponding to the past assistance request situation to the autonomous vehicle (2) in substitution for the remote operator.