Remote Vehicle Control Using Accelerated Context Playback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Autonomous vehicles often require manual assistance in unexpected situations, such as road construction or severe weather, which can be inefficient and costly due to the need for operators to be physically and psychologically prepared for remote control.

Innovation Solution

A method and system that detect the need for manual assistance, modify vehicle data streams to prepare operators, and adapt vehicle operations to ensure timely arrival at a takeover position, enabling efficient remote control by adjusting playback speed and providing real-time data to operators.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the operator is provided with historical vehicle data in real-time speed, then the operator can be physically and psychologically prepared for remote control, but the time required for operator preparation increases

Engineering Contradiction:
Improveoperator preparation qualityVSAvoidoperator preparation time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system performs preliminary action by providing the operator with historical vehicle data (video, audio, sensor data) before the actual remote control task begins. This allows the operator to familiarize themselves with the vehicle environment, recent events, and operational context in advance, ensuring they are physically and psychologically prepared without delaying the subsequent real-time control operation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The operator preparation process is segmented into two distinct phases: (1) historical data review phase where the operator examines past vehicle data at their own pace, and (2) real-time control phase where the operator takes control of the vehicle. This segmentation allows thorough preparation without extending the actual remote control execution time.

Inventive Principle:
Principle #1Segmentation

2Reliability

If the vehicle waits for the operator to be ready before reaching the takeover position, then the operator can be adequately prepared, but the overall mission time increases

Engineering Contradiction:
Improveremote control readinessVSAvoidvehicle mission efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The vehicle performs preliminary actions by continuously collecting and buffering historical data during autonomous operation. When remote control is requested, the operator receives this pre-collected data immediately, eliminating the need for the vehicle to wait or slow down specifically for operator preparation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The vehicle maintains continuous autonomous operation without interruption while the operator prepares. The historical data is prepared in parallel with vehicle operation, allowing both processes to occur simultaneously rather than sequentially, thus maintaining mission efficiency.

Inventive Principle:
Principle #20Continuity of useful action

3Reliability

If the operator receives comprehensive vehicle data, then the operator can make informed decisions, but the data transmission and processing load increases

Engineering Contradiction:
Improveoperator decision qualityVSAvoiddata processing system
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system extracts and transmits only the most relevant historical data to the operator, such as video footage from critical moments, audio recordings of key events, and sensor data related to specific situations. This selective extraction provides sufficient information for informed decision-making while reducing overall data transmission and processing requirements.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

Different types of vehicle data are provided with different levels of detail and quality based on their relevance to the current situation. For example, video data from critical moments is provided in high detail, while routine operational data is provided in summary form. This local quality approach ensures decision-making quality while optimizing data processing load.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11256251B2Enabling remote control of a vehicle
Publication Date: 2022.02.22 TELEFONAKTIEBOLAGET LM ERICSSON (PUBL)
  • US11256251B2 patent drawing
  • US11256251B2 patent drawing
  • US11256251B2 patent drawing

AI summary

It is provided a method for enabling remote control of a vehicle with autonomous propulsion capability. The method is performed by a vehicle data provider and comprises: detecting a need for manual assistance of the vehicle by an operator being remote from the vehicle; obtaining a stream of vehicle data, the vehicle data relating to a time prior to when remote control starts; modifying the vehicle data, which comprises adjusting a duration of playback of the vehicle data; providing the modified vehicle data for playback to the operator; providing, once the playback of modified vehicle data has ended, vehicle data in real-time to the operator; and enabling remote control of the vehicle by the operator.