Remote Steering Feedback Display for Lag-Induced Trajectory Mismatch

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In remote piloting systems, communication lag between the pilot seat and the mobile body leads to a lapse between steering timing by the operator and the actual mobile body, causing instability due to unnecessary adjustments.

Innovation Solution

A remote operating device with a steering unit, display unit, and control unit that receives and displays actual steering information, allowing operators to easily ascertain the mobile body's movement by comparing predicted and actual trajectory lines, and adjusting the display format based on overlap thresholds to enhance intuitive understanding.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If remote piloting is implemented with external pilot seat, then operator can control mobile body from distance, but communication lag causes lapse between steering timing in pilot seat and actual mobile body

Engineering Contradiction:
Improveremote operation capabilityVSAvoidsteering timing synchronization
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The system displays actual steering information from the mobile body alongside steering information for the steering unit on a display unit. This feedback mechanism allows the operator to see the relationship between their steering inputs and the actual mobile body response, compensating for the communication lag by providing visual confirmation of the timing discrepancy and enabling the operator to anticipate and adjust for the delay.

Inventive Principle:
Principle #23Feedback

2Ease of operation

If steering information is displayed without visual comparison, then system is simple, but operator cannot easily ascertain relationship between steering input and mobile body movement

Engineering Contradiction:
Improvesteering controlVSAvoidmovement feedback
Core Design Contradiction:
Ease of operationVSLoss of information

Solution Approach 1:

The display unit serves as an intermediary that presents both the steering information for the steering unit and the actual steering information from the mobile body in a visually comparable format. This intermediary interface allows the operator to directly observe the relationship between their steering inputs and the actual mobile body movement, bridging the information gap created by communication lag.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Reliability

If operator makes frequent steering adjustments to compensate for lag, then mobile body behavior becomes unstable, but without adjustments the mobile body does not respond timely

Engineering Contradiction:
Improvemobile body behavior stabilityVSAvoidsteering response time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

By displaying both steering information streams simultaneously, the system enables the operator to perform preliminary mental adjustment for the known communication lag. The operator can anticipate the timing discrepancy and pre-adjust their steering inputs accordingly, rather than reacting to the lag after it occurs, thereby maintaining stability while ensuring timely response.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12135548B2Remote operating device, remote operating system, steering information display method, and non-transitory storage medium
Publication Date: 2024.11.05 TOYOTA JIDOSHA KK
  • US12135548B2 patent drawing
  • US12135548B2 patent drawing
  • US12135548B2 patent drawing

AI summary

A remote operating device including a steering unit configured to steer a mobile body, a display unit configured to display steering information, and a control unit. The control unit includes a memory and a processor coupled to the memory. The processor is configured to receive actual steering information regarding the mobile body, acquire steering information for steering the steering unit, determine a difference between the actual steering information regarding the mobile body and the steering information for steering the steering unit, and cause the steering information for steering the steering unit and the actual steering information regarding the mobile body to be displayed on the display unit based on the difference.