Remote Steering Reaction Force Compensation for Network Delay

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In remote driving systems, the delay in communication between the vehicle and the remote driving apparatus leads to a time lag in transmitting steering reaction force to the remote driver, causing vibrations in the steering wheel operation and making it difficult to maintain a straight-traveling state.

Innovation Solution

An information processing apparatus that estimates delay time and model parameters based on vehicle state information to accurately calculate and transmit steering reaction force to the remote driver, using a delay time estimation unit and parameter estimation unit to synchronize and adjust the steering reaction force calculation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If steering reaction force is transmitted via Internet communication between vehicle and remote driving apparatus, then remote driver can feel steering reaction force, but delay occurs causing time lag between steering reaction force generation and transmission

Engineering Contradiction:
Improveremote driver's ability to feel steering reaction forceVSAvoiddelay time in transmitting steering reaction force
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system performs preliminary actions by predicting future steering reaction force values based on current vehicle state and delay time characteristics. The prediction is made in advance to compensate for the known communication delay, so when the delayed signal arrives, it already reflects the correct timing for the remote driver's steering operation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses feedback from the remote driver's steering wheel operations to continuously update the prediction model. By monitoring the actual steering inputs and comparing them with predicted reactions, the system adjusts its delay compensation algorithm to minimize the time lag effect and improve the responsiveness of the transmitted steering reaction force.

Inventive Principle:
Principle #23Feedback

2Reliability

If steering reaction force with time lag is transmitted to remote driver, then communication delay is accepted, but vehicle behavior at transmission time differs from generation time causing vibration in steering wheel operation

Engineering Contradiction:
Improvetransmission of steering reaction forceVSAvoidstability of steering wheel operation
Core Design Contradiction:
ReliabilityVSStability of the object's composition

Solution Approach 1:

The system calculates and transmits steering reaction force values in advance, before the actual delay period elapses. By using prediction algorithms that account for the known delay time, the system prepares the corrected steering reaction force data ahead of time, ensuring that when transmitted, it corresponds to the actual vehicle state at the moment of steering input, thereby preventing vibrations and maintaining operational stability.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If steering reaction force is calculated based on sensor data with timestamp, then accuracy of vehicle state information is improved, but delay time estimation complexity increases

Engineering Contradiction:
Improveaccuracy of vehicle state information timingVSAvoidcomplexity of delay time estimation
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system uses the timestamp information already embedded in the sensor data to self-determine the delay time. Rather than requiring external calibration or complex measurement equipment, the system leverages the existing time markers in the data stream to calculate delay periods, thereby maintaining measurement precision while avoiding excessive complexity in the delay estimation mechanism.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS20260054773A1Information processing apparatus, information processing method, and program
Publication Date: 2026.02.26 SONY GROUP CORP
  • US20260054773A1 patent drawing
  • US20260054773A1 patent drawing
  • US20260054773A1 patent drawing

AI summary

The present technology relates to an information processing apparatus, an information processing method, and a program that enable appropriate transmission of steering reaction force to a remote driver.The information processing apparatus includes a delay time estimation unit configured to estimate, on a basis of vehicle state information, delay time occurring until a vehicle which is a target of remote driving executes, in response to a remote driving operation using an operation unit including a first steering wheel, an action corresponding to the remote driving operation, the vehicle state information being information from the vehicle, indicating a state related to the vehicle, and including one or more pieces of state data having added thereto a timestamp indicating an acquisition time point, and a parameter estimation unit configured to estimate, on a basis of the vehicle state information and the delay time, a model parameter that is a parameter of a model that is used in calculation of a first steering reaction force for the first steering wheel. The present technology can be applied to remote driving systems, for example.