Tele-Operated Driving Codec Control for Variable Link Latency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Tele-operated driving systems face significant latency issues due to unpredictable changes in communication link quality, which can render real-time control of vehicles from remote control centers unsafe and inefficient.

Innovation Solution

Adapting codec parameters based on predicted latency and data rate to maintain total latency within tolerable limits, using methods such as selecting appropriate codecs and adjusting compression techniques, ensures that video and sensor data are processed and transmitted effectively during tele-operated driving sessions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Speed

If video data is transmitted with high compression to reduce latency, then transmission speed improves, but image quality deteriorates

Engineering Contradiction:
Improvetransmission speedVSAvoidimage quality
Core Design Contradiction:
SpeedVSManufacturing precision

Solution Approach 1:

The system dynamically adapts the compression level of video data based on real-time network conditions and latency requirements. When latency is critical for tele-operated driving control, higher compression is applied to ensure fast transmission. When network conditions permit, compression is reduced to maintain image quality. This dynamic adjustment resolves the contradiction between transmission speed and image quality.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes compression parameters (such as bitrate, resolution, frame rate) based on predicted latency values. When predicted latency exceeds thresholds, the system adjusts parameters to prioritize speed; when latency is acceptable, parameters are adjusted to prioritize quality. This parameter adaptation allows the system to optimize the trade-off between transmission speed and image quality for different operating conditions.

Inventive Principle:
Principle #35Parameter changes

2Manufacturing precision

If video data is transmitted with low compression to maintain image quality, then image quality improves, but transmission latency increases

Engineering Contradiction:
Improveimage qualityVSAvoidtransmission latency
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system dynamically adjusts compression levels based on real-time network conditions and latency requirements. When low latency is critical for tele-operated driving control, higher compression is applied even if it reduces image quality. When network conditions permit higher bandwidth, compression is reduced to maintain quality. This dynamic adjustment resolves the contradiction between image quality and transmission latency.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes compression parameters (bitrate, resolution, frame rate) based on predicted latency values and network conditions. When predicted latency is high, parameters are adjusted to reduce compression and improve quality. When latency is already low, parameters are adjusted to increase compression and reduce transmission time. This parameter adaptation allows optimization of the trade-off between quality and latency.

Inventive Principle:
Principle #35Parameter changes

3Loss of time

If codec parameters are frequently adapted to changing network conditions, then latency control improves, but system complexity increases

Engineering Contradiction:
Improvelatency controlVSAvoidsystem complexity
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The system performs preliminary actions by predicting future latency values based on current network conditions and historical data. Instead of reacting to latency changes after they occur, the system anticipates them and pre-adjusts codec parameters accordingly. This predictive approach improves latency control while reducing the complexity of continuous real-time monitoring and adjustment.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements feedback mechanisms where actual latency measurements and network condition changes are continuously monitored and fed back to the codec parameter adjustment logic. This feedback loop allows the system to learn from past performance and optimize parameter adaptation strategies, improving latency control while managing system complexity through adaptive learning rather than complex predetermined rules.

Inventive Principle:
Principle #23Feedback

Data Source

PatentEP3992743B1Vehicle, apparatus for a vehicle, computer program, and method for processing information for communication in a tele-operated driving session
Publication Date: 2023.08.30 VOLKSWAGEN AG
  • EP3992743B1 patent drawingFigure 1~2
  • EP3992743B1 patent drawingFigure 3~4
  • EP3992743B1 patent drawingFigure 5

AI summary

Embodiments provide a vehicle, an apparatus for a vehicle, a computer program, and a method (100) for processing information for communication in a tele-operated driving session between a vehicle and a remote control center. The method (100) comprises establishing (110) a tele-operated driving session between the vehicle and a remote control center. Further, the method (100) comprises obtaining (120) a predicted latency of a communication link between the remote control center and the vehicle for the tele-operated driving session. Also, the method (100) comprises adapting (130), based on the predicted latency, at least one codec parameter for coding the information.