Selective Image Transmission for Low-Latency Teleoperated Driving

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In telephoned driving applications, existing methods face challenges in efficiently transmitting image data over mobile networks, leading to impaired driving functions due to data incompleteness and quality losses, particularly under conditions of reduced power quality and network throughput.

Innovation Solution

The method involves analyzing image data to select only predefined, traffic-relevant content for transmission, compressing and prioritizing it, and transmitting it over communication channels, ensuring essential information for vehicle control is maintained with reduced data volume and latency, while minimizing channel overload.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If all image data is transmitted without selection, then complete information is available for vehicle control, but data transmission volume is too large causing network overload and quality loss

Engineering Contradiction:
Improvedriving function qualityVSAvoiddata transmission volume
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent extracts and transmits only the essential image content relevant for vehicle control (such as road users, obstacles, and traffic signs) while excluding redundant information. This selective extraction reduces data transmission volume by up to 50% while maintaining the reliability needed for safe teleoperated driving.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies different transmission qualities to different regions of the image based on their relevance to vehicle control. High-priority regions containing critical control information are transmitted with higher quality and lower compression, while less critical regions use lower quality settings, optimizing the balance between data volume and driving function reliability.

Inventive Principle:
Principle #3Local quality

2Productivity

If image data is compressed heavily to reduce data volume, then network utilization improves, but image quality and control precision deteriorate

Engineering Contradiction:
Improvenetwork utilizationVSAvoidimage quality for control
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent implements differential compression where different regions of the image receive different compression levels based on their importance for vehicle control. Critical regions maintaining high visual fidelity with lower compression ratios, while non-critical areas undergo higher compression, thereby improving overall network utilization without sacrificing control precision.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent dynamically adjusts compression parameters such as bitrate, resolution, and compression ratio based on the identified importance of different image regions. This parameter optimization allows the system to achieve better network utilization while preserving the image quality necessary for accurate vehicle control decisions.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If full-resolution images are transmitted to maintain quality, then control accuracy is preserved, but transmission latency increases

Engineering Contradiction:
Improvecontrol accuracyVSAvoidtransmission latency
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent extracts only the essential visual information needed for vehicle control from full-resolution images, identifying and transmitting key features such as road users, obstacles, and traffic signs. This selective extraction reduces transmission latency significantly while preserving the control accuracy required for safe teleoperated driving operations.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent segments the image into multiple regions of varying importance and processes/transmits them with different priorities and resolutions. Critical regions are transmitted with higher priority and sufficient detail for control accuracy, while less critical regions are processed more efficiently, reducing overall transmission latency without compromising control decisions.

Inventive Principle:
Principle #1Segmentation

4Loss of information

If network bandwidth is increased to transmit more data, then data completeness improves, but network costs and infrastructure requirements increase

Engineering Contradiction:
Improvedata completenessVSAvoidnetwork resource consumption
Core Design Contradiction:
Loss of informationVSQuantity of substance

Solution Approach 1:

The patent extracts and transmits only the essential image content relevant for vehicle control, achieving data completeness for safe operation without requiring increased network bandwidth. This selective transmission reduces network resource consumption by up to 50% while maintaining complete and accurate information for teleoperated driving control.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentEP3902248A1Method and communication system for optimizing image transmission in teleoperated driving applications
Publication Date: 2021.10.27 DEUTSCHE TELEKOM AG
  • EP3902248A1 patent drawingFigure 1
  • EP3902248A1 patent drawing
  • EP3902248A1 patent drawing

AI summary

In teleoperated driving (ToD) applications, large amounts of data (image data) must be transmitted reliably in a time- and quality-optimized manner. Often, the image data is compressed for this purpose. The present invention relates to methods and arrangements for optimizing image transmission in ToD applications. In particular, the invention relates to a method for optimizing image transmission in ToD applications in which image transmission takes place between at least one vehicle (1) and at least one remote driver (2), or at least one communication/control unit (2a) used/usable by the driver, or at least one ToD station (3), via at least one communication channel (6), wherein image data is compressed for image transmission. According to the invention, the image data for image transmission is analyzed with regard to predefined/predefinable image content, whereby a selection of image content is performed.This ensures a good level of quality with reduced data volume.