Remote Driving Video Encoding With ROI-Based Bandwidth Control

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current wireless communication networks face limitations in capacity, especially during hand-over between neighboring cells, which affects the reliable transmission of live video data for remote vehicle driving, necessitating optimization of video encoding and transmission.

Innovation Solution

A vehicle system equipped with a capturing unit, video encoding unit, and control unit that optimizes video encoding based on real-time driving information, pre-determined location information, and environmental factors, such as defining a region-of-interest for higher quality encoding when driving at higher speeds and uniform quality at lower speeds, using modern video coding technologies like H.264/AVC or H.265/HEVC for efficient transmission.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If video encoding quality is increased to improve transmission reliability, then the perceived quality of live video data is improved, but the bandwidth consumption increases and transmission reliability deteriorates due to network capacity limitations

Engineering Contradiction:
Improvetransmission reliabilityVSAvoidbandwidth consumption
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent applies local quality by defining a region of interest (ROI) in the video frame that corresponds to the area in front of the vehicle. Video encoding is performed with higher quality parameters (higher bitrate, higher resolution) specifically for the ROI area, while other areas of the video frame are encoded with lower quality parameters. This resolves the contradiction by concentrating bandwidth consumption on the most critical area for remote driving safety, thereby improving perceived quality where it matters most without proportionally increasing overall bandwidth usage.

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If uniform high quality encoding is applied to the entire video frame, then the perceived quality is improved, but the bandwidth consumption increases significantly

Engineering Contradiction:
Improvevideo encoding qualityVSAvoidbandwidth consumption
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent implements local quality by differentiating encoding parameters across different spatial regions of the video frame. The ROI area (in front of the vehicle) receives high-quality encoding with higher bitrate and resolution, while peripheral areas receive lower-quality encoding. This resolves the contradiction between manufacturing precision (video encoding quality) and quantity of substance (bandwidth consumption) by applying quality selectively rather than uniformly, thereby reducing overall bandwidth consumption while maintaining high perceived quality in critical areas.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent applies segmentation by dividing the video frame into distinct regions: the ROI area in front of the vehicle and the remaining peripheral areas. Each segment is encoded with different quality parameters appropriate to its importance for remote driving operations. This segmentation approach resolves the contradiction by allowing high encoding quality where necessary while reducing quality (and thus bandwidth consumption) in less critical areas.

Inventive Principle:
Principle #1Segmentation

3Productivity

If video encoding is optimized for high speed driving with region of interest, then the transmission efficiency is improved, but the device complexity increases due to dynamic parameter adjustment

Engineering Contradiction:
Improvetransmission efficiencyVSAvoidencoding control complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent applies dynamics by making the video encoding parameters adaptive rather than static. The ROI definition, bitrate allocation, and resolution settings are dynamically adjusted based on real-time driving conditions (vehicle speed, acceleration, steering angle). This resolves the contradiction between productivity (transmission efficiency) and device complexity by implementing intelligent dynamic adaptation that optimizes transmission efficiency for different driving scenarios while managing complexity through rule-based or algorithmic control of the encoding parameters.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentEP3937491B1Optimizing video encoding for remote driving applications
Publication Date: 2024.09.11 VAY TECH GMBH
  • EP3937491B1 patent drawingFigure 1
  • EP3937491B1 patent drawingFigure 2
  • EP3937491B1 patent drawingFigure 3(a)~3(b)

AI summary

The present invention relates to a vehicle (20) that is adapted to be remotely driven via a wireless communication network (30). The vehicle comprises a capturing unit (21) for capturing live video data (50) of the vehicle's environment, a video encoding unit (22) for video encoding the captured live video data, a transmission unit (23) for transmitting the encoded live video data via the wireless communication network, and a control unit (24) for controlling the video encoding unit and/or the transmission unit. The control unit is adapted to control the video encoding unit to optimize the video encoding of the captured live video data and/or to control the transmission unit to optimize the transmission of the encoded live video data, wherein the controlling is based on one, two or all of: (i) predetermined location information associated with a current location of the vehicle; (ii) real-time driving information associated with current driving parameters of the vehicle, and; (iii) real-time environment information associated with a current environment of the vehicle.