Autonomous Vehicle Image Prioritization Under Bandwidth Constraints

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Autonomous vehicle operations face challenges in providing effective assistance due to unstable or low-bandwidth communication channels, which degrade image quality and disrupt data transfer, making it difficult to monitor and control vehicles remotely.

Innovation Solution

A method for bandwidth-constrained image processing that determines data transfer rates, prioritizes sensor data based on location and availability, and generates optimized state data by filtering and using predictive data to improve image quality and communication, even under constrained bandwidth conditions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If image data is transmitted over low-bandwidth communication channels, then communication efficiency is improved, but image quality deteriorates

Engineering Contradiction:
Improvecommunication efficiencyVSAvoidimage quality
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent segments image data into prioritized components, transmitting high-priority regions (such as areas containing pedestrians, vehicles, or road signs) at higher quality while reducing or omitting low-priority regions. This segmentation allows effective use of limited bandwidth while maintaining critical image quality for autonomous vehicle operation.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality enhancement by allocating higher transmission quality to specific local regions of the image that are critical for vehicle operation, such as areas with detected objects or regions of interest. Non-critical regions are transmitted at lower quality or omitted entirely, optimizing the trade-off between bandwidth usage and image quality.

Inventive Principle:
Principle #3Local quality

2Loss of information

If sensor data from all sensors is transmitted, then measurement completeness is improved, but bandwidth consumption increases

Engineering Contradiction:
Improvemeasurement completenessVSAvoidbandwidth consumption
Core Design Contradiction:
Loss of informationVSQuantity of substance

Solution Approach 1:

The patent extracts and transmits only the most essential sensor data based on prioritization attributes. Sensors detecting critical information (such as LIDAR data showing nearby obstacles or cameras detecting pedestrians) are selected for transmission, while less critical sensor data is omitted or transmitted at reduced fidelity, reducing overall bandwidth consumption while maintaining measurement completeness for safety-critical parameters.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent dynamically adjusts which sensor data is transmitted based on real-time conditions. The prioritization of sensors changes dynamically according to the vehicle's operational context, such as prioritizing forward-facing sensors when the vehicle is moving forward and side sensors when changing lanes, optimizing bandwidth usage while maintaining measurement completeness for current operational needs.

Inventive Principle:
Principle #15Dynamics

3Manufacturing precision

If high-resolution image data is transmitted, then image quality is improved, but data transfer rate decreases

Engineering Contradiction:
Improveimage qualityVSAvoiddata transfer rate
Core Design Contradiction:
Manufacturing precisionVSSpeed

Solution Approach 1:

The patent applies partial action by transmitting only the necessary portion of image data at high resolution rather than the entire image. High-resolution transmission is applied selectively to regions of interest (such as detected objects or areas with high motion activity), while other regions are transmitted at lower resolution or omitted, maintaining acceptable image quality for critical areas while improving overall data transfer rate.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentEP3552358B1Bandwidth constrained image processing for autonomous vehicles
Publication Date: 2021.05.26 NISSAN NORTH AMERICA INC
  • EP3552358B1 patent drawingFigure 1
  • EP3552358B1 patent drawingFigure 2
  • EP3552358B1 patent drawingFigure 3

AI summary

Methods, apparatuses, systems, and non-transitory computer readable storage media for providing bandwidth constrained image processing are described. The disclosed technology determines a data transfer rate of at least one signal received from a vehicle, the at least one signal including state/status data of the vehicle. In response to determining that the data transfer rate satisfies a data transfer rate criterion, a location of the vehicle and a location of at least one of a plurality of objects that obstruct the at least one signal is determined using the state data and external data associated with the vehicle. The disclosed technology generates optimized state data using the state data and the external data.