Remote Driving Image Stitching via Cloud Intermediary

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current automatic driving technologies rely heavily on image processing for remote control, but they face challenges in efficiently stitching and transmitting multiple-channel image data from vehicles to remote cockpit apparatuses, leading to potential delays and reduced remote driving effectiveness.

Innovation Solution

A cloud apparatus performs a stitching process on multiple-channel image data from vehicles, creating a stitched image that is then sent to the remote cockpit apparatus, leveraging high computing performance to reduce latency and improve remote driving control.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If multiple-channel image data is transmitted directly from vehicle to remote cockpit apparatus, then transmission is simpler, but remote driving effect deteriorates due to delays and lack of seamless visualization

Engineering Contradiction:
Improveremote driving effectVSAvoidimage processing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

A cloud apparatus is introduced as an intermediary between the vehicle and remote cockpit apparatus. The cloud apparatus receives multiple-channel image data from the vehicle, performs stitching processing to create seamless composite images, and transmits the processed images to the remote cockpit apparatus. This mediator resolves the contradiction by improving remote driving effect through professional image processing while managing complexity centrally in the cloud rather than at vehicle or cockpit endpoints.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If stitching process is performed on multiple-channel image data, then remote driving effect is improved, but processing time and latency increase

Engineering Contradiction:
Improveremote driving effectVSAvoidimage processing latency
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The cloud apparatus performs stitching processing on image data in advance before transmission to the remote cockpit apparatus. By pre-processing the multiple-channel image data into seamless composite images and storing them in the cloud, the system reduces real-time latency during actual remote driving operations. The stitching work is done preliminarily when network conditions are favorable, improving responsiveness when needed.

Inventive Principle:
Principle #10Preliminary action

3Ease of operation

If cloud apparatus performs stitching process, then remote cockpit apparatus can control vehicle more effectively, but network bandwidth consumption increases

Engineering Contradiction:
Improveremote control effectivenessVSAvoidnetwork bandwidth consumption
Core Design Contradiction:
Ease of operationVSLoss of energy

Solution Approach 1:

The cloud apparatus merges multiple-channel image data from different vehicle cameras into single seamless composite images through stitching processing. By combining multiple data streams into unified images, the system reduces the total number of separate image transmissions required to the remote cockpit apparatus, thereby managing network bandwidth consumption more efficiently while improving remote control effectiveness.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS12114100B2Image processing method in remote control, device, apparatus and program product
Publication Date: 2024.10.08 BEIJING BAIDU NETCOM SCI & TECH CO LTD
  • US12114100B2 patent drawing
  • US12114100B2 patent drawing
  • US12114100B2 patent drawing

AI summary

An image processing method in remote control, a device, an apparatus and a program product are provided and related to the field of automatic driving technologies. The specific implementation solution includes receiving image information sent by a vehicle, wherein the image information includes multiple-channel image data collected by the vehicle; performing a stitching process on the multiple-channel image data, to obtain a stitched image; sending the stitched image to a remote cockpit apparatus for controlling the vehicle.