Remote Vehicle Camera Stitching for Fast Distortion-Aware Operation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing remote vehicle operation systems face challenges in combining camera images from overlapping camera ranges, leading to distortion and delayed image processing, which can hinder quick and clear visualization for operators.
Innovation Solution
A method and device for remote vehicle operation that sets a vertical position for combining overlapping camera images based on operation content data, allowing for efficient image processing and adjustment of the connecting position, and adding auxiliary images to blank regions, ensuring visibility and rapid image provision.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If camera images are combined to reduce unnecessary information, then information efficiency is improved, but image processing time increases and distortion occurs
Solution Approach 1:
The patent applies preliminary action by pre-defining multiple candidate connecting positions and their corresponding composite image layouts before actual remote operation begins. When combining camera images during operation, the system simply selects from these pre-prepared options based on the current operation type, avoiding complex real-time image processing and position calculation.
2Loss of information
If camera images are combined to reduce unnecessary information, then information efficiency is improved, but image distortion and deviation occur
Solution Approach 1:
The patent pre-calculates and stores multiple candidate connecting positions that account for different camera viewpoints and overlapping ranges. Each candidate position is optimized in advance to minimize distortion and deviation for specific operation scenarios, allowing the system to select the most appropriate position without real-time image processing.
Solution Approach 2:
The patent applies local quality by setting different connecting positions for different regions of the composite image based on the operation type. For example, when the operation requires focusing on the front area, the connecting position is adjusted to prioritize front view alignment, while operations requiring side area focus use connecting positions optimized for side views.
3Manufacturing precision
If complex image processing is performed to eliminate distortion, then image quality is improved, but image provision speed decreases
Solution Approach 1:
The patent performs all complex image processing准备工作 in advance, including calculating connecting positions, adjusting image parameters, and preparing composite image layouts. During actual remote operation, the system only needs to retrieve and display pre-processed images, achieving both high image quality and fast provision speed.
Data Source
AI summary
A method to perform remote operation of a mobile vehicle is provided. In this method, data of two types of camera images whose imaging ranges partially overlap each other and data of operation content in the remote operation are acquired. Further, based on the data of the operation content, the position in the vertical direction at which the two types of the camera images are combined is set. Further, at least one of the two types of the camera images is moved in the vertical direction such that the two types of the camera images are combined at the set position in the vertical direction, and the two types of the camera images are combined. Then, a composite image of the two types of the camera images is output from a display of a remote operation device.